What about GPU Architecture makes them superior for training neural networks over CPUs?

Question

In ML/AI, GPUs are used to train neural networks of various sizes. They are vastly superior to training on CPUs. Why is this?

In: 679

Answer 1

A lot of what machine learning does is multiplying vectors, which so happens to be what GPU’s are designed to do as well. GPU’s do it to calculate with polygons. And most of what machine learning does is as said multiplying vectors which makes them a great fit.

Not to mention that a good CPU has at the very top end 64 cores wheras a GPU has thousnads of compute units and also a far wider data bus.

Answer 2

A lot of what machine learning does is multiplying vectors, which so happens to be what GPU’s are designed to do as well. GPU’s do it to calculate with polygons. And most of what machine learning does is as said multiplying vectors which makes them a great fit.

Not to mention that a good CPU has at the very top end 64 cores wheras a GPU has thousnads of compute units and also a far wider data bus.