What about GPU Architecture makes them superior for training neural networks over CPUs?

Question

In ML/AI, GPUs are used to train neural networks of various sizes. They are vastly superior to training on CPUs. Why is this?

In: 679

Answer 1

CPUs are generalists. They can do many things, but are not necessarily specialized in any particular area.

GPUs are specialists. They cannot do most of the things CPU can do or even if they can they would be way slower than CPUs. However, there are a few things which GPUs can do a lot of at the same time (i.e. in parallel), making them way faster than CPUs.

CPUs are way better for some things in a similar way that makes humans much better suited for walking through the thick jungle than bicycles.

GPUs are way better for NNs than CPUs in a similar way that makes airplanes way better for intercontinental travel than bicycles.

Answer 2

CPUs are generalists. They can do many things, but are not necessarily specialized in any particular area.

GPUs are specialists. They cannot do most of the things CPU can do or even if they can they would be way slower than CPUs. However, there are a few things which GPUs can do a lot of at the same time (i.e. in parallel), making them way faster than CPUs.

CPUs are way better for some things in a similar way that makes humans much better suited for walking through the thick jungle than bicycles.

GPUs are way better for NNs than CPUs in a similar way that makes airplanes way better for intercontinental travel than bicycles.