What about GPU Architecture makes them superior for training neural networks over CPUs?

Question

In ML/AI, GPUs are used to train neural networks of various sizes. They are vastly superior to training on CPUs. Why is this?

In: 679

Answer 1

GPUs are hard to program generically but are easy to program to process lots of things in parallel (graphics/pixels), which is good for NNs and can speed up training by a 100x or more. Ive had training go from days to minutes

Answer 2

GPUs are hard to program generically but are easy to program to process lots of things in parallel (graphics/pixels), which is good for NNs and can speed up training by a 100x or more. Ive had training go from days to minutes