What about GPU Architecture makes them superior for training neural networks over CPUs?

Question

In ML/AI, GPUs are used to train neural networks of various sizes. They are vastly superior to training on CPUs. Why is this?

In: 679

Answer 1

GPUs have thousands or even 10s of thousands of cores, vs a CPU with single digit or maybe 10s of cores.

GPU cores can only do maths (vs CPU cores that need to handle all kinds of logic), but the difficult part of AI training is loads and loads of maths so a GPU handles that much faster.

Answer 2

GPUs have thousands or even 10s of thousands of cores, vs a CPU with single digit or maybe 10s of cores.

GPU cores can only do maths (vs CPU cores that need to handle all kinds of logic), but the difficult part of AI training is loads and loads of maths so a GPU handles that much faster.