What about GPU Architecture makes them superior for training neural networks over CPUs?

Question

In ML/AI, GPUs are used to train neural networks of various sizes. They are vastly superior to training on CPUs. Why is this?

In: 679

Answer 1

A CPU is a fleet of trucks, a GPU a swarm of a thousand delivery bikes.

AI and neural networks generally work on crossing and analyzing a ridiculous amount of small elements simultaneously, in an extensive dataset, which GPU architectures are more suited for.

Answer 2

A CPU is a fleet of trucks, a GPU a swarm of a thousand delivery bikes.

AI and neural networks generally work on crossing and analyzing a ridiculous amount of small elements simultaneously, in an extensive dataset, which GPU architectures are more suited for.