What about GPU Architecture makes them superior for training neural networks over CPUs?

Question

In ML/AI, GPUs are used to train neural networks of various sizes. They are vastly superior to training on CPUs. Why is this?

In: 679

Answer 1

CPUs are like swiss army knives. They can do many different types of computations well. GPUs are like filetting knives. Very good at doing a specific thing – filleting fish. You can fillet your fish with a swiss army knife, but are much better off doing it with a filleting knife.

In the case of GPUs, the filleting is a type of activity that is also very useful for ML applications.

Answer 2

CPUs are like swiss army knives. They can do many different types of computations well. GPUs are like filetting knives. Very good at doing a specific thing – filleting fish. You can fillet your fish with a swiss army knife, but are much better off doing it with a filleting knife.

In the case of GPUs, the filleting is a type of activity that is also very useful for ML applications.