What about GPU Architecture makes them superior for training neural networks over CPUs?

Question

In ML/AI, GPUs are used to train neural networks of various sizes. They are vastly superior to training on CPUs. Why is this?

In: 679

Answer 1

Focus are tightly focused super efficient machines VS a CPU that is more of a jack of all trades.

What a video card can do, it can do that thing 100x better than a CPU can.

That’s why there is so much effort directed toward breaking things down into chunks that can be offloaded onto video cards for applications like curing cancer or bitcoin mining. You want the processor to be relied on as little as possible and the video card to be relied on as much as possible.

Answer 2

Focus are tightly focused super efficient machines VS a CPU that is more of a jack of all trades.

What a video card can do, it can do that thing 100x better than a CPU can.

That’s why there is so much effort directed toward breaking things down into chunks that can be offloaded onto video cards for applications like curing cancer or bitcoin mining. You want the processor to be relied on as little as possible and the video card to be relied on as much as possible.