ChatGPT just announced they need an absurd amount of video cards. Why are video cards used and not dedicated CPUs? Why not make a motherboard that has the right processors?
In: 2
It’s a function of FLOPS, floating point operations per second. Almost all AI works essentially by fine tuning massive amounts of numbers with decimal points. These are floats.
There is specialized hardware that does this, and there are certainly times in which companies have used it.
But there is also consumer facing hardware that is already exceptionally good at it: Graphics Cards.
The benefit is that they are mature, which allows for both cost consideration as well as software solutions that have been finely tuned over time for efficiency.
Latest Answers