GPU is basically it’s own entire extra computer. The compute chip, It’s own memory, it’s own IO, onboard power management, the cooler, an abbreviated case holding the entire assembly together, the only thing it doesn’t have is storage.
But really, it’s not like the electronics couldn’t be packed smaller, they absolutely can. But the true limiting factor is cooling. You have so much power use, therefore you need that large of a heatsink, that much of a fan etc. That is what truly sets the size.
Latest Answers