“ChatGPT consumes over half a million kilowatts of electricity each day, an amount staggering enough to service about two hundred million requests. ChatGPT’s daily power usage is nearly equal to 180,000 U.S. households, each using about twenty-nine kilowatts.”
One of main concerns around ChatGPT and similar LLM models becoming ubiquitous is that there is not enough electricity in the world to run those massive GPU farms.
Latest Answers