Colossus is the world’s most powerful AI training system. It has 20,000 GPUs more than the one from OpenAI, which uses 80,000 GPUs. This means that Colossus can process more data and learn faster than any other AI system out there. In a few months it is supposed to be doubled in size, hence the 200k.
Latest Answers