Like the title says, how have we gone from ChatGPT being the apex of it’s type (and therefore presumably very complex and rare) to seeing so many clones in sl short a time? Wouldn’t the code/ system that makes up ChatGPT be in copyright or the code be difficult to mimic, wouldn’t the amount of data scraping take forever?
In: Technology
It’s relatively simple technology. GPT architecture was created in Google and published in 2018, another paper that improved this tech is called “attention is all you need” was a breakthrough and also was published. Facebook launched it open source models LLaMa right after ChatGPT surge. Everything else is training, data collection, fine-tuning. It’s expensive, but nothing complex here
Latest Answers