How does ‘cutting edge’ technology suddenly get implemented by other parties soon after new technology is unveiled…for example. chatgpt came out as an amazing new technology that was like nothing we ever saw, and then right after, we hear that other parties are coming up with their own version of chatgpt…If the technology was so secret, then how come everyone else just started coming up with their own version so soon?
In: 506
OpenAI’s models are priviate, but the methods for creating a large language model are mostly public. The challange isn’t inventing the method; the challenge is training it and running it.
To do that, you need lots of high-powered computers, skilled programmers, and *tons and tons* of data. Those are all things that companies like Google, Facebook/Meta, Snapchat, Microsoft, etc. all have access to already. Once it became apparent to them that demand for LLMs was high, it was just a matter of shuffling their resources around to make it happen.
Also, a lot of AI — such as Bing Chat — are actually just GPT with pre-prompts or minor tweaks.
Latest Answers