How does ‘cutting edge’ technology suddenly get implemented by other parties soon after new technology is unveiled…for example. chatgpt came out as an amazing new technology that was like nothing we ever saw, and then right after, we hear that other parties are coming up with their own version of chatgpt…If the technology was so secret, then how come everyone else just started coming up with their own version so soon?
In: 506
There was a key paper around attention released in 2017. Basically everyone apart from Google realised it was a big thing. So lots of companies started building LLM of a similar type after that paper.
>Attention Is All You Need
>
>https://arxiv.org/abs/1706.03762
Latest Answers