This goes for almost all AI language models that I’ve used.
I ask it a question, and instead of giving me a paragraph instantly, it generates a response word by word, sometimes sticking on a word for a second or two. Why can’t it just paste the entire answer straight away?
In: Technology
Most of the tools you will be using (generative ai) will be building their response, next word, next pixel, next frame, based on the probability of the next word, pixel, frame being correct. That is why you are seeing it come in word by word. Equally they could build the entire sentence for you and send it at once, but this is more engaging and magical 🙂
Latest Answers