This goes for almost all AI language models that I’ve used.
I ask it a question, and instead of giving me a paragraph instantly, it generates a response word by word, sometimes sticking on a word for a second or two. Why can’t it just paste the entire answer straight away?
In: Technology
Because all it’s doing is generating what the next work is based on probability. It doesn’t have an entire answer.
Ok, it could generate all the words first and send that , but then people would complain about the delay.
Latest Answers