eli5: Why does ChatpGPT give responses word-by-word, instead of the whole answer straight away?

1.51K viewsOtherTechnology

This goes for almost all AI language models that I’ve used.

I ask it a question, and instead of giving me a paragraph instantly, it generates a response word by word, sometimes sticking on a word for a second or two. Why can’t it just paste the entire answer straight away?

In: Technology

28 Answers

Anonymous 0 Comments

Just think of it like this … it’s just a statistics machine. it does not “know” the answer … it just knows what words are more probable to come after what words.

That’s why it’s sometimes sooo wrong.

After it generated a word, it just gets the “best fitting” word that goes the best after that word. After it has 2 words, he works out “what word” fits the best after the next 2 words and so on.

You are viewing 1 out of 28 answers, click here to view all answers.