eli5: Why does ChatpGPT give responses word-by-word, instead of the whole answer straight away?

1.49K viewsOtherTechnology

This goes for almost all AI language models that I’ve used.

I ask it a question, and instead of giving me a paragraph instantly, it generates a response word by word, sometimes sticking on a word for a second or two. Why can’t it just paste the entire answer straight away?

In: Technology

28 Answers

Anonymous 0 Comments

It is actually doing it letter by letter, because it’s not thinking, just analyzing a big book of text and running the statics on what letter comes next based on the prompt and general chances of ANY letter coming next. There is no intelligence in these algorithms, just messy statistics that aren’t actually the correct answer because we aren’t looking for correctness, just plausibility.

You are viewing 1 out of 28 answers, click here to view all answers.