eli5: Why does ChatpGPT give responses word-by-word, instead of the whole answer straight away?

1.47K viewsOtherTechnology

This goes for almost all AI language models that I’ve used.

I ask it a question, and instead of giving me a paragraph instantly, it generates a response word by word, sometimes sticking on a word for a second or two. Why can’t it just paste the entire answer straight away?

In: Technology

28 Answers

Anonymous 0 Comments

You could get a 30second long loading bar for every reply you give… But most people would drop the tool almost instantly, as our attention span keeps on shrinking at a staggering pace.

As the things stand, it is much more desirable to have *immediate* output than having *complete* output.

Also LLM technology works one word at a time at the moment, thus the visual output reflects the digital output of the algorithm

You are viewing 1 out of 28 answers, click here to view all answers.