eli5 : Why does ai like ChatGPT or Llama 3 make things up and fabricate answers?

1.50K viewsOtherTechnology

I asked it for a list of restaurants in my area using google maps and it said there is a restaurant (Mug and Bean) in my area and even used a real address but this restaurant is not in my town. Its only in a neighboring town with a different street address

In: Technology

22 Answers

Anonymous 0 Comments

These systems lack any inherit knowledge, all they do is try to predict the next word in a sentence.

They are reasoning engines, not databases. You can to an extend avoid hallucinations by feeding it context relevant information (eg. the Wikipedia page on the topic you are asking questions about) together with your prompt, this is what many tools utilizing ChatGPT’s API do, but it may still invent stuff even if this is done.

Due to this risk there always needs to be a human in the loop who validates the output of these models, and you should never trust anything these models claim unless you can validate it.

You are viewing 1 out of 22 answers, click here to view all answers.