why do models like ChatGPT forget things during conversations or make things up that are not true?
In: 803
It looks like a chat to you, with history, but to GPT, every time you send a message, it’s aa brand new “person” with no memory of you. With every message you send, it receives your message and a bit of context based on keywords in your last message.
It’s like if you were talking to your grandma that has dementia.
Whenever you say something, even in the middle of the conversation, it’s like the first thing you say to her as far as she knows. But then based on the words and concept you used in what you said, her brain is like “hey, that vaguely connect to something” and it brings part of that “something” up.
SO she’s able to answer you semi-coherently, even tho you’re just a stranger and her answer is based on your last message and a few vague unprecise memories of past things you’ve said or she used to know.
Latest Answers