Eli5: how does a program like chatgp actually “learn” something

477 views

Is there a fundamental difference between how a program like chatgp learns and how a human learns?

In: 2

18 Answers

Anonymous 0 Comments

It’s important to note that it’s dicey to talk about AI with the same words we apply to humans. “Learning” really isn’t the same thing for a computer program, but it’s analogous.

There are different kinds of AI, and ChatGPT is one type called a Large Language Model (LLM). Oversimplifying, it takes giant amounts of text, especially conversations, and builds a model of what an actual conversation looks like. Plus, it takes all that text as a database, kind of like Google does when it indexes to give you search results. Google doesn’t really “know” anything, it just has a good database and a good algorithm for returning search results.

It’s also important to note that these LLMs are a bit better at having a conversation that looks right than at providing accurate information. In fact, if the text they’re trained on is consistently wrong about something, they will be too. They also make up text that fits their model of what an answer should look like, and sometimes what they make up is nonsense.

It’s a cool advancement, and they’ll keep getting refined and improved, but there are for sure shortfalls.

You are viewing 1 out of 18 answers, click here to view all answers.