Is there a fundamental difference between how a program like chatgp learns and how a human learns?
In: 2
Machine-learning systems like GPT “learn” through a number of techniques, none of which is anything like Human learning. It’s more like breeding animals.
Imagine an AI as a grid of numbers.
Start with 100,000 of these AI grids and fill them with random numbers.
Ask these grids to do something useful, like answer a question that you already know the answer to.
“Kill” all the AIs that get the answer wrong.
Take the ones that got the answer right and let them “breed”, creating new AIs with mixes of the numbers that got that answer right, plus some randomness added in.
Repeat that thousands or millions of times, with millions of questions that you already know the answers to.
The “descendants” (keeping with the animal metaphor) that survive can reliably answer questions correctly.
For Chat GPT, the “questions” are what do various types of writing on a variety of topics look like, and the answers are text that looks like a valid sentence, short essay, white paper, etc., but doesn’t have to be factual or correct because correctness isn’t what they’re looking for.
Latest Answers