what does it mean for a machine to “learn?” How do we quantify something like skill growth when, for humans, learning is a subjective experience?

Question

what does it mean for a machine to “learn?” How do we quantify something like skill growth when, for humans, learning is a subjective experience?

In: 4

Answer 1

> How do we quantify something like skill growth

Split off a chunk of your dataset for validation. For a classification problem, it’s usually a simple matter of accuracy=correct classifications your program managed/total items in the validation set. If it’s a regression problem (guess a numeric value instead of trying to attach a label to something), usually something like mean squared error is used.

> for humans, learning is a subjective experience?

But I can rate your ability to recognize Monet paintings by showing you a bunch of paintings and asking you if they are from Monet or not and noting down the ratio of mistakes, yes? Or, something simpler, this is the same concept as common multiple choice tests are graded in school.