eli5: How do Captcha’s know the correct answer to things and beyond verification what are their purpose?

334 views

I have heard that they are used to train AI and self driving cars and what not, but if thats the case how do they know the right answers to things. IF they need to train AI to know what a traffic light is, how do they know im actually selecting traffic lights? and could we just collectively agree to only select the top right square over and over and would their systems eventually start to believe it that this was the right answer? Sorry this is a lot of questions

In: 3352

16 Answers

Anonymous 0 Comments

Captcha is an umbrella term for a variety of tests to identify if the answering party is a human, hence the name, Completely Automated Public Turing to tell Computers and Humans Apart.

First captcha test were randomly generated characters. Since computer generated the answer and knew it on the server side, it was assumed answer cannot be stolen, only answered. But computers and developers are useful at solving issues. They used character recognition tools to solve them. Then it became an arm race, they started warping text, using math questions, etc. In all cases computer randomly generated an answer and a question to go with it. Only thing server needed to do is to check your answer.

Then someone got a clever idea; people will try to answer it the best way they can, so we should start asking questions that we don’t know the answers of. Character recognition is not bulletproof, so ask the words we are not sure. If enough people say that word is “triangulation” computer will use this information to enhance future recognition performance. This is called blind entry, where multiple people are asked to identify same thing without knowing what others answered, and it has been in use for data entry tasks. Captcha is a way to utilize free labor.

Today we are using pictures because we are done with words (probably). Yet another computer term is computer vision where we process images to extract information, find barcodes, read text, identify an object or plant, face id. Computer vision systems also employ systems for recognition, most common is Neural Networks. A neural network is a very complex system where you train by giving the system thousands of taxi images and telling it “hey if you see something like this, say it is a cab.” Then you will feed pictures of other cars and birds and planes. When you feed a new picture system will says it looks like car %60, but also looks like a boat %35. Computer will find some pictures very confusing but will provide a possibility for each object type it learned before.

Now you see the pattern, for training people need pictures of objects and name of the objects. To get this data you need people to identify them, this is where we come to the picture, literally.

Computer will select some of the pictures it is sure of and some it is not and use us as dat entry operator for blind entry.

You are viewing 1 out of 16 answers, click here to view all answers.