eli5: How do you design a deep learning algorithm?
In: Technology
Deep learning algorithms belong to “black box” family. This means that there is magical black box where you feed inputs and get outputs. You have no idea why or how it produces those results it just does. This is real ELI5 answer.
If you open the box you will see bunch of wires with different widths that are randomly connected to each other. Each time you put input in the size of wires change little bit and might make new connections (or more specify change 0 width to something else). When the output comes out you say how good it was and should the box use same wires next time. Bit by bit it learns but because everything inside the box is random there is noway of saying how it works.
Practical example is social media feeds. They get content as input and give you some post that they think you will watch the most. Now we have woken up in world where feeds are full of angry racist stuff but that’s because people view that stuff and engage with it. Some times connections are more complicated. Sometimes they give social media post from your local restaurant because friend of you liked a post about some recipe with same cuisine. No way of knowing why or how they suggested that place to you because wires are too complicated to analyze. This also means you cannot tweak the algorithm and give it new rules because it would mess the whole interconnected thing.
Latest Answers