eli5: How do you design a deep learning algorithm?
In: Technology
You take your inputs and multiply them by a random weight.
Inputs of [1, 0, 3]
Weigjts if [2, 5, 1]
[1, 0, 3] * [2, 5, 1] = [2, 0, 3]
Then you take the sum of those
[2, 0, 3] = 5
That goes through an activation function this let’s the model learn more complex patterns. A function is common is relu. How it works is if the sum is > 0 return the sum otherwise return 0.
5>0=5
Then the output
5 would be comparable against the true value say its true value is 7.
Each loop it will take the output (5) and compare to the true value (7)
After it makes the comparison it will calculate the loss and update the random weights until the loss is under a certain score.
Then you’ve trained a simple perceptron.
For a deep learning algorithms you would combine multiple perceptrons.
(Then theres more advanced methods like convolutions and recurring nodes but I won’t go into that)
Latest Answers