![Page 1: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/1.jpg)
![Page 2: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/2.jpg)
2
![Page 3: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/3.jpg)
3
![Page 4: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/4.jpg)
4
Walren McCulloch & Walter Pitts proposed a very simple model of biological neurons
![Page 5: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/5.jpg)
5
The Percepton is one of the simplest ANN architectures, invented in 1957 by Frank Rosenblatt.
![Page 6: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/6.jpg)
6
![Page 7: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/7.jpg)
7
Hebb’s rule : “Cells that fire together, wire together.”=> The connection between two neurons is increased whenever
they have the same output.
- The perceptron does not reinforce connections that lead to the wrong output. - It is fed one training instance at a time, and for each instance it makes its predictions.
![Page 8: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/8.jpg)
8
![Page 9: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/9.jpg)
9
![Page 10: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/10.jpg)
10
![Page 11: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/11.jpg)
11
![Page 12: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/12.jpg)
12
![Page 13: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/13.jpg)
13
![Page 14: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/14.jpg)
14
TF.Learn offers a Scikit-Learn-compatible API.
![Page 15: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/15.jpg)
15
MNIST dataset
The first step : construction phase
The second step : execution phase
![Page 16: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/16.jpg)
16
![Page 17: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/17.jpg)
17
![Page 18: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/18.jpg)
18
![Page 19: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/19.jpg)
19
![Page 20: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/20.jpg)
20
Next Step : Fine-Tuning NN Hyperparameters
Random search, Grid search …
![Page 21: 자료구조 1차 과제 - WordPress.com · Figure 10-5. Perceptron diagram . w. is the connection weight between the ith input neuron and the jth output neu- ron. is the ith input](https://reader033.vdocuments.site/reader033/viewer/2022050507/5f986497d6c64f617f376fb1/html5/thumbnails/21.jpg)
21
It has a actually been shown that an MLP with just one hidden layer can model even the most complex functions provided it has enough neurons.
But! It is the fact that deep networks have a much higher parameter efficiency than shallow ones: they can model complex functions using exponentially fewer neurons than shallow nets, making them much faster to train.