![Page 1: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/1.jpg)
March 2016
![Page 2: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/2.jpg)
Mainstream Media
![Page 3: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/3.jpg)
![Page 4: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/4.jpg)
1997
![Page 5: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/5.jpg)
Ing cup 1985 – 2000(up to 1,400,000$)
(1985-2000)
![Page 6: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/6.jpg)
5d win 1998
![Page 7: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/7.jpg)
October 2015
![Page 8: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/8.jpg)
This is the first time that a computer program has defeated a human professional player in the
full-sized game of Go, a featpreviously thought to be at
least a decade away.
Silver, D. et al., 2016. Mastering the game of Go with deep neural networks and tree search. Nature, 529(7587), p.484-489.
January 2016
![Page 9: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/9.jpg)
November 2015
![Page 11: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/11.jpg)
![Page 12: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/12.jpg)
Go
![Page 13: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/13.jpg)
Computational Challenge
![Page 14: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/14.jpg)
Monte Carlo Method
![Page 15: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/15.jpg)
Neural Networks
![Page 16: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/16.jpg)
Revolution with Neural Networks
![Page 17: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/17.jpg)
What did we learn?
![Page 18: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/18.jpg)
Go
![Page 19: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/19.jpg)
![Page 20: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/20.jpg)
![Page 21: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/21.jpg)
![Page 22: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/22.jpg)
![Page 23: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/23.jpg)
![Page 24: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/24.jpg)
![Page 25: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/25.jpg)
![Page 26: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/26.jpg)
![Page 27: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/27.jpg)
![Page 28: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/28.jpg)
![Page 29: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/29.jpg)
![Page 30: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/30.jpg)
![Page 31: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/31.jpg)
![Page 32: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/32.jpg)
![Page 33: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/33.jpg)
![Page 34: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/34.jpg)
![Page 35: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/35.jpg)
![Page 36: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/36.jpg)
![Page 37: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/37.jpg)
![Page 38: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/38.jpg)
![Page 39: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/39.jpg)
![Page 40: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/40.jpg)
![Page 41: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/41.jpg)
![Page 42: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/42.jpg)
![Page 43: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/43.jpg)
![Page 44: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/44.jpg)
![Page 45: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/45.jpg)
![Page 46: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/46.jpg)
![Page 47: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/47.jpg)
![Page 48: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/48.jpg)
![Page 49: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/49.jpg)
![Page 50: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/50.jpg)
![Page 51: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/51.jpg)
![Page 52: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/52.jpg)
![Page 53: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/53.jpg)
![Page 54: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/54.jpg)
Computational Challenge
![Page 55: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/55.jpg)
Go vs. Chess
![Page 56: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/56.jpg)
Complex vs. Complicated
![Page 57: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/57.jpg)
„While the Baroque rules of chess could only have been created by humans, the rules of
go are so elegant, organic, and rigorously logical that if intelligent life forms exist
elsewhere in the universe, they almost certainly play go.“
Edward Lasker (chess grandmaster)
![Page 58: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/58.jpg)
Larger board19x19 vs. 8x8
![Page 59: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/59.jpg)
Almost every move is legal
![Page 60: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/60.jpg)
Average branching factor:250 vs 35
![Page 61: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/61.jpg)
State Space Complexity:10 171 vs 1047
![Page 62: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/62.jpg)
1080
![Page 63: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/63.jpg)
Global impact of moves
![Page 64: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/64.jpg)
68957966354765
685766345
857635
563
6
MAX
MIN
MAX
MIN
MAX
![Page 65: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/65.jpg)
Evaluation function
![Page 66: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/66.jpg)
![Page 67: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/67.jpg)
Monte Carlo Method
![Page 68: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/68.jpg)
What is Pi?
![Page 69: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/69.jpg)
How do you determine Pi?
![Page 70: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/70.jpg)
![Page 71: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/71.jpg)
2006
![Page 72: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/72.jpg)
Browne, Cb, and Edward Powley. 2012. A survey of monte carlo tree search methods. Intelligence and AI 4, no. 1: 1-49
![Page 73: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/73.jpg)
2/4
1/1 0/1 1/1 0/1
A1D5
F13C7
![Page 74: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/74.jpg)
2/4
1/1 0/1 1/1 0/1
A1D5
F13C7
Selection
![Page 75: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/75.jpg)
2/4
1/1 0/1 1/1 0/1
A1D5
F13C7
0/0
B5
Expansion
![Page 76: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/76.jpg)
2/4
1/1 0/1 1/1 0/1
A1D5
F13C7
0/0
B5
Simulation
![Page 77: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/77.jpg)
Random
![Page 78: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/78.jpg)
3/5
2/2 0/1 1/1 0/1
A1D5
F13C7
1/1
B5
Backpropagation
![Page 79: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/79.jpg)
3/5
2/2 0/1 1/1 0/1
A1D5
F13C7
1/1
B5
Perspective
![Page 80: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/80.jpg)
2/5
1/2 0/1 1/1 0/1
A1D5
F13C7
1/1
B5
Perspective
![Page 81: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/81.jpg)
Multi Armed Bandit
![Page 82: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/82.jpg)
Exploitation vs Exploration
![Page 83: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/83.jpg)
winsvisits
+explorationFactor √ ln (totalVisits)visits
![Page 84: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/84.jpg)
15042
86/193
0/1 1/2 0/2
36/1116
2/2
58/151
1/2 0/23/3
![Page 85: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/85.jpg)
15042
86/193
0/1 1/2 0/2
36/1116
2/2
58/151
1/2 0/23/3
![Page 86: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/86.jpg)
15042
86/193
0/1 1/2 0/2
36/1116
2/2
58/151
1/2 0/23/3
![Page 87: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/87.jpg)
Not Human like?
![Page 88: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/88.jpg)
Aheuristic
![Page 89: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/89.jpg)
Generate a valid random move
![Page 90: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/90.jpg)
Who has won?
![Page 91: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/91.jpg)
![Page 92: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/92.jpg)
General Game Playing
![Page 93: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/93.jpg)
Anytime
![Page 94: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/94.jpg)
Lazy
![Page 95: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/95.jpg)
![Page 96: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/96.jpg)
AMAF + RAVE
![Page 97: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/97.jpg)
Expert Knowledge
![Page 98: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/98.jpg)
Neural Networks
![Page 99: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/99.jpg)
2014
![Page 100: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/100.jpg)
What does this even mean?
![Page 101: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/101.jpg)
Neural Networks
![Page 102: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/102.jpg)
Input “Hidden” Layer Output
Neural Networks
![Page 103: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/103.jpg)
Weights
![Page 104: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/104.jpg)
Bias/Threshold
![Page 105: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/105.jpg)
Sum of Weights >= Threshold
![Page 106: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/106.jpg)
Activation
![Page 107: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/107.jpg)
Training
![Page 108: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/108.jpg)
Adjust parameters
![Page 109: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/109.jpg)
Supervised Learning
InputExpectedOutput
![Page 110: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/110.jpg)
Backpropagation
![Page 111: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/111.jpg)
Data set
![Page 112: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/112.jpg)
Training data + test data
![Page 113: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/113.jpg)
Training
![Page 114: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/114.jpg)
Verify
![Page 115: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/115.jpg)
Overfitting
![Page 116: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/116.jpg)
Deep Neural Networks
![Page 117: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/117.jpg)
Michael A. Nielsen, "Neural Networks and Deep Learning", Determination Press, 2015 http://neuralnetworksanddeeplearning.com
Convolutional Neural Networks
![Page 118: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/118.jpg)
Michael A. Nielsen, "Neural Networks and Deep Learning", Determination Press, 2015 http://neuralnetworksanddeeplearning.com
Local Receptive Field
![Page 119: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/119.jpg)
Michael A. Nielsen, "Neural Networks and Deep Learning", Determination Press, 2015 http://neuralnetworksanddeeplearning.com
Stride
![Page 120: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/120.jpg)
Michael A. Nielsen, "Neural Networks and Deep Learning", Determination Press, 2015 http://neuralnetworksanddeeplearning.com
Shared weights and biases
![Page 121: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/121.jpg)
Michael A. Nielsen, "Neural Networks and Deep Learning", Determination Press, 2015 http://neuralnetworksanddeeplearning.com
Multiple Feature maps/filters
![Page 122: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/122.jpg)
Michael A. Nielsen, "Neural Networks and Deep Learning", Determination Press, 2015 http://neuralnetworksanddeeplearning.com
Pooling
![Page 124: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/124.jpg)
12 layered DCNN
![Page 125: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/125.jpg)
64 to 192 feature maps per layer
![Page 126: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/126.jpg)
2.3 million parameters630 million connections
![Page 127: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/127.jpg)
● Stone Colour x 3● Liberties x 4● Liberties after move played x 6● Legal Move x 1● Turns since x 5● Capture Size x 7 ● Ladder Move x 1● KGS Rank x 9
Input Features
![Page 128: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/128.jpg)
55% Accuracy
![Page 129: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/129.jpg)
Mostly beats GnuGo
![Page 130: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/130.jpg)
Combined with MCTS
![Page 131: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/131.jpg)
Selection
![Page 132: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/132.jpg)
Asynchronous GPU Power
![Page 133: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/133.jpg)
Revolution
![Page 134: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/134.jpg)
Silver, D. et al., 2016. Mastering the game of Go with deep neural networks and tree search. Nature, 529(7587), p.484-489.
Networks in Training
![Page 135: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/135.jpg)
Silver, D. et al., 2016. Mastering the game of Go with deep neural networks and tree search. Nature, 529(7587), p.484-489.
AlphaGo Search
![Page 136: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/136.jpg)
1202 CPUs and 176 GPUs
![Page 137: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/137.jpg)
Tensor PU
![Page 138: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/138.jpg)
Human Instinct Policy NetworkReading Capability SearchPositional Judgement Value Network
3 Strengths of AlphaGo
![Page 139: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/139.jpg)
Human Instinct Policy NetworkReading Capability SearchPositional Judgement Value Network
Most Important Strength
![Page 140: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/140.jpg)
More Natural
![Page 141: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/141.jpg)
Style
![Page 142: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/142.jpg)
So when AlphaGo plays a slack looking move,we may regard it as a mistake,
but perhaps it should more accurately be viewedas a declaration of victory?
An Younggil 8p
![Page 143: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/143.jpg)
Game 2
![Page 144: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/144.jpg)
Game 4
![Page 145: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/145.jpg)
![Page 146: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/146.jpg)
Game 4
![Page 147: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/147.jpg)
Game 4
![Page 148: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/148.jpg)
What can we learn?
![Page 149: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/149.jpg)
Making X fastervs
Doing less of X
![Page 150: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/150.jpg)
Modularizing small components
![Page 151: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/151.jpg)
Benchmark everything
![Page 152: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/152.jpg)
Solving problems the human wayvs
Solving problems the computer way
![Page 153: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/153.jpg)
Don't blindly dismiss approaches as infeasible
![Page 154: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/154.jpg)
One Approach vs
Combination of Approaches
![Page 155: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/155.jpg)
Joy of Creation
![Page 156: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/156.jpg)
PragTob/Rubykon
![Page 157: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/157.jpg)
PragTob/web-go
![Page 160: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/160.jpg)
Sources
● Maddison, C.J. et al., 2014. Move Evaluation in Go Using Deep Convolutional Neural Networks.
● Silver, D. et al., 2016. Mastering the game of Go with deep neural networks and tree search. Nature, 529(7587), p.484-489.
● Michael A. Nielsen, "Neural Networks and Deep Learning", Determination Press, 2015 http://neuralnetworksanddeeplearning.com
● Gelly, S. & Silver, D., 2011. Monte-Carlo tree search and rapid action value estimation in computer Go. Artificial Intelligence, 175(11), p.1856-1876.
● I. Althöfer, “On the Laziness of Monte-Carlo Game Tree Search In Non-tight Situations,” Friedrich-Schiller Univ., Jena, Tech. Rep., 2008.
● Browne, C. & Powley, E., 2012. A survey of monte carlo tree search methods. IEEE Transactions on Intelligence and AI in Games, 4(1), p.1-49.
● Gelly, S. & Silver, D., 2007. Combining online and offline knowledge in UCT. Machine Learning, p.273-280.
● https://www.youtube.com/watch?v=LX8Knl0g0LE&index=9&list=WL
![Page 161: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/161.jpg)
Photo Credit● http://www.computer-go.info/events/ing/2000/images/bigcup.jpg
● https://en.wikipedia.org/wiki/File:Kasparov-29.jpg
● http://www.geforce.com/hardware/desktop-gpus/geforce-gtx-titan-black/product-images
● http://giphy.com/gifs/dark-thread-after-lCP95tGSbMmWI
● https://cloudplatform.googleblog.com/2016/05/Google-supercharges-machine-learning-tasks-with-custom-chip.html
● https://gogameguru.com/i/2016/01/Fan-Hui-vs-AlphaGo-550x364.jpg
● CC BY 2.0
– https://en.wikipedia.org/wiki/File:Deep_Blue.jpg
– https://www.flickr.com/photos/luisbg/2094497611/
● CC BY-SA 3.0
– https://en.wikipedia.org/wiki/Alpha%E2%80%93beta_pruning#/media/File:AB_pruning.svg
● CC BY-SA 2.0
– https://flic.kr/p/cPUtny
– https://flic.kr/p/dLSKTQ
– https://www.flickr.com/photos/83633410@N07/7658272558/
![Page 162: What did AlphaGo do to beat the strongest human Go player? (Strange Group Version)](https://reader031.vdocuments.site/reader031/viewer/2022030305/587071631a28ab48378b7a15/html5/thumbnails/162.jpg)
Photo Credit● CC BY-NC-ND 2.0
– https://flic.kr/p/q15pzb
– https://flic.kr/p/bHSj7D
– https://flic.kr/p/ixSsfM
– https://www.flickr.com/photos/waxorian/4228645447/
– https://www.flickr.com/photos/pennstatelive/8972110324/
– https://www.flickr.com/photos/dylanstraub/6428496139/
● https://en.wikipedia.org/wiki/Alphabet_Inc.#/media/File:Alphabet_Inc_Logo_2015.svg
● CC BY 3.0
– https://en.wikipedia.org/wiki/File:Pi_30K.gif