neural simulated classical and quantum annealing
TRANSCRIPT
![Page 1: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/1.jpg)
Mohamed Hibat-Allah
Neural Simulated Classical and
Quantum Annealing
AQC, June 2021
![Page 2: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/2.jpg)
2
Joint work with
RoelandWiersema
JuanCarrasquilla
EstelleInack
Roger Melko
Mohamed Hibat-Allah, Estelle Inack, Roeland Wiersema, Roger G. Melko, Juan Carrasquilla, Variational Neural Annealing, arXiv:2101.10154.
Neural Simulated Classical and Quantum Annealing
![Page 3: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/3.jpg)
Question?
3
Can we solve real-world Optimization Problems using
< Neural Networks | Annealing >?
Neural Simulated Classical and Quantum Annealing
![Page 4: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/4.jpg)
Question?
4
Can we solve real-world Optimization Problems using
Recurrent Neural Networks by taking advantage of Simulated
(Classical and Quantum) Annealing?
Neural Simulated Classical and Quantum Annealing
![Page 5: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/5.jpg)
5
Outline
o 1 - Recurrent Neural Networks (RNN).
o 2 - Variational Classical Annealing with RNNs.
o 3 - Variational Quantum Annealing with RNNs.
o 4 - Promising results on prototypical models.
Neural Simulated Classical and Quantum Annealing
![Page 6: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/6.jpg)
6
1 - Recurrent Neural Networks
Neural Simulated Classical and Quantum Annealing
![Page 7: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/7.jpg)
Recurrent Neural Networks (RNNs)
7
Very powerful at generating sequential data.
• Speech recognition, machine translation, times series reconstruction.
Neural Simulated Classical and Quantum Annealing
![Page 8: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/8.jpg)
Recurrent Neural Networks (RNNs)
8
Very powerful at generating sequential data.
• Speech recognition, machine translation, times series reconstruction.
-Juan Carrasquilla, Giacomo Torlai, Roger G. Melko, Leandro Aolita
Reconstructing quantum states with generative models, Nature Machine Intelligence, 2019.
-Mohamed Hibat-Allah, Martin Ganahl, Lauren E. Hayward, Roger G. Melko, Juan Carrasquilla, Recurrent Neural Network Wave Functions,
PRReasearch, 2020.
-Christopher Roth, Iterative Retraining of Quantum Spin Models using Recurrent Neural Networks,
2020.
RNNs and Quantum-many body physics
Neural Simulated Classical and Quantum Annealing
![Page 9: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/9.jpg)
RNN Wave Functions
9
Neural Simulated Classical and Quantum Annealing
Recurrent Neural Network Wave Functions,
PRReasearch, Jun 2020.
![Page 10: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/10.jpg)
10
RNN Wave Functions
Neural Simulated Classical and Quantum Annealing
Recurrent Neural Network Wave Functions,
PRReasearch, Jun 2020.
![Page 11: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/11.jpg)
11
RNN Wave Functions
Neural Simulated Classical and Quantum Annealing
Recurrent Neural Network Wave Functions,
PRReasearch, Jun 2020.
![Page 12: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/12.jpg)
12
RNN Wave Functions
Neural Simulated Classical and Quantum Annealing
Recurrent Neural Network Wave Functions,
PRReasearch, Jun 2020.
![Page 13: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/13.jpg)
13
RNN Wave Functions
An approximation of the ground state is found!
Recurrent Neural Network Wave Functions,
PRReasearch, Jun 2020.
Neural Simulated Classical and Quantum Annealing
![Page 14: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/14.jpg)
14
2 - Variational Classical Annealing (VCA)
with RNNs
Neural Simulated Classical and Quantum Annealing
![Page 15: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/15.jpg)
15
-Goal: Find ground state of a target (classical) Hamiltonian:
Simulated Classical Annealing
Neural Simulated Classical and Quantum Annealing
![Page 16: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/16.jpg)
16
-Goal: Find ground state of a target (classical) Hamiltonian:
Simulated Classical Annealing
-Examples:
• Spin glass models.
• Traveling salesman problems.
• Protein folding problems,…
Neural Simulated Classical and Quantum Annealing
![Page 17: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/17.jpg)
17
-Goal: Find ground state of a target (classical) Hamiltonian:
Simulated Classical Annealing
Entropy term (thermal fluctuations)
-Free Energy:
Neural Simulated Classical and Quantum Annealing
![Page 18: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/18.jpg)
Simulated Classical Annealing
18Neural Simulated Classical and Quantum Annealing
![Page 19: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/19.jpg)
19
High-Temperature Regime
Neural Simulated Classical and Quantum Annealing
![Page 20: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/20.jpg)
20
Warmup Phase
𝐅𝐑𝐍𝐍 from a randomly initialized RNN
Neural Simulated Classical and Quantum Annealing
![Page 21: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/21.jpg)
21
Warmup Phase
Gradient descent
Neural Simulated Classical and Quantum Annealing
![Page 22: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/22.jpg)
22
Warmup Phase
Gradient descent
Neural Simulated Classical and Quantum Annealing
![Page 23: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/23.jpg)
23
Warmup Phase
Gradient descent
Neural Simulated Classical and Quantum Annealing
![Page 24: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/24.jpg)
24
Warmup Phase
Neural Simulated Classical and Quantum Annealing
![Page 25: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/25.jpg)
25
Annealing Step
Neural Simulated Classical and Quantum Annealing
![Page 26: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/26.jpg)
26
Training Step
Gradient descent
Neural Simulated Classical and Quantum Annealing
![Page 27: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/27.jpg)
27
Close to zero temperature
Gradient descent
Global minimum
Neural Simulated Classical and Quantum Annealing
![Page 28: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/28.jpg)
28
Optimization at T = 0
Gradient descent
Neural Simulated Classical and Quantum Annealing
![Page 29: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/29.jpg)
29
Gradient descent
Optimization at T = 0
Neural Simulated Classical and Quantum Annealing
![Page 30: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/30.jpg)
30
Gradient descent
Optimization at T = 0
Local minimum
Neural Simulated Classical and Quantum Annealing
![Page 31: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/31.jpg)
31
3 - Variational Quantum Annealing (VQA)
with RNN Wave Functions
Neural Simulated Classical and Quantum Annealing
![Page 32: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/32.jpg)
32
RNNwave function
Variational Quantum Annealing with RNNs
Initial Hamiltonian:
“Ground state is simple”
Neural Simulated Classical and Quantum Annealing
![Page 33: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/33.jpg)
33
Gradient descent
Warmup phase
Neural Simulated Classical and Quantum Annealing
![Page 34: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/34.jpg)
34
Gradient descent
Warmup phase
Neural Simulated Classical and Quantum Annealing
![Page 35: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/35.jpg)
35
Gradient descent
Warmup phase
Neural Simulated Classical and Quantum Annealing
![Page 36: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/36.jpg)
36
Annealing Step
Neural Simulated Classical and Quantum Annealing
![Page 37: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/37.jpg)
37
Annealing Step
Neural Simulated Classical and Quantum Annealing
![Page 38: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/38.jpg)
38
Training Step
Gradient descent
Neural Simulated Classical and Quantum Annealing
![Page 39: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/39.jpg)
39
Training Step
Gradient descent
Neural Simulated Classical and Quantum Annealing
![Page 40: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/40.jpg)
40
Annealing Step
Neural Simulated Classical and Quantum Annealing
![Page 41: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/41.jpg)
41
Training Step
Neural Simulated Classical and Quantum Annealing
![Page 42: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/42.jpg)
42
Variational Quantum Annealing (VQA)
Neural Simulated Classical and Quantum Annealing
![Page 43: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/43.jpg)
43
Variational Quantum Annealing (VQA)
Neural Simulated Classical and Quantum Annealing
![Page 44: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/44.jpg)
44
Variational Quantum Annealing (VQA)
Neural Simulated Classical and Quantum Annealing
![Page 45: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/45.jpg)
45
Variational Quantum Annealing (VQA)
Ground state of target Hamiltonian is found!
Neural Simulated Classical and Quantum Annealing
![Page 46: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/46.jpg)
The Variational Adiabatic Theorem
46
is sufficient to guarantee:
Under a set of assumptions [1], a total number of gradient steps:
[1] Variational Neural Annealing, 2101.10154
Neural Simulated Classical and Quantum Annealing
![Page 47: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/47.jpg)
The Variational Adiabatic Theorem
47
Conclusions:
[1] Variational Neural Annealing, 2101.10154
Neural Simulated Classical and Quantum Annealing
![Page 48: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/48.jpg)
48
4 - Results on spin-glass models
Neural Simulated Classical and Quantum Annealing
![Page 49: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/49.jpg)
49
Spin Ising glass in 2D
Edwards-Anderson model:
The couplings are drawn from random uniform distribution in
the range [-1,1)
Neural Simulated Classical and Quantum Annealing
![Page 50: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/50.jpg)
50
Spin Ising glass in 2D (N = 10x10 spins)
Edwards-Anderson model:
Residual energy:
Variational Classical Annealing (VCA)
• 𝐓(𝐭) = 𝐓𝟎 𝟏 − 𝐭/𝐍𝐚𝐧𝐧𝐞𝐚𝐥𝐢𝐧𝐠
Variational Quantum Annealing (VQA)
• 𝐁𝐱(𝐭) = 𝐁𝐱𝟎 𝟏 − 𝐭/𝐍𝐚𝐧𝐧𝐞𝐚𝐥𝐢𝐧𝐠
Neural Simulated Classical and Quantum Annealing
![Page 51: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/51.jpg)
51
Spin Ising glass in 2D (N = 10x10 spins)
Variational Classical Annealing (VCA)
• 𝐓(𝐭) = 𝐓𝟎 𝟏 − 𝐭/𝐍𝐚𝐧𝐧𝐞𝐚𝐥𝐢𝐧𝐠
Variational Quantum Annealing (VQA)
• 𝐁𝐱(𝒕) = 𝐁𝐱𝟎 𝟏 − 𝐭/𝐍𝐚𝐧𝐧𝐞𝐚𝐥𝐢𝐧𝐠
Classical-Quantum Optimization (CQO)
• 𝐓 = 𝟎, 𝐁𝐱 = 𝟎
Edwards-Anderson model:
Neural Simulated Classical and Quantum Annealing
![Page 52: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/52.jpg)
52
Spin Ising glass in 2D (N = 40x40 spins)
SA: Simulated Annealing.
SQA: Path-Integral Quantum Monte Carlo.
Edwards-Anderson model:
Neural Simulated Classical and Quantum Annealing
![Page 53: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/53.jpg)
Sampling advantage of RNNs
53Neural Simulated Classical and Quantum Annealing
SA and SQAMetropolis sampling
VCA (RNNs)Autoregressive (exact) sampling
![Page 54: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/54.jpg)
Fully-connected spin glasses (N = 100 spins)
54
The couplings are drawn from a gaussian distribution with
mean 0 and variance 1.
Sherrington-Kirkpatrick model:
Residual energy:
Neural Simulated Classical and Quantum Annealing
![Page 55: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/55.jpg)
55
Takeaways
o We can use neural networks to emulate Classical and Quantum Annealing to
solve optimization problems.
o Neural Machine Translation (RNNs) meets Classical and Quantum Annealing.
o VCA is superior compared to VQA.
o VCA is superior compared to SA and SQA.
Neural Simulated Classical and Quantum Annealing
More results: Variational Neural Annealing, arXiv:2101.10154.
![Page 56: Neural Simulated Classical and Quantum Annealing](https://reader030.vdocuments.site/reader030/viewer/2022013022/61d1afbb2e2f8a4bcf6b3c15/html5/thumbnails/56.jpg)
56
Thank you for your attention!
Neural Simulated Classical and Quantum Annealing
o We can use neural networks to emulate Classical and Quantum Annealing to
solve optimization problems.
o Neural Machine Translation (RNNs) meets Classical and Quantum Annealing.
o VCA is superior compared to VQA.
o VCA is superior compared to SA and SQA.
More results: Variational Neural Annealing, arXiv:2101.10154.