how can random noise help us - purdue universityyipn/talks/cmumathclub0309.pdf · one of the five...

32
How Can Random Noise Help Us Global Transports from Thermal Fluctuations Aaron N. K. Yip Department of Mathematics Purdue University 0 1 2 3 4 5 6 7 8 9 10 x 10 4 -150 -100 -50 0 50 100 150 200 250 Random Walk Time Position How Can Random Noise Help Us – p.1/32

Upload: others

Post on 14-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

How Can Random Noise Help UsGlobal Transports from Thermal Fluctuations

Aaron N. K. YipDepartment of Mathematics

Purdue University

0 1 2 3 4 5 6 7 8 9 10

x 104

−150

−100

−50

0

50

100

150

200

250Random Walk

Time

Pos

ition

How Can Random Noise Help Us– p.1/32

Page 2: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Basics of Random Walki.e. Drunken WalkerStart from the origin, to decide where to go next, youtoss a coin, if the outcome is ahead, you move onestep to theright , if it is a tail , you move to theleft.

5. . . . .....

−1−2−3

q p

0 1 2 3 4

Let Xi = 1 or−1 if the i-th toss is a head or tail.Then yourposition after timen is given by:

Sn = X1 + X2 + · · ·Xn

How Can Random Noise Help Us– p.2/32

Page 3: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Basics of Random Walk – 2

0 5 10 15 20 25 30 35 40 45 50−5

−4

−3

−2

−1

0

1Coin Tossing Experiment

Time

Cap

ital

Supposeheadcomes up withprobability p andtailwith probability q = 1 − p. (If p = q = 1

2, the coin is

calledfair .)

What is thestatisticsof your position,Xn (at timen)?How Can Random Noise Help Us– p.3/32

Page 4: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Binomial Distribution

Prob(Sn = j) =

n

n+j

2

pn+j2 q

n−j2

where

0

@

n

m

1

A =n(n − 1)(n − 2) · · · (n − m + 1)

m(m − 1)(m − 2) · · · (2)(1)=

n!

m!(n − m)!

−25 −20 −15 −10 −5 0 5 10 15 20 250

0.02

0.04

0.06

0.08

0.1

0.12

0.14

0.16

0.18

Position

Pro

babi

lity

Probability Distribution of the Position of an Unbiased Random Walk after 20 Steps

How Can Random Noise Help Us– p.4/32

Page 5: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Gaussian (Normal) Distribution

Gµ,σ(x) =1√

2πσ2e−

(x−µ)2

2σ2

Mean = µ, Variance = σ2

−4 −3 −2 −1 0 1 2 3 40

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4Standard Gaussian (Normal) Distribution, Mean = 0, Variance = 1

x

Pro

babi

lity

Dis

trib

utio

n F

unct

ion

How Can Random Noise Help Us– p.5/32

Page 6: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Binomial converges to Gaussian Distribution

As n → ∞,

−15 −10 −5 0 5 10 150

0.02

0.04

0.06

0.08

0.1

0.12

0.14Comparison between Binomial and Normial Distribution

x

Pro

babi

lity

Dis

trib

utio

n

What is thisTheoremcalled?

How Can Random Noise Help Us– p.6/32

Page 7: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Binomial converges to Gaussian Distribution

As n → ∞,

−15 −10 −5 0 5 10 150

0.02

0.04

0.06

0.08

0.1

0.12

0.14Comparison between Binomial and Normial Distribution

x

Pro

babi

lity

Dis

trib

utio

n

Central Limit Theorem

How Can Random Noise Help Us– p.7/32

Page 8: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Gaussian Distribution and Heat DiffusionHeat Equation – describes thediffusion of heat:

∂u

∂t=

1

2

∂2u

∂x2; u(x, 0) = δ(x)

The solution is given by:u(x, t) =1√2πt

e−x2

2t

— Gaussian Distribution, mean zero and variance√

t

−10 −8 −6 −4 −2 0 2 4 6 8 100

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4Solution for Heat Diffusion

x

Hea

t Dis

trib

utio

n

t=1

t=2

t=3

t=10

How Can Random Noise Help Us– p.8/32

Page 9: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Random Walk and Brownian Motion

Let thetime step△t andspatial step△x converge tozero in such a way that

(△x)2

△t−→ Constant

thenRandom Walk can be described byBrownianMotion .

0 5 10 15 20 25 30 35 40 45 50−5

−4

−3

−2

−1

0

1Coin Tossing Experiment

Time

Cap

ital

0 1 2 3 4 5 6 7 8 9 10

x 104

−150

−100

−50

0

50

100

150

200

250Random Walk

Time

Pos

ition

How Can Random Noise Help Us– p.9/32

Page 10: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Random Walk and Brownian Motion – 2

How Can Random Noise Help Us– p.10/32

Page 11: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Brownian Motion – Some Historical Notes

Robert Brown observed the random motion ofpollens in water.

How Can Random Noise Help Us– p.11/32

Page 12: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Brownian Motion – Some Historical Notes – 2

Albert Einstein made use of the concept of Brownianmotion to estimate thesizeof solute molecules in asolvent.

one of thefive fundamental papers Einstein wrote in1905:

Einstein’s Miraculous Year:Five Papers that Changed the Face of Physics.

Princeton University Press, 2005, John Stachel (ed.)

How Can Random Noise Help Us– p.12/32

Page 13: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Brownian Motion – Some Historical Notes – 3• The 1926 Nobel Prize in physics was received by

J. Perrin for his precise determination of theAvogadro’s number. He compared theexperimentally measured diffusivity of sphericalgranules in water with theStokes-Einsteinformula for thediffusion coefficient:

D =kBT

6πηR, and D = lim

t→∞〈X(t)2〉

2t

• Other contributors to the understanding ofBrownian Motion: Smoluchowski; Langevin;Ornstein-Ohlenback; Wiener; Levy; ....

How Can Random Noise Help Us– p.13/32

Page 14: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Gambler Ruin ProblemGiven initial capitalC, between0 andA, you keep on playing

until your capital becomes0 or A.

If p = 12

(i.e. the game is fair), then

Prob(Win) =C

A, Prob(Lose)= 1 − C

A

Theexpected durationof the game, either lose or win is:

C(A − C)

If p 6= 12

, the above formulas become (z = qp

)

Prob(Win) =zC − 1

zA − 1, Prob(Lose)=

zA − zC

zA − 1

Expected duration =

C

q − p

«

A

q − p

« „

1 − zC

1 − zA

«

How Can Random Noise Help Us– p.14/32

Page 15: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Winning by Losing Strategies

Parrondo’s Paradox. G. P. Harmer, D. Abbott,Nature, 1999

Now you can choose two different games to play:

• Game A.One slightly biased coin is used:

Prob(Head) = 0.495

• Game B.Two different coins are used, depending on your

current sum (capital).

1. If your current sum is divisible by three i.e.

0, 3, 6, 9 . . ., you toss the coin with

Prob(Head)) = 0.095;

2. otherwise, you toss the coin withProb(Head) = 0.745.

How Can Random Noise Help Us– p.15/32

Page 16: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Playing Game A Only

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000−400

−300

−200

−100

0

100

200Outcome of Playing Game A

Time

Cap

ital

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000−90

−80

−70

−60

−50

−40

−30

−20

−10

0

10Average Outcome of Playing Game A

Time

Cap

ital

How Can Random Noise Help Us– p.16/32

Page 17: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Playing Game B only

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000−250

−200

−150

−100

−50

0

50

100Outcome of Playing Game B

Time

Cap

ital

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000−80

−70

−60

−50

−40

−30

−20

−10

0Average Outcome of Playing Game B

Time

Cap

ital

How Can Random Noise Help Us– p.17/32

Page 18: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Playing Games of A and B in sequence:

AABBAABBAABB....

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000−200

−100

0

100

200

300

400

500Outcome of Playing Games A and B in sequence

Time

Cap

ital

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000−20

0

20

40

60

80

100

120

140Average Outcome of Playing Games A and B in Sequence

Time

Cap

ital

How Can Random Noise Help Us– p.18/32

Page 19: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Playing Games A and B at Random:

AABABAABBBBABB...

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000−200

−100

0

100

200

300

400Outcome of Playing Games A and B in Randomly Sequence

Time

Cap

ital

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000−20

0

20

40

60

80

100

120

140

160

180Average Outcome of Playing Games A and B in Random Sequence

Time

Cap

ital

How Can Random Noise Help Us– p.19/32

Page 20: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Random Walk in Periodic Environment• Homogeneous Environment.

(No global drift )

.• Inhomogeneous (Symmetric) Environment.

(No global drift )

.How Can Random Noise Help Us– p.20/32

Page 21: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Random Walk in Periodic Environment – 2• Inhomogeneous (Asymmetric, Unbiased)

Environment. (Global drift? )

.• Inhomogeneous (Biased) Environment.

(Global drift? )

.How Can Random Noise Help Us– p.21/32

Page 22: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Random Walk in Periodic Environment – 2• Inhomogeneous (Asymmetric, Unbiased)

Environment. (Still no global drift )

.• Inhomogeneous (Biased) Environment.

(Global drift )

.How Can Random Noise Help Us– p.22/32

Page 23: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Extraction of useful workfrom random noiseandun-biased butnon-equilibrium fluctuations

• (I) Potential U(x).

. . .• (II) Potential ≡ 0.

. ..(I) and (II) individually does not giveglobal drift .

How Can Random Noise Help Us– p.23/32

Page 24: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Extraction of useful work – 2nowalternate (I) and (II) with certainfrequency.

• (I) Potential U(x) is ON.

. . .• (II) Potential U(x) is OFF.

. . .How Can Random Noise Help Us– p.24/32

Page 25: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Extraction of useful work – 3• (I) Potential U(x) is ON again.

.• Soeffectively, there is aglobal drift .

...How Can Random Noise Help Us– p.25/32

Page 26: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Optimal Frequency – Stochastic Resonance

optim

al d

rift

frequence of turning U onand off

optimal frequency

Key ingredients:• Spatially asymmetric environment;• Non-equilibrium fluctuations;• Noise!

How Can Random Noise Help Us– p.26/32

Page 27: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Back to Parrondo’s ParadoxPlaying Game A.

.winning prob = 0.495

Playing Game B.

winning prob = 0.75

.winning prob= 0.1

Soeffectively, there is awinning tendency.

How Can Random Noise Help Us– p.27/32

Page 28: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Applications of Stochastic Resonance

Astumian, Science, Vol 276, 1997

How Can Random Noise Help Us– p.28/32

Page 29: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Applications of Stochastic Resonance –2

Astumian, Science, Vol 276, 1997

How Can Random Noise Help Us– p.29/32

Page 30: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Applications of Stochastic Resonance –3

Hanggi, et. al., Ann. Phys., Vol 14, 2005

How Can Random Noise Help Us– p.30/32

Page 31: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

Applications of Stochastic Resonance?

Feynman’s Lecture Notes in Physics

How Can Random Noise Help Us– p.31/32

Page 32: How Can Random Noise Help Us - Purdue Universityyipn/talks/cmuMathClub0309.pdf · one of the five fundamental papers Einstein wrote in 1905: Einstein’s Miraculous Year: Five Papers

THANK YOU

How Can Random Noise Help Us– p.32/32