what every electrical engineer should know about nonlinear ...what every electrical engineer should...

84
1 www.tyndall.ie Michael Peter Kennedy FIEEE University College Cork, Ireland © 2013 IEEE CAS Society, Santa Clara Valley Chapter 05 August 2013 What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems www.tyndall.ie Outline Part 1: Motivation and Key Concepts (70) Part 2: Examples (5 x 18) SPICE DC Analysis Schmitt Trigger Colpitts Oscillator Injection-Locking Digital Delta-Sigma Modulator 2/168

Upload: others

Post on 20-Jun-2020

7 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

1

www.tyndall.ie

Michael Peter Kennedy FIEEE University College Cork, Ireland

© 2013

IEEE CAS Society, Santa Clara Valley Chapter

05 August 2013

What Every Electrical Engineer

Should Know about Nonlinear

Circuits and Systems

www.tyndall.ie

Outline

• Part 1: Motivation and Key Concepts (70)

• Part 2: Examples (5 x 18) SPICE DC Analysis

Schmitt Trigger

Colpitts Oscillator

Injection-Locking

Digital Delta-Sigma Modulator

2/168

Page 2: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

2

www.tyndall.ie

Part 1

Motivation and Key Concepts

3/168

www.tyndall.ie

Motivation and Key Concepts

• Motivation Linear Systems

Nonlinear Systems

Nonlinear Effects

• Key Concepts in Nonlinear Dynamical

Systems

4/168

Page 3: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

3

www.tyndall.ie

Motivation

“It doesn’t matter how beautiful your theory

is, it doesn’t matter how smart you are.

If it doesn’t agree with experiment, it’s

wrong.”

Richard P. Feynman

5/168

www.tyndall.ie

Linear Systems

• Global behavior Unique solution; independent of initial conditions

• Frequencies don’t mix

• Tractable

• Exact solution

• Quantitative analysis

6/168

Page 4: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

4

www.tyndall.ie

Nonlinear Systems

• Local and global behavior Coexisting solutions; dependence on initial conditions

Small- and large-signal behavior

• What does “frequency” mean?

• Normally intractable

• Approximate solutions

• Qualitative analysis

7/168

www.tyndall.ie

“Static” (Memoryless) Nonlinearities

• “Weak” and “strong” nonlinearities Harmonic distortion

Saturation

Non-monotonicity

Hysteresis?

8/168

Page 5: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

5

www.tyndall.ie

• Harmonic distortion (superharmonics)

• Saturation

• Amplitude limiting

• Bistability

• “Hysteresis”

• Subharmonics

• Synchronization

Nonlinear Effects 9/168

www.tyndall.ie

Motivation

“…even the theory of the simplest valve oscillator

cannot in principle be reduced to the

investigation of a linear differential equation and

requires the study of a nonlinear equation.''

…a linear equation, for example, cannot explain

the fact that a valve oscillator, independently of

the initial conditions, has a tendency to reach

determined steady-state conditions.”

A.A. Andronov, A.A. Vitt, and S.E. Khaikin,

Theory of Oscillators, Pergamon Press, 1966

10/168

Page 6: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

6

www.tyndall.ie

Examples

• SPICE DC Analysis

• Schmitt Trigger

• Colpitts Oscillator

• Injection-Locking

• Digital Delta-Sigma Modulator

11/168

www.tyndall.ie

Examples

• SPICE DC analysis: Why does my simulation

not converge? Why does my oscillator not

start in simulation?

12/168

Page 7: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

7

www.tyndall.ie

Example: SPICE DC analysis

• The basins of attraction are intertwined…

XQ1 XQ2 XQ3

1 2 3 3 3 1 1 … …

13/168

www.tyndall.ie

Examples

• Schmitt Trigger: What happens between

the switching thresholds?

14/168

Page 8: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

8

www.tyndall.ie

Example: Schmitt trigger

• Voltage transfer characteristic (measured)

15/168

www.tyndall.ie

Examples

• Colpitts Oscillator: How large should the

loop gain be?

16/168

Page 9: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

9

www.tyndall.ie

Example: Colpitts Oscillator

• Design space

17/168

www.tyndall.ie

Examples

• Injection-Locking: What’s the division

ratio?

18/168

Page 10: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

10

www.tyndall.ie

Example: Injection-Locking

fout=5 MHz

fin=20 MHz

• A point on line (d) of the

sensitivity lines (Q=40).

Vout @ fout Vin @ fin

0

110MHz

2f

LC

19/168

www.tyndall.ie

Examples

• Digital Delta Sigma Modulator: why do

different values of the input yield

different quantization noise spectra?

20/168

Page 11: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

11

www.tyndall.ie

Example: DDSM

• Different inputs produce different spectra

MASH 1-1-1

wordlength: 17 bits

(i) X=1

(ii) X=216

21/168

www.tyndall.ie

Motivation

“I've wondered why it took us so long to catch on.

We saw it and yet we didn't see it.

Or rather we were trained not to see it...

The truth knocks on the door and you say, 'Go

away, I'm looking for the truth,' and so it goes

away…”

Robert M. Pirsig,

Zen and the Art of Motorcycle Maintenance, Corgi, 1974

22/168

Page 12: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

12

www.tyndall.ie

Motivation

The “truths” of

Nonlinear Circuits and Systems

can provide some valuable insights…

23/168

www.tyndall.ie

Nonlinear Dynamical Systems

• Dynamical System State

State equations

Trajectories

• Phase Portrait (effect of initial conditions) Non-wandering sets

Attractors

Basins of attraction

• Bifurcation Diagram (parameters) Local and global bifurcations

24/168

Page 13: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

13

www.tyndall.ie

Nonlinear Dynamical Systems

• A dynamical system comprises a state

space and a dynamic

• The state space is the set of possible

states of the system; it is also called the

“phase space”

• The dynamic describes the evolution of the

state with time; it is also called the “state

equations” or the “equations of motion”

25/168

www.tyndall.ie

State Equations (Dynamic)

• Continuous time

• Discrete time

26/168

Page 14: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

14

www.tyndall.ie

Nonlinear Dynamical Systems

• The continuous- (discrete-) time system is

nonlinear if F (G) is not linear in X

27/168

www.tyndall.ie

Nonlinear Dynamical Systems

• A dynamical system follows a trajectory

(orbit) through the state space

• The flow describes the evolution of all

trajectories in the state space

28/168

Page 15: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

15

www.tyndall.ie

Trajectories (Orbits)

• Continuous time

• Discrete time

29/168

www.tyndall.ie

Nonlinear Dynamical Systems

• Nonlinear dynamics is concerned with:

(a) the structure of the flow (types of

trajectories and their stability)

(b) its dependence on the parameters

of the system (structural stability

and bifurcations)

30/168

Page 16: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

16

www.tyndall.ie

Phase Portrait and Bifurcation Diagram

• Phase portrait: Structure of the flow

• Bifurcation diagram: Dependence of the

flow on the parameters

31/168

www.tyndall.ie

Phase Portrait

32/168

Page 17: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

17

www.tyndall.ie

Phase Portrait

33/168

www.tyndall.ie

Phase Portrait

34/168

Page 18: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

18

www.tyndall.ie

Bifurcation Diagram

35/168

www.tyndall.ie

Bifurcation Diagram

36/168

Page 19: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

19

www.tyndall.ie

• Types of trajectories

• Limit sets

• Stability of limit sets

• Attractors (“steady-state”)

• Basins of attraction/separatrices

Structure of the Flow 37/168

www.tyndall.ie

• Equilibrium (fixed) point

• Periodic trajectory (cycle)

• Quasiperiodic trajectory (torus)

• Chaotic trajectory

• Heteroclinic trajectory

• Homoclinic trajectory

Special Types of Trajectories 38/168

Page 20: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

20

www.tyndall.ie

• Equilibrium (fixed) point

• Periodic trajectory (cycle)

• Quasiperiodic trajectory (torus)

• Chaotic trajectory

Non-Wandering Sets 39/168

www.tyndall.ie

Equilibrium (Fixed) Point

• Continuous time

• Discrete time

40/168

Page 21: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

21

www.tyndall.ie

Periodic Trajectory (Cycle)

• Continuous time

• Discrete time

41/168

www.tyndall.ie

Quasiperiodic Trajectory (Torus)

• Continuous time

42/168

Page 22: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

22

www.tyndall.ie

Chaotic Trajectory

• Continuous time

43/168

www.tyndall.ie

• ω limit sets

• Attracting (or not)

• Basin of attraction

Stability of Non-Wandering Sets 44/168

Page 23: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

23

www.tyndall.ie

• Linearization (local behavior; “small-

signal” analysis)

• Eigenvalues (negative or positive real parts

[CT]; magnitudes less than or greater than

unity [DT])

Stability of Non-Wandering Sets: Techniques 45/168

www.tyndall.ie

• Poincaré maps (reduce CT system to

equivalent lower order DT system)

• Lyapunov exponents (generalized notion of

stability)

Stability of Non-Wandering Sets: Techniques 46/168

Page 24: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

24

www.tyndall.ie

Equilibrium (Fixed) Point

• Continuous time

• Discrete time

47/168

www.tyndall.ie

Linearization (Jacobian)

48/168

Page 25: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

25

www.tyndall.ie

Equilibrium (Fixed) Point

• Continuous time

49/168

www.tyndall.ie

Periodic Trajectory (Cycle)

• Continuous time Poincaré map

• Discrete time

50/168

Page 26: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

26

www.tyndall.ie

Poincaré Map

• Continuous time Poincaré map

51/168

www.tyndall.ie

Quasiperiodic Trajectory (Torus)

• Continuous time Poincaré map

52/168

Page 27: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

27

www.tyndall.ie

Chaotic Trajectory

• Poincaré map

• Lyapunov exponents

53/168

www.tyndall.ie

Summary: Phase Portrait

• Flow

• Non-wandering sets

• Special trajectories (heteroclinic and

homoclinic connections)

• Separatrices

• ω limit sets (attractors; “steady states”)

• Basins of attraction

54/168

Page 28: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

28

www.tyndall.ie

Phase Portrait

55/168

www.tyndall.ie

Structural Stability

• A structurally stable dynamical system is

one for which a small change in a

parameter does not change the dynamics

qualitatively

• A bifurcation occurs if the qualitative

dynamics change; the system is not

structurally stable at the bifurcation point

56/168

Page 29: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

29

www.tyndall.ie

Bifurcations

• Local bifurcation: The stability of an

equilibrium (or fixed) point changes

• Global bifurcation: A 'larger' invariant set,

such as a periodic orbit, collides with an

equilibrium

57/168

www.tyndall.ie

Bifurcations

• Local bifurcations Saddle-node (fold, tangent) [Schmitt trigger]

Transcritical

Pitchfork [Bistable]

Period-doubling (flip)

Hopf [“Sinusoidal” oscillator]

• Global bifurcations Homoclinic: limit cycle collides with a saddle

Heteroclinic: limit cycle collides with two or more saddles

Blue sky catastrophe: limit cycle collides with an unstable cycle

58/168

Page 30: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

30

www.tyndall.ie

Local Bifurcations

• Saddle-node (fold, tangent) A stable and an unstable equilibrium point collide and disappear

• Pitchfork A stable equilibrium point goes unstable and two new stable

equilibria appear

59/168

www.tyndall.ie

Local Bifurcations

• Period-doubling (flip) A stable fixed point goes unstable with an

eigenvalue equal to -1

• Hopf A stable equilibrium point becomes unstable

and a stable cycle appears

60/168

Page 31: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

31

www.tyndall.ie

Saddle-Node Bifurcation [CT]

• State equation

• Equilibrium points

• Stability

61/168

www.tyndall.ie

Saddle-Node Bifurcation [DT]

• State equation

• Equilibrium points

• Stability

62/168

Page 32: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

32

www.tyndall.ie

Pitchfork Bifurcation [CT]

• State equation

• Equilibrium points

• Stability

63/168

www.tyndall.ie

Pitchfork Bifurcation [DT]

• State equation

• Equilibrium points

• Stability

64/168

Page 33: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

33

www.tyndall.ie

Period-Doubling Bifurcation [DT]

• State equation

• Equilibrium point(s)

• Stability

65/168

www.tyndall.ie

Hopf Bifurcation [CT]

• State equation

• Equilibrium point

• Stability

66/168

Page 34: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

34

www.tyndall.ie

Local Bifurcations

• Saddle-node (fold, tangent) A stable and an unstable equilibrium point collide and disappear

• Pitchfork A stable equilibrium point goes unstable and two new stable

equilibria appear

• Period-doubling (flip) A stable fixed point goes unstable with eigenvalue equal to -1

• Hopf A stable equilibrium point becomes unstable and a stable cycle

appears

67/168

www.tyndall.ie

Summary

• Part 1: Motivation and Basic Concepts Coexisting solutions

Bistability

“Hysteresis”

Synchronization

State space trajectories

Limit sets (steady-state solutions) and basins of attraction

Structural stability

Bifurcations (saddle-node, pitchfork, period-doubling, Hopf)

68/168

Page 35: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

35

www.tyndall.ie

[K93a] M.P. Kennedy. Three steps to chaos part I:

Evolution. IEEE Trans. Circuits and Systems-Part I:

Fundamental Theory and Applications, 40(10):640-656,

October 1993.

[K93b] M.P. Kennedy. Three steps to chaos part II: A Chua's

circuit primer. IEEE Trans. Circuits and Systems-Part I:

Fundamental Theory and Applications, 40(10):657-674,

October 1993.

[K94] M.P. Kennedy. Basic concepts of nonlinear dynamics

and chaos. In C. Toumazou, editor, Circuits and Systems

Tutorials, pages 289-313. IEEE Press, London, 1994.

References: Nonlinear Dynamics 69/168

www.tyndall.ie

[NBb] A.H. Nayfeh and B. Balachandran. Applied Nonlinear

Dynamics. Wiley, 1995.

[S01] S.H. Strogatz. Nonlinear Dynamics And Chaos: With

Applications To Physics, Biology, Chemistry, And

Engineering. Perseus Books, 2001.

References: Nonlinear Dynamics 70/168

Page 36: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

36

www.tyndall.ie

Part 2: Examples

• SPICE DC Analysis (intertwined basins of

attraction)

• Schmitt Trigger (Saddle-node bifurcation)

• Colpitts Oscillator (Hopf bifurcation)

• Injection-Locking (Arnold tongues)

• Digital Delta-Sigma Modulator (Coexisting

solutions)

71/168

www.tyndall.ie

Acknowledgements

• FIRB Italian National Research Program

RBAP06L4S5

• Science Foundation Ireland Grant

08/IN1/I1854

72/168

Page 37: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

37

www.tyndall.ie

Part 2

Examples

73/168

www.tyndall.ie

Examples

• SPICE DC Analysis (intertwined basins of

attraction)

• Schmitt Trigger (Saddle-node bifurcation)

• Colpitts Oscillator (Hopf bifurcation)

• Injection-Locking (Arnold tongues)

• Digital Delta-Sigma Modulator (Coexisting

solutions)

74/168

Page 38: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

38

www.tyndall.ie

Example: SPICE DC analysis

• Local: Equilibrium (“operating”) point

• Global: Coexisting stable equilibrium

points; multiple basins of attraction;

complex separatrices

75/168

www.tyndall.ie

Example: SPICE DC analysis

• At each time point, SPICE solves a

nonlinear circuit using Modified Nodal

Analysis (MNA) and the Newton-Raphson

algorithm

76/168

Page 39: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

39

www.tyndall.ie

Example: SPICE DC analysis

77/168

www.tyndall.ie

Example: SPICE DC analysis

• Modified Nodal Analysis (MNA)

78/168

Page 40: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

40

www.tyndall.ie

Example: SPICE DC analysis

• Use Newton-Raphson to solve

where

79/168

www.tyndall.ie

Example: SPICE DC analysis

• Newton-Raphson is a dynamical system

with equilibrium (fixed) point(s) at

80/168

Page 41: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

41

www.tyndall.ie

Example: SPICE DC analysis

• CMOS ILFD with direct injection

81/168

www.tyndall.ie

Example: SPICE DC analysis

• Simplified model

82/168

Page 42: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

42

www.tyndall.ie

Example: SPICE DC analysis

• Nonlinear resistor

83/168

www.tyndall.ie

Example: SPICE DC analysis

• Nonlinear resistor

84/168

Page 43: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

43

www.tyndall.ie

Example: SPICE DC analysis

• Modified Nodal Analysis (MNA)

where

85/168

www.tyndall.ie

Example: SPICE DC analysis

• Use Newton-Raphson to solve

where

86/168

Page 44: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

44

www.tyndall.ie

Example: SPICE DC analysis

• Newton-Raphson is a dynamical system

with

and

87/168

www.tyndall.ie

Example: SPICE DC analysis

• State equation

• Equilibrium (fixed) points

88/168

Page 45: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

45

www.tyndall.ie

Example: SPICE DC analysis

• The next state is obtained from the

current state by following the tangent…

X[0]

X[1]

X[2]

89/168

www.tyndall.ie

Example: SPICE DC analysis

• The basins of attraction are intertwined…

XQ1 XQ2 XQ3

1 2 3 3 3 1 1 … …

90/168

Page 46: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

46

www.tyndall.ie

Example: SPICE DC analysis

• Intertwining can be very complicated…

91/168

www.tyndall.ie

Example: SPICE DC analysis

• Issues Oscillation (of algorithm)

Unboundedness

“Missed” solution

No oscillation (of circuit)

92/168

Page 47: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

47

www.tyndall.ie

Example: SPICE DC analysis

• Local: Equilibrium (“operating”) point

• Global: Coexisting stable equilibrium

points; multiple basins of attraction;

complex separatrices

93/168

www.tyndall.ie

Example: Schmitt trigger

• Local: Stable equilibrium point

• Global: Coexisting stable and unstable

equilibrium points (“bistable”)

• Structural: Saddle-node (fold) bifurcations

at transition points

94/168

Page 48: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

48

www.tyndall.ie

Example: Schmitt trigger

• Circuit diagram

95/168

www.tyndall.ie

Example: Schmitt trigger

• Voltage transfer characteristic

96/168

Page 49: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

49

www.tyndall.ie

Example: Schmitt trigger

• Voltage transfer characteristic (measured)

97/168

www.tyndall.ie

Example: Schmitt trigger

• Simplified model

98/168

Page 50: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

50

www.tyndall.ie

Example: Schmitt trigger

• Simplified model

99/168

www.tyndall.ie

Example: Schmitt trigger

• Experimental verification

100/168

Page 51: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

51

www.tyndall.ie

Example: Schmitt trigger

• Measurement circuit

101/168

www.tyndall.ie

Example: Schmitt trigger

• Voltage transfer characteristic (measured)

102/168

Page 52: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

52

www.tyndall.ie

Example: Schmitt trigger

• One parasitic capacitor is sufficient to

explain the switching mechanism…

103/168

www.tyndall.ie

Example: Schmitt trigger

• Equivalent circuit

104/168

Page 53: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

53

www.tyndall.ie

Example: Schmitt trigger

• Equivalent circuit

105/168

www.tyndall.ie

Example: Schmitt trigger

• Nonlinear resistor seen by parasitic

106/168

Page 54: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

54

www.tyndall.ie

Example: Schmitt trigger

Saddle-node bifurcation

107/168

www.tyndall.ie

Example: Schmitt trigger

• Simulation issues Equilibrium point

Coexisting solutions

108/168

Page 55: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

55

www.tyndall.ie

Example: Schmitt trigger

• Local: Stable equilibrium point

• Global: Coexisting stable and unstable

equilibrium points (“bistable”)

• Structural: Saddle-node (fold) bifurcations

at transition points

109/168

www.tyndall.ie

[KC91] M.P. Kennedy and L.O. Chua. Hysteresis in

electronic circuits: A circuit theorist's perspective. Int. J.

Circuit Theory Appl., 19(5):471-515, 1991.

References: Hysteresis 110/168

Page 56: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

56

www.tyndall.ie

Example: Colpitts Oscillator

• Local: Unstable equilibrium point; stable

limit cycle

• Global: Amplitude-limiting mechanism

• Structural: Hopf bifurcation; period-

doubling (flip) bifurcation

111/168

www.tyndall.ie

Example: Colpitts Oscillator

• Circuit diagram

112/168

Page 57: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

57

www.tyndall.ie

Example: Colpitts Oscillator

113/168

www.tyndall.ie

Example: Colpitts Oscillator

• SPICE deck

114/168

Page 58: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

58

www.tyndall.ie

Example: Colpitts Oscillator

115/168

www.tyndall.ie

Example: Colpitts Oscillator

• Simplified circuit diagram

116/168

Page 59: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

59

www.tyndall.ie

Example: Colpitts Oscillator

• State equations

117/168

www.tyndall.ie

Example: Colpitts Oscillator

• State equations

118/168

Page 60: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

60

www.tyndall.ie

Example: Colpitts Oscillator

• Alternative topology

119/168

www.tyndall.ie

Example: Colpitts Oscillator

• State equations

120/168

Page 61: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

61

www.tyndall.ie

Example: Colpitts Oscillator

• Normalized state equations

121/168

www.tyndall.ie

Example: Colpitts Oscillator

• Phase portrait

122/168

Page 62: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

62

www.tyndall.ie

Example: Colpitts Oscillator

• Bifurcation diagram

123/168

www.tyndall.ie

Example: Colpitts Oscillator

• Design space

124/168

Page 63: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

63

www.tyndall.ie

Example: Colpitts Oscillator

• Simulation issues Equilibrium point

Coexisting solutions

125/168

www.tyndall.ie

Example: Colpitts Oscillator

• Local: Unstable equilibrium point; stable

limit cycle

• Global: Amplitude-limiting mechanism

• Structural: Hopf bifurcation; period-

doubling (flip) bifurcation

126/168

Page 64: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

64

www.tyndall.ie

[K94] M.P. Kennedy. Chaos in the Colpitts oscillator. IEEE

Trans. Circuits and Systems-Part I, 41(11):771-774,

November 1994.

[MdeFK99] G.M. Maggio, O.de Feo, and M.P. Kennedy.

Nonlinear analysis of the Colpitts oscillator with

applications to design. IEEE Trans. Circuits and Systems-

Part I: Fundamental Theory and Applications, CAS-

46(9):1118-1130, September 1999.

References: Colpitts Oscillator 127/168

www.tyndall.ie

Example: Injection-Locking

• Local: Stable limit cycle

• Global: Arnold tongues

• Structural: Fold (?) bifurcation

128/168

Page 65: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

65

www.tyndall.ie

Example: Injection-Locking

• Model of injection-locking: The Circle map

129/168

www.tyndall.ie

Example: Injection-Locking

• Bifurcation diagram (Arnold tongues)

130/168

Page 66: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

66

www.tyndall.ie

Example: Injection-Locking

• Devil’s staircase

131/168

www.tyndall.ie

Example: Injection-Locking

• CMOS ILFD with tail coupling

132/168

Page 67: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

67

www.tyndall.ie

Example: Injection-Locking

• Simplified model

133/168

www.tyndall.ie

Example: Injection-Locking

• Nonlinearity

134/168

Page 68: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

68

www.tyndall.ie

Example: Injection-Locking

• Normalized model

135/168

www.tyndall.ie

2(1 )

1

dxQ y G x x

d

dyx y

d Q

Bifurcation

Diagram of

Unforced Circuit

Example: Injection-Locking 136/168

Page 69: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

69

www.tyndall.ie

Example: Injection-Locking

• Bifurcation diagram (simulated)

137/168

www.tyndall.ie

Example: Injection-Locking

• Bifurcation diagram (simulated)

138/168

Page 70: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

70

www.tyndall.ie

Example: Injection-Locking

fout=5 MHz

fin=20 MHz

• A point on line (d) of the

sensitivity lines (Q=40).

Vout @ fout Vin @ fin

0

110MHz

2f

LC

139/168

www.tyndall.ie

Example: Injection-Locking

• Experimental measurements

140/168

Page 71: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

71

www.tyndall.ie

Example: Injection-Locking

• Bifurcation diagram (measured)

141/168

www.tyndall.ie

Example: Injection-Locking

• CMOS ILFD with direct injection

142/168

Page 72: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

72

www.tyndall.ie

Example: Injection-Locking

• Bifurcation diagram (measured)

143/168

www.tyndall.ie

Example: Injection-Locking

• “Devil’s staircase” (measured)

144/168

Page 73: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

73

www.tyndall.ie

Example: Injection-Locking

• Simulation issues Coexisting solutions

Long transients

Calculation of frequency ratio

Detecting periodicity

145/168

www.tyndall.ie

Example: Injection-Locking

• Local: Stable limit cycle

• Global: Arnold tongues

• Structural: Fold (?) bifurcation

146/168

Page 74: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

74

www.tyndall.ie

[O’DKFQJ05] K. O’Donoghue, M.P. Kennedy, P. Forbes, M.

Qu, and S. Jones. A Fast and Simple Implementation of

Chua’s Oscillator with Cubic-like Nonlinearity. Int. J. Bif.

Chaos. 15(9):2959-2971, September 2005.

[DdeFK10] S. Daneshgar, O. De Feo and M.P. Kennedy.

Observations Concerning the Locking Range in the

Complementary Differential LC Injection-Locked

Frequency Divider Part I: Qualitative Analysis. IEEE

Trans. Circuits and Systems-Part I, 57(1):179-188, Jan.

2010.

References: Injection-Locking 147/168

www.tyndall.ie

Example: Digital Delta Sigma Modulator

• Local: unstable equilibrium

• Global: cycles; complex basins of

“attraction”

• Structural: multiple nonlinearities

148/168

Page 75: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

75

www.tyndall.ie

The ideal DDSM

• A bandlimited digital signal x (n bits) is

requantized to a shorter word y (m bits)

• The additive quantization noise e is

highpass filtered for later removal by a

lowpass filter

n bits m bits

149/168

www.tyndall.ie

The ideal DDSM

• x is bandlimited

• y includes highpass filtered quantization noise

• quantization noise can be removed by lowpass filtering

X

X E

150/168

Page 76: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

76

www.tyndall.ie

Example: DDSM

• MASH: Higher order filtering with exact

cancellation of intermediate errors

Y(z) = X(z) + El(z) (1-z-1)l

151/168

www.tyndall.ie

Example: DDSM

• 3rd order MASH

Y1(z) = X(z) + E1(z) (1-z-1)

Y2(z) = -E1(z) + E2(z) (1-z-1)

Y3(z) = -E2(z) + E3(z) (1-z-1)

Y(z) = Y1(z) + Y2(z) (1-z-1) + Y3(z) (1-z-1)2

= X(z) + E3(z) (1-z-1)3

152/168

Page 77: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

77

www.tyndall.ie

Example: DDSM

• MASH: Idealized power spectra (white

noise with 2nd and 3rd order filters)

60 dB/decade

40 dB/decade

153/168

www.tyndall.ie

• A MASH 1-1-1 with a constant input can

produce spurious tones (spurs)

Example: DDSM

MASH 1-1-1

wordlength: 18 bits

Spurs

154/168

Page 78: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

78

www.tyndall.ie

Example: DDSM

• Different wordlengths can produce

different spectra

• Different initial conditions can produce

different spectra

• Different inputs can produce different

spectra

• All of the above can cause spurs!

155/168

www.tyndall.ie

Example: DDSM

• Different wordlengths produce different

spectra

MASH 1-1-1

green plot: 9 bits

blue plot: 18 bits

156/168

Page 79: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

79

www.tyndall.ie

Example: DDSM

• Different initial conditions produce

different spectra MASH 1-1-1

Input = 8 (decimal)

accumulator word length: 14 bits

cycle length for green plot: 4096

cycle length for blue plot: 32768

red plot: CMQ approximation

157/168

www.tyndall.ie

Example: DDSM

• Different inputs produce different spectra

MASH 1-1-1

wordlength: 17 bits

(i) X=1

(ii) X=216

158/168

Page 80: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

80

www.tyndall.ie

Example: DDSM

• The DDSM is a Finite State Machine (FSM)

• The FSM has a finite state space S

(containing Ns states) and a deterministic

rule G (called the dynamic) that governs

the evolution of states

• The next state is determined completely

by the current state and the input:

X[n+1] = G(X[n])

159/168

www.tyndall.ie

Example: DDSM

• If the input is fixed, the most complex

trajectory visits each state in the state

space once before repeating; the longest

cycle has period N = Ns-1

• In the worst case, the trajectory repeats

with period N = 4

160/168

Page 81: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

81

www.tyndall.ie

Stochastic approach

• Make the dynamic stochastic

• The next state depends on the current

state s, the input x, and a random dither

signal d

s[n+1] = GS(s[n], x[n], d[n])

• Periodicity is destroyed

• Trajectories can be much longer than Ns

161/168

www.tyndall.ie

Stochastic approach: LSB dither

• MASH 1-1-1 with LSB dither: V(z) = (1-z-1)R

Green: V(z)= 0

Red: V(z)=1

Blue: V(z)=1-z-1

162/168

Page 82: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

82

www.tyndall.ie

Deterministic approaches: ICs

• MASH 1-1-1: Choose s1[0] odd (“seeding”)

MASH 1-1-1

Input = 8 (decimal),

accumulator word length: 14 bits

cycle length for green plot: 4096

cycle length for blue plot: 32768

163/168

www.tyndall.ie

• Local: unstable equilibrium

• Global: cycles; complex basins of

“attraction”

• Structural: multiple nonlinearities

Example: DDSM 164/168

Page 83: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

83

www.tyndall.ie

[HK07b] K. Hosseini and M.P. Kennedy. Maximum Sequence

Length MASH Digital Delta-Sigma Modulators. IEEE Trans.

Circuits and Systems-Part I, 54(12):2628-2638, Dec.

2007.

[HK08] K. Hosseini and M.P. Kennedy. Architectures for

Maximum-Sequence-Length Digital Delta-Sigma

Modulators. IEEE Trans. Circuits and Systems-Part II,

55(11):1104-1108, Nov. 2008.

[HK11] K. Hosseini and M.P. Kennedy. Minimizing Tones in

Digital Delta-Sigma Modulators. Springer, New York,

2011.

References: DDSM 165/168

www.tyndall.ie

Summary

• Part 2: Examples SPICE DC analysis (intertwined basins of attraction)

Schmitt trigger (saddle-node bifurcation)

Colpitts oscillator (Hopf bifurcation)

Injection-locking (Arnold tongues)

DDSM (coexisting solutions)

166/168

Page 84: What Every Electrical Engineer Should Know about Nonlinear ...What Every Electrical Engineer Should Know about Nonlinear Circuits and Systems ... Nonlinear Dynamics And Chaos: With

84

www.tyndall.ie

Acknowledgements

• FIRB Italian National Research Program

RBAP06L4S5

• Science Foundation Ireland Grant

08/IN1/I1854

[email protected]

167/168

www.tyndall.ie

Motivation

“I've wondered why it took us so long to catch on.

We saw it and yet we didn't see it.

Or rather we were trained not to see it...

The truth knocks on the door and you say, 'Go

away, I'm looking for the truth,' and so it goes

away…”

Robert M. Pirsig,

Zen and the Art of Motorcycle Maintenance, Corgi, 1974

168/168