a physically intuitive haptic drumstick

52
ABabcdfghiejkl A Physically Intuitive Haptic Drumstick Edgar Berdahl, Bill Verplank, and Julius O. Smith III Center for Computer Research in Music and Acoustics unter Niemeyer Telerobotics Laboratory Stanford University International Computer Music Conference Copenhagen, Denmark August, 2007

Upload: others

Post on 12-Sep-2021

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

A Physically Intuitive Haptic Drumstick

Edgar Berdahl, Bill Verplank, and Julius O. Smith IIICenter for Computer Research in Music and Acoustics

—Gunter Niemeyer

Telerobotics Laboratory—

Stanford University—

International Computer Music ConferenceCopenhagen, Denmark

August, 2007

Page 2: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Outline

Explain how drum rolls are played

Develop a physical model

Implement the model dynamics on a haptic display

Alter the dynamics to make it easier to play drum rolls

Page 3: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Drum Rolls

◮ Drummers can control drum rolls at rates up to 30Hz.

Page 4: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Drum Rolls

◮ Drummers can control drum rolls at rates up to 30Hz.◮ The human neuromuscular system has a reaction time of

over 100ms.

Page 5: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Drum Rolls

◮ Drummers can control drum rolls at rates up to 30Hz.◮ The human neuromuscular system has a reaction time of

over 100ms.◮ How is this possible?!

Page 6: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Drum Rolls

◮ Drummers can control drum rolls at rates up to 30Hz.◮ The human neuromuscular system has a reaction time of

over 100ms.◮ How is this possible?!

1. The bouncing effect: the drum membrane “throws” the stickback at the drummer.

0 0.5 1 1.5−0.005

0

0.005

0.01

0.015

0.02

0.025

Time [sec]

Dis

plac

emen

t [m

]

Page 7: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Drum Rolls

◮ Drummers can control drum rolls at rates up to 30Hz.◮ The human neuromuscular system has a reaction time of

over 100ms.◮ How is this possible?!

1. The bouncing effect: the drum membrane “throws” the stickback at the drummer.

2. Impedance modulation: the drummer can alter theimpedance of his or her hand in real time.

K Routhand

Page 8: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Outline

Explain how drum rolls are played

Develop a physical model

Implement the model dynamics on a haptic display

Alter the dynamics to make it easier to play drum rolls

Page 9: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Above The Drum Membrane

zmg*

handK RoutDrum membrane

Figure: Drumstick dynamics for z > 0

◮ For the purposes of investigating drum rolls, we model thedrumstick as a bouncing ball with mass m.

◮ The spring and dashpot are commuted to the end.◮ Drummer can adjust rest position zh0 of the spring Khand .◮ Letting zss = zh0 − mg∗/Khand , we have

mz + Rout z + Khand (z − zss) = 0.

Page 10: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

“Inside” The Drum Membrane

◮ At DC, a drumstick being pressed into a drum membranebehaves like a linear spring Kcoll .

◮ There is still damping Rin due to losses in the hand andcollision.

−z

*mg

handK Rin

collKDrum Membrane

Figure: Drumstick dynamics for z < 0

mz + Rinz + Khand (z − zss) + Kcollz = 0

Page 11: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Coefficient Of Restitution

◮ Let β be the coefficient of restitution (COR) ofdrumstick/membrane collisions.

Page 12: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Coefficient Of Restitution

◮ Let β be the coefficient of restitution (COR) ofdrumstick/membrane collisions.

◮ For a collision beginning at any time tin and ending at anytime tout , if z(tin) = v0, then z(tout) = −βv0.

Page 13: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Coefficient Of Restitution

◮ Let β be the coefficient of restitution (COR) ofdrumstick/membrane collisions.

◮ For a collision beginning at any time tin and ending at anytime tout , if z(tin) = v0, then z(tout) = −βv0.

◮ Perfectly elastic collisions: β = 1

Page 14: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Coefficient Of Restitution

◮ Let β be the coefficient of restitution (COR) ofdrumstick/membrane collisions.

◮ For a collision beginning at any time tin and ending at anytime tout , if z(tin) = v0, then z(tout) = −βv0.

◮ Perfectly elastic collisions: β = 1◮ Inelastic collisions: 0 < β < 1

Page 15: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Coefficient Of Restitution

◮ Let β be the coefficient of restitution (COR) ofdrumstick/membrane collisions.

◮ For a collision beginning at any time tin and ending at anytime tout , if z(tin) = v0, then z(tout) = −βv0.

◮ Perfectly elastic collisions: β = 1◮ Inelastic collisions: 0 < β < 1◮ β ≈ exp −Rinπ√

4mKcoll−R2in

Page 16: A Physically Intuitive Haptic Drumstick

Summary Of Model Dynamics

◮ Above membrane (z > 0, COR α):mz + Rout z + Khand (z − zss) = 0

Page 17: A Physically Intuitive Haptic Drumstick

Summary Of Model Dynamics

◮ Above membrane (z > 0, COR α):mz + Rout z + Khand (z − zss) = 0

◮ “Inside” membrane (z < 0, COR β):mz + Rinz + Khand (z − zss) + Kcollz = 0

Page 18: A Physically Intuitive Haptic Drumstick

Summary Of Model Dynamics

◮ Above membrane (z > 0, COR α):mz + Rout z + Khand (z − zss) = 0

◮ “Inside” membrane (z < 0, COR β):mz + Rinz + Khand (z − zss) + Kcollz = 0

z

z

.

Page 19: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Outline

Explain how drum rolls are played

Develop a physical model

Implement the model dynamics on a haptic display

Alter the dynamics to make it easier to play drum rolls

Page 20: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Haptic Drumstick

◮ We use the three DOF Model T PHANTOM robotic arm1.

1From SensAble Technologies, see http://www.sensable.com.

Page 21: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Sound Synthesis

Figure: Rectilinear 2D Mesh

Page 22: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Sound Synthesis

Figure: Rectilinear 2D Mesh

Page 23: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Outline

Explain how drum rolls are played

Develop a physical model

Implement the model dynamics on a haptic display

Alter the dynamics to make it easier to play drum rolls

Page 24: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Altering The Drumstick Dynamics

◮ Noise and deterministic chaos are not physically intuitive.

Page 25: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Altering The Drumstick Dynamics

◮ Noise and deterministic chaos are not physically intuitive.◮ Stable limit cycles, or self-sustaining attractive oscillations,

describe biological oscillations such as the heart beating.

Page 26: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Altering The Drumstick Dynamics

◮ Noise and deterministic chaos are not physically intuitive.◮ Stable limit cycles, or self-sustaining attractive oscillations,

describe biological oscillations such as the heart beating.◮ Limit cycles also manifest themselves in bowed strings,

vibrating reeds, and drum rolls.

Page 27: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Altering The Drumstick Dynamics

◮ Noise and deterministic chaos are not physically intuitive.◮ Stable limit cycles, or self-sustaining attractive oscillations,

describe biological oscillations such as the heart beating.◮ Limit cycles also manifest themselves in bowed strings,

vibrating reeds, and drum rolls.◮ Goal: Assist the drummer in playing drum rolls.

Page 28: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Altering The Drumstick Dynamics

◮ Noise and deterministic chaos are not physically intuitive.◮ Stable limit cycles, or self-sustaining attractive oscillations,

describe biological oscillations such as the heart beating.◮ Limit cycles also manifest themselves in bowed strings,

vibrating reeds, and drum rolls.◮ Goal: Assist the drummer in playing drum rolls.◮ We can help bring about self-oscillations with

1. system delay

Page 29: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Altering The Drumstick Dynamics

◮ Noise and deterministic chaos are not physically intuitive.◮ Stable limit cycles, or self-sustaining attractive oscillations,

describe biological oscillations such as the heart beating.◮ Limit cycles also manifest themselves in bowed strings,

vibrating reeds, and drum rolls.◮ Goal: Assist the drummer in playing drum rolls.◮ We can help bring about self-oscillations with

1. system delay2. a hysteretic spring Kcoll

Page 30: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Altering The Drumstick Dynamics

◮ Noise and deterministic chaos are not physically intuitive.◮ Stable limit cycles, or self-sustaining attractive oscillations,

describe biological oscillations such as the heart beating.◮ Limit cycles also manifest themselves in bowed strings,

vibrating reeds, and drum rolls.◮ Goal: Assist the drummer in playing drum rolls.◮ We can help bring about self-oscillations with

1. system delay2. a hysteretic spring Kcoll

3. negative damping Rout

Page 31: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Altering The Drumstick Dynamics

◮ Noise and deterministic chaos are not physically intuitive.◮ Stable limit cycles, or self-sustaining attractive oscillations,

describe biological oscillations such as the heart beating.◮ Limit cycles also manifest themselves in bowed strings,

vibrating reeds, and drum rolls.◮ Goal: Assist the drummer in playing drum rolls.◮ We can help bring about self-oscillations with

1. system delay2. a hysteretic spring Kcoll

3. negative damping Rout

4. forcing the drumstick in the z-dimension every time that thestick enters the simulated membrane

h(t) =m∆vpulse

τe−t/τ

Page 32: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Forced Pulses Can Induce Limit Cycles

d

*

z

. zpulsestarts

Page 33: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Forced Pulses Can Induce Limit Cycles

d

*

z

. zpulsestarts

◮ Here we choose each pulse to be of constant magnitude.

Page 34: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Forced Pulses Can Induce Limit Cycles

d

*

z

. zpulsestarts

◮ Here we choose each pulse to be of constant magnitude.◮ But is d stable?

Page 35: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Related Discrete-Time System

e

**

pulsestarts

dp

U

P(q)Eq

z

. z

Page 36: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Related Discrete-Time System

e

**

pulsestarts

dp

U

P(q)Eq

z

. z

◮ P(·) is a Poincare map.

Page 37: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Related Discrete-Time System

e

**

pulsestarts

dp

U

P(q)Eq

z

. z

◮ P(·) is a Poincare map.◮ Let vi is the velocity of the drumstick tip at the end of

the i th collision with the drum membrane.

Page 38: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Related Discrete-Time System

e

**

pulsestarts

dp

U

P(q)Eq

z

. z

◮ P(·) is a Poincare map.◮ Let vi is the velocity of the drumstick tip at the end of

the i th collision with the drum membrane.◮ We analyze the stability of the closed orbit d by analyzing

the stability of:vi+1 = P(vi) = αβvi + β∆vpulse

Page 39: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Applying Pulses With Constant Magnitude

◮ Choose ∆vpulse = k/β, where k is constant

Page 40: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Applying Pulses With Constant Magnitude

◮ Choose ∆vpulse = k/β, where k is constant

◮ vi+1 = P(vi) = αβvi + k

Page 41: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Applying Pulses With Constant Magnitude

◮ Choose ∆vpulse = k/β, where k is constant

◮ vi+1 = P(vi) = αβvi + k = α(β + kαvi

)vi

Page 42: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Applying Pulses With Constant Magnitude

◮ Choose ∆vpulse = k/β, where k is constant

◮ vi+1 = P(vi) = αβvi + k = α(β + kαvi

)vi

◮ At small amplitudes, the effective COR β = (β + kαvi

) > 1.

Page 43: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Applying Pulses With Constant Magnitude

◮ Choose ∆vpulse = k/β, where k is constant

◮ vi+1 = P(vi) = αβvi + k = α(β + kαvi

)vi

◮ At small amplitudes, the effective COR β = (β + kαvi

) > 1.

◮ At large amplitudes, the effective COR β = (β + kαvi

) ≈ β.

Page 44: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Applying Pulses With Constant Magnitude

◮ Choose ∆vpulse = k/β, where k is constant

◮ vi+1 = P(vi) = αβvi + k = α(β + kαvi

)vi

◮ At small amplitudes, the effective COR β = (β + kαvi

) > 1.

◮ At large amplitudes, the effective COR β = (β + kαvi

) ≈ β.◮ α < 1 and β < 1 ⇒ αβ < 1

Page 45: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Applying Pulses With Constant Magnitude

◮ Choose ∆vpulse = k/β, where k is constant

◮ vi+1 = P(vi) = αβvi + k = α(β + kαvi

)vi

◮ At small amplitudes, the effective COR β = (β + kαvi

) > 1.

◮ At large amplitudes, the effective COR β = (β + kαvi

) ≈ β.◮ α < 1 and β < 1 ⇒ αβ < 1

◮ ⇒ limi→∞vi = k

1−αβ

= vlc is positive and finite.

Page 46: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Applying Pulses With Constant Magnitude

◮ Choose ∆vpulse = k/β, where k is constant

◮ vi+1 = P(vi) = αβvi + k = α(β + kαvi

)vi

◮ At small amplitudes, the effective COR β = (β + kαvi

) > 1.

◮ At large amplitudes, the effective COR β = (β + kαvi

) ≈ β.◮ α < 1 and β < 1 ⇒ αβ < 1

◮ ⇒ limi→∞vi = k

1−αβ

= vlc is positive and finite.◮ The discrete-time system is stable.

Page 47: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Applying Pulses With Constant Magnitude

◮ Choose ∆vpulse = k/β, where k is constant

◮ vi+1 = P(vi) = αβvi + k = α(β + kαvi

)vi

◮ At small amplitudes, the effective COR β = (β + kαvi

) > 1.

◮ At large amplitudes, the effective COR β = (β + kαvi

) ≈ β.◮ α < 1 and β < 1 ⇒ αβ < 1

◮ ⇒ limi→∞vi = k

1−αβ

= vlc is positive and finite.◮ The discrete-time system is stable.◮ P(·) is a Poincare map ⇒ d is a stable limit cycle

Page 48: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Conclusions

◮ Informal testing suggests that the altered dynamics make iteasier to play drum rolls.

Page 49: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Conclusions

◮ Informal testing suggests that the altered dynamics make iteasier to play drum rolls.

◮ Drum roll limit cycles are guaranteed to be stable.

Page 50: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Conclusions

◮ Informal testing suggests that the altered dynamics make iteasier to play drum rolls.

◮ Drum roll limit cycles are guaranteed to be stable.◮ Drummers can increase the drum roll rate by increasing

Khand or decreasing zh0 as in traditional drum roll playing.

Page 51: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Conclusions

◮ Informal testing suggests that the altered dynamics make iteasier to play drum rolls.

◮ Drum roll limit cycles are guaranteed to be stable.◮ Drummers can increase the drum roll rate by increasing

Khand or decreasing zh0 as in traditional drum roll playing.◮ The previous point suggests that the new musical instrument

is physically intuitive–i.e., the new instrument supportsphysical interactions that are familiar to traditionalperformers of traditional drums.

Page 52: A Physically Intuitive Haptic Drumstick

ABabcdfghiejkl

Thank You!

Questions?