human detection and localization of sounds in complex ...€¦ · human detection and localization...

45
Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington, DC 4 May, 2010

Upload: others

Post on 19-Nov-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Human Detection and Localization of Sounds

in Complex EnvironmentsW.M. Hartmann

Physics - AstronomyMichigan State University

QRTV, UN/ECE/WP-29Washington, DC4 May, 2010

Page 2: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Goals: GRB-51-18, QRTV

• Phases II-IV. Determine human and technical factors relevant to improving the safety of pedestrians in the presence of quiet road vehicles.

e.g.: • Detection• Localization

These are psychoacoustical topics

Page 3: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Psychoacoustics Goals

• Mathematical models of hearing processes.

• Consistent with animal physiology.• Consistent with human imaging and

encephalography.• Explain data from listening experiments in

which listeners respond to sounds.

Page 4: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

People from off the street

Irreproducible results

Experiment

Page 5: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Psychoacoustical Methods

• Controlled environment• Focused attention• Trained listeners• Long

experiments• Specialized

protocol.

Page 6: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Experimental protocol

Two-interval forced choice

One of these intervals has a signal in it.The listener knows that in advance.

Interval 1 Interval 2

Page 7: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Experimental Goals Met

• Reproducible data• Find the best possible performance for the

human organism. • Successfully test models.

• Relevant to the blind pedestrian on the street corner?

But

Page 8: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Single interval/ No interval

• Maybe there’s a signal…. Maybe not.

Signal present: HIT MISS

No signal: FALSE CORRECTALARM REJECTION

YES NO

Page 9: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Hit Rate + Miss Rate =100False Alarm+Correct Rejection=100

Page 10: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Slope about 1.0

Listener in unbiassed experiment

Page 11: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Miss rate about 0.

Pedestrian

Page 12: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Is psychoacoustics of any use at all in this context?

• P, “It cannot be heard.”• Conclusion: It can’t be heard.

• P, “It’s easily heard.”• Conclusion: Maybe it can be heard.

• There’s more:

Page 13: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Active cochlea

Page 14: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

0

20

40

60

80

Cal

Test

Page 15: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Detection

• In typical environments, background noise means that detection thresholds are masked thresholds.

• Masking is frequency specific.• Tonotopic organization starts with the

cochlea.

Page 16: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State
Page 17: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State
Page 18: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Buick Lucerne, 1 meter, idle

60 dBA15 dB beeps

Page 19: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

100 dBA

Page 20: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Buick Lucerne, 1 meter, 2000-1500 RPM

72 dBA

Page 21: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State
Page 22: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

DC9, next to the intake

30 dB

hp

Page 23: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Sound Localization

• Azimuth-90 degrees to 90 deges

• Elevation – including front back0 to 360 degees

• Distance

Page 24: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

ITD = Interaural time differenceILD = Interaural level difference

xL xR

t t

Azimuth

Page 25: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

714 Hz

1428 Hz

θ=41 deg => 500 us

=> ITD < 1200 Hz

ITD

Page 26: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Right ear

Left ear

Brightspot

ILD

Arago-Poisson, 1818

Headshadow

>1300 Hz

Page 27: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

ILD

Page 28: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Listener Responses

Page 29: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Amplitude modulation• fc=1500 Hz, fm = 100 Hz• 100% modulation

2/3 ms 10 ms

Page 30: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

AMfm=100 Hz100%

Listener N

Listener Responses

Page 31: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Direct sound retains coherenceMax cross-correlation = 1.

xL xR

t t

Page 32: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Room reflections destroy coherence

xL xR

t t

Page 33: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Coherence γ

ITDτo

BW (τ-τo)

Page 34: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

⇒Need high coherenceto use envelope cues.

Page 35: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

PRECEDENCE EFFECT

• Competition between Sound 1 & Sound 2• Sound 1: Localization cues, ITD, ILD, etc.• Sound 2: Localization cues, ITD, ILD, etc.

time1 2

Sound 1 takes precedence.

Page 36: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

• Sound 1: Localization cues, ITD, ILD, etc.• Sound 2: Localization cues, ITD, ILD, etc.

time1 2

Sound 1 takes precedence.

Fused image near location of Sound 1.

Page 37: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

1 2

Yvor Winters, 1900-1968

Page 38: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

1 2closer

Page 39: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Elevation and front/back

• Anatomical filtering – cues at high frequencies > 8 kHz or > 2 kHz.

• Problem for elderly listeners.• Front/back

– Turn the head. Otherwise lost.

Page 40: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Distance

• Intensity of known sounds• Air absorption attenuates high frequencies• Direct-to-reverberant ratio• Low-frequency ILD (< 1 meter).

Page 41: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Buick Lucerne, at grille, idle

66 dBA

Page 42: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

Conclusions

• To be detectable, signals should have frequencies different from masking. Practically, this means mid to high.

• To be localizable (AZ), signals should have low frequencies. Both ITD and ILD work for the widest range of azimuths. Signals should be impulsive to elicit precedence.

• To disambiguate front/back signals should have high frequencies too.

Page 43: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

The End

Thanks to the NIDCD

Page 44: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

ILD + Responses

Listener does notuse ear signalsindependently.

Page 45: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State

IPD + Responses

1500 Hz is too fast for ongoingITD or IPD.