geometric modeling of sound propagation in 3d environments · 2004. 4. 20. · small wood corridor...

F1

Geometric Modeling ofSound Propagation in

3D Environments

Geometric Modeling ofSound Propagation in

3D Environments

��

Computer Science DepartmentPrinceton University

��

Computer Science DepartmentPrinceton University

Goal

��

0-10 ms

90-100 ms

30-40 ms

120-130 ms 150-160 ms

60-70 ms

Stettner92

Sound Source

Motivation

��

Ø ��

� ��

� !��

Evans & Sutherland

Vartek NV

Motivation

��

� ��

Ø ��

� !�� Unreal Tournament,

Epic / GT Interactive 1999

Large stone hall

Small wood corridor Small metal room

Unreal Tournament, Epic / GT Interactive 1999

Alone in the Dark 4, Darkworks/Infogrames, 2000

Motivation

��

� ��

� ��

Ø !��

Moves InstituteEverquestMoves Institute

Audio Rendering

Input Audio Signals

AcousticModeling

Output Audio Signal(s)

Source Receiver

VirtualEnvironment

AuditoryDisplayA

mpl

itude

Time Delay

Impulse Response

F2

Talk Outline

"� ��

#�� $

%��

� !��

� ��

��

�� $� �

Acoustic Modeling Overview

��

� ��

� &��

� # �� '� ��


��

Ø ��

� &��

� # �� '� ��

= wave theory approximation

Stettner92


��

� ��

Ø &��

� # �� '� ��

= ray theory approximation

PropagationPaths


��

� ��

� &��

Ø # �� '� �� = perceptual approximation

τ1

τN

τ 2

g1

gN

g2

A

delay attenuation

feedback matrix

Feedback Delay NetworkJot


"�� (�� )

Am

plitu

de

Time DelayDirectSound

EarlyPropagation

LateReverberation

ArtificialReverberation

GeometricPath Tracing

F3


"�� (�� )

Am

plitu

de

Time DelayDirectSound

EarlyPropagation

LateReverberation

ArtificialReverberation

GeometricPath Tracing

Geometric Path Tracing

��


��

Ø "��

� ��

� %��

�� $��*�� +�


��

Ø "��

� ��

� %��

�� $��*�� +�


��

� "��

Ø ��

� %��

� ��


��

� "��

� ��

Ø %��

� ��'��('�� )��

F4


��

� "��

� ��

Ø %��

Beam Tracing Method

,��

� ��

� �� -�� -��

� .�� / ��

� !�� 0��

Papers atSIGGRAPH

1998, 1999, 2001

Talk Outline

"� ��

#�� $

%��

Ø !��

� ��

��

�� $� �

Beam Tracing Method

Cell Adjacency Graph

Spatial Subdivision

StationarySources

SourceAudio

Beam Trees

Beam Tracing

Propagation Paths

Path Generation

Auditory Display

MovingReceiver

Off-LineInteractive

3D Environment

Spatialized Audio

Step 4: Auralization

��'��

source

receiver

Beam Tracing Method

Cell Adjacency Graph

Spatial Subdivision

StationarySources

SourceAudio

Beam Trees

Beam Tracing

Propagation Paths

Path Generation

Auditory Display

MovingReceiver

Off-LineInteractive

3D Environment

Spatialized Audio

F5

Beam Tracing Demo Experimental Results

�� $��

Beam Tracing Results

%�� $�$��'��1��

0

100000

200000

300000

400000

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000

# Polygons in Environment

# B

eam

s T

race

d

(up

to

8 r

efle

ctio

ns)

Path Generation Results

2 �� 3��

0

0.1

0.2

0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000

# Polygons in Environment

Pat

h G

ener

atio

n T

ime

(in

sec

on

ds)

10,057 input polygons8 specular reflections6 updates per second

195MHz CPU (1998)

Path Generation Video Path Generation Demo

Reflection pathsupdated interactively

StationarySource

F6

Auralization Video I

Specular reflection only

Auralization Video II

Diffraction and specular reflection

Diagnostic Results

Paths

Power Power + Paths

Diagnostic Results

Specular Reflection + Diffraction

Specular Reflection Only

Diffraction Only

Diagnostic Results Talk Outline

"� ��

#�� $

%��

� !��

� ��

��

�� $� �

F7

Multi-Player Game System

AudioServer

Client B Client D

Client CClient A

Network

Player Audio& Viewpoints

Spatialized Audio Network

Moving Sources & Receivers

��

� �� '��$�� -��

� $�� 0�� -��

� ��

Real-timePath Tracing

Real-Time Beam Tracing

� ��'�� / �� 0��

� #�� '��

� 2 �� 0� ��'��

� %�� '��

� ��0� ��

Audio

Receiver

Audio

SourcePath Generation

Sequence Construction

Beam Tracing

Real-Time System Organization

Avatar Regions

Motion Prediction AvatarViewpoints

AvatarAudio

Conservative Beams

Beam Tracing

Traversal Sequences

Sequence Construction

Reflection Paths

Path Generation

Auralization Spatialized

Audio

~10 Hz

~100 Hz

GlobalPriority Queue

Amortized Beam Tracing

� ��'��

Beams from box over-estimate paths from points in boxBeams from box over-estimate paths from points in box

AA

Priority-Driven Beam Tracing

2 �� '��'��

BBBB

400 beams with shortest paths to “B”400 beams with shortest paths to “B”

AA AA

F8

Bidirectional Beam Tracing

��'��'��

Beams from “A” (up to 2 reflections)

Beams from “A” (up to 2 reflections)

Beams from “B” (up to 2 reflections)

Beams from “B” (up to 2 reflections)

AA

BB


��'��'��

Surface intersectionSurface intersection

AA

BB


��'��'��

Propagation pathPropagation path

BB

AA

Path Generation

Bidirectional sequencing

Beam Tracing

Predictive Time-Critical Computing

Avatar Regions

Motion Prediction AvatarViewpoints

AvatarAudio

Conservative Beams

Beam Tracing

Traversal Sequences

Bidirectional sequencing

Reflection Paths

Path Generation

Auralization Spatialized

Audio

~10 Hz

~100 Hz

GlobalPriority Queue

of Beams

Real-Time Beam Tracing Video

Specular reflection only

Summary

2��0'��

� ��

� ��

� !��

%��

� 2 ��-�� -��1

� #�� -�� 0� ��-'�� -��-��

� 2 ��0� ��

��

� "��

� ��0�� / ��

F9

Limitations of Current Method

4��0��

� %�� -��-��

4�� -�� -��

� 5� �-�� $��

4�� 6��0�� 0��

� 7�� $�� (��-��5 �)

Future Work

��

� ��1��

� ��

%��

� ��

� �� '��

��

� �� /��

��'��

� �� 1��

Thank You ...

2 ��.��

� 2� �� -�2�� -#��7��-�2��

%��'� ��

� 7��-�"� �� '��-�&� ��8��-��!��-�9��:��-��&��-&��2��

��#��

� 7!�� #$� �-�!��& ��

��;//$$$�� /<��

geometric modeling of sound propagation in 3d environments · 2004. 4. 20. · small wood corridor...

Documents