low-latency hd: shared spaces and undersea window
DESCRIPTION
John Roston and Jeremy R. Cooperstock Centre for Interdisciplinary Research in Music Media and Technology McGill University. Low-latency HD: Shared Spaces and Undersea Window. Low-latency. Videoconferencing: The Future?. Zack Snyder’s “Online Jam”, October 2001. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/1.jpg)
John Roston and Jeremy R. CooperstockCentre for Interdisciplinary Research in Music Media and TechnologyMcGill University
Low-latency HD:Shared Spaces and
Undersea Window
![Page 2: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/2.jpg)
Low-latency
![Page 3: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/3.jpg)
Videoconferencing: The Future?
Zack Snyder’s “Online Jam”, October 2001
![Page 4: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/4.jpg)
For those with DSL at home...
yeah, right!
![Page 5: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/5.jpg)
Pinchas Zuckerman, Columbia U, NYC
Wu Ji, Canarie ARDNOC, Ottawa
“Playing Together” experiment
New York-Ottawa, Remote Masters class, Dec. 8, 2000
![Page 6: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/6.jpg)
Latency: The Interaction-Killer
or put another way...
![Page 7: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/7.jpg)
0
200
400
600
800
1000
1200
1400
1600
HD-SDI SDI DV/HDV MPEG
Mbps
Bandwidth vs. Latency
• near-equivalent quality of encoded video (HD-SDI vs HDV or SDI vs DV/MPEG) at greatly reduced bandwidth
• but… compression takes time
![Page 8: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/8.jpg)
* This is a theoretical “best-case” scenario. Actual performance may vary. The manufacturer makes no warranties, either express or implied, and will not be held liable for damage resulting from use of the product. Certain restrictions may apply. Offer void where prohibited by law. Batteries not included.
compress transmit
100 20 4030 50 7060 80
networks light speed: Mtl-LA
net latency Mtl-LA
large ensemble
activity smallensemble
lip synch
MPEG*acquire
90 100ms
speech, drumming
Tolerated Synchronicity
![Page 9: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/9.jpg)
Current Projects
![Page 10: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/10.jpg)
Going deep under… to 2000m
HD video over new undersea networks –VENUS and NEPTUNE
![Page 11: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/11.jpg)
“Undersea Window” Project
VENUS – Test Camera 100m
NEPTUNE – Cameras 2,000m
![Page 12: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/12.jpg)
System Architecture
![Page 13: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/13.jpg)
Shared Spaces: Panoramic High-Def
See everything - no camera panning
![Page 14: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/14.jpg)
Conference Room Configuration
![Page 15: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/15.jpg)
C4 OME@BCnet
to servers w/GbE i/f
C4 OME@RISQ
UBC 10G switch
McGill 10G switchRISQ
fibreBCnetfibre
OC-19210GWan Phy
to servers w/GbE i/f
10GWan Phy
CA*net 4
local loop for end-end lightpath prgram scope
Network Architecture
![Page 16: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/16.jpg)
New challenge: Real-time mosaicing
![Page 17: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/17.jpg)
Sample Result
Can your camera do this?
![Page 18: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/18.jpg)
Previous Projects
![Page 19: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/19.jpg)
Distributed Violin Duet
McGill-Université de Montréal demo, Nov. 21, 2001 • IP over 1 Gbps fiber link • < 30ms latency
![Page 20: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/20.jpg)
McLuhan: “The medium is the message”
Cooperstock's Corollary:
“The medium must be faster than the message.” *
* but between protocol deficiencies (TCP, UDP), competing data flows, process scheduling on a budget, ARQ (retransmission management) without QoS, interface HW/SW “uncooperativeness”, aggressive router policies, multi-format support, echo suppression, and interface complexity… it’s much more than just the medium
![Page 21: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/21.jpg)
Violin Masters Class
Montreal-Ottawa Trial with Pinchas Zuckerman, Feb. 20, 2002
![Page 22: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/22.jpg)
Size does matter
![Page 23: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/23.jpg)
Distributed Jazz Jam
Montreal-Stanford (CCRMA), Research Demo, Oct. 24, 2002
![Page 24: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/24.jpg)
The “Sweet Spot” Problem
![Page 25: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/25.jpg)
Vibrosensory Transmission
VRQ demo, March 8, 2004
![Page 26: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/26.jpg)
… and another application
![Page 27: Low-latency HD: Shared Spaces and Undersea Window](https://reader035.vdocuments.site/reader035/viewer/2022062321/568131be550346895d98262d/html5/thumbnails/27.jpg)
Thank you.Further information available:
http://ultravideo.mcgill.edu