• Learnware Network description• Project concerns and components• Remote Sign Language Interpretation� Questions

Technical Details (Jeremy)• Music teaching and recording • Intelligent Classroom� Questions

Project Overview (John)

Learnware Network Description

• Educational network on CA*net 3• Production and distribution of educational

materials and tools • Materials and tools use high-quality digital

audio and video

Project Main Concerns

• Engineering, networking and streaming technology issues

• Optimization of hardware and software for high quality audio and video

• Broadcast studio SMPTE 259M uncompressed SDI video (200+ Mbps)

• Recording studio quality uncompressed multichannel 96kHz, 24 bit audio

Learnware Components

• Music and Audio• Negotiation Simulation• Classroom Teaching in Engineering• Related project:

Remote Sign Language Interpretation

Music and Audio

• multi-channel surround sound • studio sharing• composition collaboration• master classes• shared performances• shared recording sessions

Montreal

Los Angeles

12 channels, 96kHz, 24

bits/channel

Music and Audio• Sept. 2000: McGill – USC Shared Recording

Music and Audio• Nov. 2001: McGill – HEC Violin Duet

Music and Audio• Mar. 2002: Pinchas Zukerman Master Class

Negotiation Simulation

• teach negotiation skills• existing CD-ROM application• conversion to Java for web delivery• video delivery creates heavy system load

Negotiation Simulation

Classroom Teaching

• augmented videoconference teaching• automatic recording and indexing of

lecture for later retrieval• instructor tracking• automatic far-end camera control

Remote Sign Language Interpretation• Related project• Physician and deaf patient in hospital• Interpreter in another city• DV video and audio• 3 compressed video streams • Software decompression

Sign Language

• Technical issues• Social factors• Intelligent Classroom Overview� Questions

Part II

Music Video Recorded via Internet2

• Palo Alto, CA (Nov. 6)--To demonstrate the broadband capabilities of Internet2, a network technologies development program being led by over 180 universities, musicians and engineers at college campuses throughout the United States recently collaborated on a music video recording session via the network.

• But…

Where we’re going

• same idea, but no cheating -- “real” interaction– remote instruction, master classes– distributed rehearsal and performance– studio sharing, recording sessions– remote sign-language interpretation – collaborative engineering design

• all at high-resolution, low-latency

27.6 Mbps

Recording Studio that Spans a ContinentAES 109th demo, Sept. 23, 2000

The “Frères Jacques” experiment• RISQ 2000:

“low-latency” MPEG-2 videoconferencing

“Playing Together” experiment• MPEG-2 Remote Master Class, Dec. 8,

2000

Pinchas Zukerman, Columbia U, NYC

Wu Ji, Canarie ARDNOC, Ottawa

Tolerated Synchronicity

compress transmit

100 20 4030 50 7060 80ms

speed of light: Mtl-LA

net latency Mtl-LA

networks

smallensemble

large ensemble

lip synch

musicalactivity

* This figure is a theoretical “best-case” scenario. Actual performance may vary based on local hardware. The manufacturer makes no warranties, either express or implied, and cannot be held liable for any damages resulting from use of the product. Certain restrictions may apply. Offer void where prohibited by law. Batteries not included.

MPEG*acquire

Size *does* matter: The Big Picture

• high-res* video• high-fidelity audio• multi-channel

surround• large (life-size?)

picture

Starting to feel more like “being there”?

Remote Classroom Teaching

Robust Person Tracking

Detecting Raised Arms

Questions?

• McGill Advanced Learnware:– http://www.mcgill.ca/icc/canarie/learnWare/

• Remote Sign Language Interpretation– http://www.mcgill.ca/icc/canarie/signLanguage/

• Network Audio Streaming:– http://www.cim.mcgill.ca/~jer/research/aes

• Intelligent Classroom:– http://www.cim.mcgill.ca/~jer/research/iroom