teleimmersion (1)
TRANSCRIPT
-
8/3/2019 teleimmersion (1)
1/29
Teleimmersion
Fazel Fakhrieh
-
8/3/2019 teleimmersion (1)
2/29
Overview Introduction: what is teleimmersion?
Teleimmiersion and the grid
Application of teleimmersion
Teleimmersion technologies
Teleimmersion performance requirements
-
8/3/2019 teleimmersion (1)
3/29
Definitions of Teleimmersion networked/distributed/collaborative
virtual environments
[teleimmersive applications] enable the
interaction between geographically
remote participants within a shared, three-
dimensional space.- Watsen & Zyda
-
8/3/2019 teleimmersion (1)
4/29
Definitions (cont) The term Tele-immersion was first
used as the title of a workshop to
bring together researchers in distributedcomputing, collaboration, virtual reality
and networking
- Jason Leigh
-
8/3/2019 teleimmersion (1)
5/29
Definitions (cont) [teleimmersion is] a broad multidisciplinary
research area that includes all aspects of
computer science, virtual reality, virtual worlds,teleoperation and telepresence. A variety of
network elements are required to scale up virtual
environments to arbitrary sizes, simultaneously
connecting thousands of interacting players andall kinds of information objects
- Brutzman, Macedonia & Zyda
-
8/3/2019 teleimmersion (1)
6/29
Definitions (cont) The ultimate synthesis of networking and
media technologies
- Smith & Weingarten
-
8/3/2019 teleimmersion (1)
7/29
Definitions (cont)
Merging Virtual Reality with
Collaboration Technology
-- Rick Stevens
VR
Haptics
VR
Haptics
VR
Haptics
-
8/3/2019 teleimmersion (1)
8/29
a notion of some underlying virtual world
a visual (usually 3D) representation of the
world, possibly augmented with audio andhaptic representations
multiple participants in the world, aware of oneanother
interactions between participants, directed tosome (possibly frivolous) end
--Sam Taylor
Definitions (cont)
-
8/3/2019 teleimmersion (1)
9/29
Virtual Reality
Concept:immersing the user ina computer generated world that
provides suspension of disbelief(i.e. transports the user into the world).
Immersive high-resolution real-time stereo
graphics
Point of view rendering High-quality (spatialized or surround) audio
Haptics (touch and force feedback)
Basis for creating shared work spaces
VR
Haptics
-
8/3/2019 teleimmersion (1)
10/29
Examples of Teleimmersion scientific visualisation - big data, big
compute
cooperative design - architects and CAD
education- distance learning, outreach
entertainment- multi-player games
military- training and simulation
-
8/3/2019 teleimmersion (1)
11/29
Teleimmersion and the grid
Symbiotic relationship
A key is bandwidth latency ,jitter of
network
Integration of computer and data base
Judgment how far we are from pervasive
use of teleimmersion
-
8/3/2019 teleimmersion (1)
12/29
Application of teleimmersion
-
8/3/2019 teleimmersion (1)
13/29
Teleimmersionapplication classes
Interactive scientific visualization
Education, training, and scenario simulation
Art and entertainment
Industrial design, architectural, evaluation
Interactive scientific visualization
Education, training, and scenario simulation Art and entertainment
Industrial design, architectural, evaluation
-
8/3/2019 teleimmersion (1)
14/29
Teleimmersionapplication classes
(cont) Information visualization and data mining
Telecollaboration environments and human
factors
Telepresence for exploration, construction,
and recreation
-
8/3/2019 teleimmersion (1)
15/29
Tele-immersion case study
-
8/3/2019 teleimmersion (1)
16/29
Teleimmertion technologies
Information visualization and data mining
Telecollaboration environments and human
factors
Telepresence for exploration, construction,
and recreation
Projection based system
CAVE( Cave Automatic Virtual Environment )
ImmerDesk
PowerWall
Monitor based system
Head-mounted displays( HMDs)
Binocular Omni-Orientation Monitors( BOOMs)
-
8/3/2019 teleimmersion (1)
17/29
Teleimmertion technologies (cont)
personal
Information
infrastructure
Desktop
collaborativeenvironment
ImmersaDesk
CAVEPowerWall
Work groupsIndividuals collaborations Institutions
-
8/3/2019 teleimmersion (1)
18/29
Teleimmertion technologies (cont)
CAVE
Smaller VR devices
-
8/3/2019 teleimmersion (1)
19/29
CAVE
Multi-person, room-sized, high-resolution,
3D video and audio environment
Graphics are rear-projected in stereo ontothree walls and the floor and are viewed
with stereo glasses
-
8/3/2019 teleimmersion (1)
20/29
CAVE Capability
A user is presented with dynamically movingstereo full-color at multi-thousand-pixel horizontalresolution on the walls and floor.
The primary users position is tracked so that thecorrect perspective view is generated in real time
The primary user can navigate with variety of
intuitive navigational devices currently under testand construction.
-
8/3/2019 teleimmersion (1)
21/29
Immersive Virtual Environment
Audio Synthesizer
Audio Localizer
SpeechRecognizer
DisplayElectronics
Head/Eye/Hand
TrackingElectronics
Haptic/Tactilekinaestheticssystem
commands
graphics
eye position
head position
hand position
VirtualEnvironmentGenerator
UserEnvironment
head-mounteddisplayorprojectiondisplaysystem
-
8/3/2019 teleimmersion (1)
22/29
Teleimmersion performance
requirements Teleimmersion data flows
VR lag and communications performance
Performance requirement
-
8/3/2019 teleimmersion (1)
23/29
Teleimmersion data flow
Control
Text
Audio
Video
Tracking
Data base
Simulation Haptics
Rendering
Tele-immersion
management
Synchronization
of events
-
8/3/2019 teleimmersion (1)
24/29
Audio
Video
Tracking
Database and Event Transactions
Simulation Data
Haptic Drivers
Remote Rendering
Text
Control
Type of flow in collaborative virtual
reality
-
8/3/2019 teleimmersion (1)
25/29
VR lag and communication
performance Caused by: Rendering, display, tracking,
simulation, communication, synchronization
Communications latency source: Transmission Bandwidth
Switching or routing
Contention Protocol
Asynchronous teleimmersion model
-
8/3/2019 teleimmersion (1)
26/29
Performance requirement
Bandwidth requirement
Latency
Reliability
Multicast
-
8/3/2019 teleimmersion (1)
27/29
Bandwidth requirements
-
8/3/2019 teleimmersion (1)
28/29
Type Latency Bandwidth Reliable Multicast Security Streaming DynQosControl < 30 ms 64Kb/s Yes No High No Low
Text < 100 ms 64Kb/s Yes No Medium No Low
Audio < 30 ms Nx128Kb/s No Yes Medium Yes Medium
Video < 100 ms Nx5Mb/s No Yes Low Yes Medium
Tracking < 10 ms Nx128Kb/s No Yes Low Yes Medium
Database < 100 ms > 1GB/s Yes Maybe Medium No High
Simulation < 30 ms > 1GB/s Mixed Maybe Medium Maybe HighHaptic < 10 ms > 1 Mb/s Mixed Maybe High Maybe High
Rendering < 30 ms >1GB/s No Maybe Low Maybe Medium
-
8/3/2019 teleimmersion (1)
29/29
Further reading
For more information on the topics covered in this chapter,see www.mkp.com/grids also following references:
Kalawskys reference text on virtual environments is
comprehensive Two national research council reports discuss open
research topics in environments and user interfaces
Burdea provides a comprehensive survey of haptics, and
Minsky a wonderful haptices bibiography Matlin and Foley survey human sensory and perceptionsystems, from which many of the requirments ofteleimmersive and virtual environment derive
http://www.mkp.com/gridshttp://www.mkp.com/grids