vr and ar lecture - glapdg/teaching/mantchi/itmm2003/slides/vr.pdf · mixed reality msc it...

6
1 MSC IT Multimedia Module VR & AR Virtual and Augmented Reality Phil Gray 2 MSC IT Multimedia Module VR & AR Outline What is VR? Types of VR VR technologies DIVE VRML QTVR VR Issues 3 MSC IT Multimedia Module VR & AR Outline What is AR? Related Concepts AR Examples Mixed Reality 4 MSC IT Multimedia Module VR & AR VR: Defining characteristics Computer simulations that use 3D graphics and devices such as the data glove to allow the user to interact with the simulation. (FOLDOC) Simulation Sense of presence Interactivity Direct manipulation 3D? 5 MSC IT Multimedia Module VR & AR VR: Types of VR Immersive Generate representation that surrounds the user VR headsets Data gloves Haptic input devices CAVEs Desktop VR Give user “window” onto a 3D world Spatialised sound Haptic input & feedback 6 MSC IT Multimedia Module VR & AR VR: VR Hardware Technology Head mounted displays 3D displays Data glove Haptic devices CAVEs (CAVE Automatic Virtual Environment)

Upload: others

Post on 16-Jul-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: vr and ar lecture - Glapdg/teaching/mantchi/itmm2003/slides/vr.pdf · Mixed Reality MSC IT Multimedia Module VR & AR 4 VR: Defining characteristics Computer simulations that use 3D

1MSC IT Multimedia Module VR & AR

Virtual and

Augmented Reality

Phil Gray

2MSC IT Multimedia Module VR & AR

OutlineWhat is VR?Types of VRVR technologies

DIVEVRMLQTVR

VR Issues

3MSC IT Multimedia Module VR & AR

OutlineWhat is AR?Related ConceptsAR ExamplesMixed Reality

4MSC IT Multimedia Module VR & AR

VR:Defining characteristics

Computer simulations that use 3D graphics and devices such as the data glove to allow the user to interact with the simulation. (FOLDOC)SimulationSense of presenceInteractivity

Direct manipulation

3D?

5MSC IT Multimedia Module VR & AR

VR:Types of VR

ImmersiveGenerate representation that surrounds the user

VR headsetsData glovesHaptic input devicesCAVEs

Desktop VRGive user “window” onto a 3D worldSpatialised soundHaptic input & feedback

6MSC IT Multimedia Module VR & AR

VR:VR Hardware Technology

Head mounted displays3D displaysData gloveHaptic devicesCAVEs(CAVEAutomaticVirtualEnvironment)

Page 2: vr and ar lecture - Glapdg/teaching/mantchi/itmm2003/slides/vr.pdf · Mixed Reality MSC IT Multimedia Module VR & AR 4 VR: Defining characteristics Computer simulations that use 3D

7MSC IT Multimedia Module VR & AR

VR:CAVE

CAVE at UCL

Training devicefor speakers

Also used to treat phobias

8MSC IT Multimedia Module VR & AR

VR:VR Software Technology

VRMLQTVRDIVE

9MSC IT Multimedia Module VR & AR

VR:VRML

Virtual Reality Modelling Language“an open standard for 3D multimedia and shared virtual worlds on the Internet”Scene description languageRequires a viewer

Stand-alonePlug-in

Demo

10MSC IT Multimedia Module VR & AR

VR:VRML

VRML 1.0 – static environmentsVRML 97 (VRML 2.0)

InteractionAnimation

X3DMaking VRML XML compliant

11MSC IT Multimedia Module VR & AR

VR:VRML: A Simple Example#VRML V1.0 ascii

Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0

rotation 1 0 0 3.14159265}

Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97

height 4}

Define a colour(RGB value)

12MSC IT Multimedia Module VR & AR

VR:VRML: A Simple Example#VRML V1.0 ascii

Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0

rotation 1 0 0 3.14159265}

Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97

height 4}

Create a primitive shape

Page 3: vr and ar lecture - Glapdg/teaching/mantchi/itmm2003/slides/vr.pdf · Mixed Reality MSC IT Multimedia Module VR & AR 4 VR: Defining characteristics Computer simulations that use 3D

13MSC IT Multimedia Module VR & AR

VR:VRML: A Simple Example#VRML V1.0 ascii

Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0

rotation 1 0 0 3.14159265}

Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97

height 4}

move & rotate

14MSC IT Multimedia Module VR & AR

VR:VRML: A Simple Example#VRML V1.0 ascii

Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0

rotation 1 0 0 3.14159265}

Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97

height 4}

Change the colour

15MSC IT Multimedia Module VR & AR

VR:VRML: A Simple Example#VRML V1.0 ascii

Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0

rotation 1 0 0 3.14159265}

Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97

height 4}

Add anotherprimitive shape

16MSC IT Multimedia Module VR & AR

VR:QTVR

System for generating low-cost simplified pseudo-3D desktop virtual environmentsBased on the QuickTime software architecture3 variants

panoramasobjectsscenes

17MSC IT Multimedia Module VR & AR

VR:DIVE

Distributed Interactive Virtual EnvironmentProvides

software infrastructureFile formatsApplications

Used for large-scale collaborative virtual reality applications

18MSC IT Multimedia Module VR & AR

Page 4: vr and ar lecture - Glapdg/teaching/mantchi/itmm2003/slides/vr.pdf · Mixed Reality MSC IT Multimedia Module VR & AR 4 VR: Defining characteristics Computer simulations that use 3D

19MSC IT Multimedia Module VR & AR

VR:VR Issues

Fatigue & nausea with head-mounted displaysComputational challenge of achieving fidelity and sufficient performanceSupporting interactivity

Avatars3D interaction techniques

20MSC IT Multimedia Module VR & AR

AR:Augmented Reality

AR – systems that enhance interaction between a user and his/her physical environment by placing computational capabilities in and around the physical environment

21MSC IT Multimedia Module VR & AR

AR:Related Concepts

Ubiquitous computingPervasive computingAmbient intelligenceContext-aware systemsContext-sensitive systems

22MSC IT Multimedia Module VR & AR

AR:Tangible Media

Hiroshi IshiiTangible MediaGroup, MIT Media LabAdding computationto ordinary physicalobjects

23MSC IT Multimedia Module VR & AR

AR:The SenseTable (MIT Media Lab)

24MSC IT Multimedia Module VR & AR

AR:SandScape (MIT Media Lab)

Page 5: vr and ar lecture - Glapdg/teaching/mantchi/itmm2003/slides/vr.pdf · Mixed Reality MSC IT Multimedia Module VR & AR 4 VR: Defining characteristics Computer simulations that use 3D

25MSC IT Multimedia Module VR & AR

AR:Magic Board (IMAG, Grenoble)

Images can bedrawn onto whiteboardProjected ontowhiteboard

Gestures can bedetected via processingof video images

26MSC IT Multimedia Module VR & AR

AR:Agumented Environments

Life-Sized Projector-Based Dioramas (2001) Kok-Lim Low, Greg Welch, Anselmo Lastra, Henry Fuchs. UNC Chapel Hill

27MSC IT Multimedia Module VR & AR

AR:Case Study: CASPER

Augmented surgeryTrajectory of needle is plannedin advanceDuring procedure, position ofneed is projected onto display

Version 1

Version 2

28MSC IT Multimedia Module VR & AR

AR:The Next Step – Mixed Reality

Mixed reality = VR + ARSystems that

combine physical and digital information and experienceCoordinate physical and digital experiences … for one or more people

29MSC IT Multimedia Module VR & AR

AR:Case Study: The City Project

30MSC IT Multimedia Module VR & AR

AR:Case Study: The City Project

EQUIPTupleSpace

locationsensors

Desktop VR

Hypertext (Web)The Real Gallery

Page 6: vr and ar lecture - Glapdg/teaching/mantchi/itmm2003/slides/vr.pdf · Mixed Reality MSC IT Multimedia Module VR & AR 4 VR: Defining characteristics Computer simulations that use 3D

31MSC IT Multimedia Module VR & AR

computationalcapabilities arebeginning tobecome availablefor incorporationin clothesMIThrilwearableplatform

AR:Wearable Computing

32MSC IT Multimedia Module VR & AR

For more informationCAVEs

Mel Slater website

VRMLhttp://vrmlworks.crispen.org/faq/

ARHiroshi Ishii, Tangible Media Group, MIT Media Lab

Pervasive ComputingGregory Abowd, Georgia Tech

Mixed RealityEquator IRC