Download - COSC 426 Lect. 1 - Introduction to AR
![Page 1: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/1.jpg)
COSC 426 A d R liCOSC 426: Augmented Reality
Mark Billinghurst
July 2011
Lecture 1Lecture 1
![Page 2: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/2.jpg)
Mark BillinghurstPhD Electrical EngineeringPhD Electrical Engineering
University of WashingtonInteraction DesignInteraction Design
Museum experiencesTools for designersTools for designers
Augmented RealityMobile AR Evaluation Mobile AR, Evaluation, Multimodal Interfaces, Collaborative
CollaborationCollaborationEnhanced FtF and remote collaborationSocial networkingSocial networking
![Page 3: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/3.jpg)
OverviewOne tow hour lectures weekOne tow hour lectures week
Friday 9 – 11amYou will learnYou will learn
Introduction to Augmented RealityAugmented Reality technologyAugmented Reality technologyAR Interaction techniquesInteraction DesignInteraction DesignAR authoring toolsResearch directions in AR
Complete a simple project
![Page 4: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/4.jpg)
C O lCourse OutlineWk 1 (July 15th): Introduction to AR(J y )Wk 2 (July 22nd): AR TechnologyWk 3 (July 29th): AR Developer Tools(J y ) pWk 4 (Aug 5th): AR Interaction TechniquesWk 5 (Aug 12th): AR ApplicationsWk 5 (Aug 12 ): AR ApplicationsWk 6 (Aug 19th): Outdoor and Mobile ARWk 7,8 (Aug 26th, Sept 2nd): Holidays Wk 7,8 (Aug 26 , Sept 2 ): Holidays Wk 9 (Sept 9th): Collaborative AR Wk 10 (Sept 16th): Usability Testing Wk 10 (Sept 16 ): Usability Testing Wk 11 (Sept 23rd): AR research DirectionsWk 12 (Sept 30th): Final Project Presentations Wk 12 (Sept 30 ): Final Project Presentations
![Page 5: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/5.jpg)
Assessment - Update
Research project – 40%Group work (2-4 people)Group work (2-4 people)Due Sept 30th
Two Class Assignments – 20 %Programming assignments, individual workg g g ,
Final Exam – 40%E k O 3 d 14thExam week Oct 3rd – 14th
![Page 6: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/6.jpg)
IntroductionIntroduction
![Page 7: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/7.jpg)
A Brief History of Time
T dTrendsmaller, cheaper, more functions, more intimate
T h l b blTechnology becomes invisibleIntuitive to use I f i lInterface over internalsForm more important than functionH t d d iHuman centered design
![Page 8: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/8.jpg)
A B f H f CA Brief History of Computing
Trendsmaller, cheaper, faster, more intimate, intelligent objects
Computers need to become invisiblehide the computer in the real world
- Ubiquitous / Tangible Computing
put the user inside the computer Vi l R li- Virtual Reality
![Page 9: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/9.jpg)
Invisible Interfaces
Jun Rekimoto, Sony CSL
![Page 10: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/10.jpg)
Virtual Reality
19891989…
![Page 11: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/11.jpg)
![Page 12: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/12.jpg)
Cheap HMDs
![Page 13: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/13.jpg)
Virtual Reality
Immersive VR Head mounted display, glovesSeparation from the real worldSeparation from the real world
![Page 14: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/14.jpg)
VR Today
$3-5 Billion VR business (+ > $150 Billion Graphics Industry)Visualization, simulation, gaming, CAD/CAE, multimedia, graphics arts
![Page 15: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/15.jpg)
1977 – Star Wars
![Page 16: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/16.jpg)
2008 - CNN
![Page 17: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/17.jpg)
Augmented Reality DefinitionD f Ch [A 97]Defining Characteristics [Azuma 97]
Combines Real and Virtual Images- Both can be seen at the same time
Interactive in real-time- The virtual content can be interacted with
Registered in 3Dg- Virtual objects appear fixed in space
![Page 18: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/18.jpg)
Augmented Reality Examples
Put AR pictures here
![Page 19: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/19.jpg)
AR vs VR
Virtual Reality: Replaces RealityScene Generation: requires realistic imagesq gDisplay Device: fully immersive, wide FOVTracking and Sensing: low accuracy is okayTracking and Sensing: low accuracy is okay
Augmented Reality: Enhances RealityScene Generation: minimal rendering okayDisplay Device: non-immersive small FOVDisplay Device: non immersive, small FOVTracking and Sensing: high accuracy needed
![Page 20: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/20.jpg)
Milgram’s Reality-Virtuality continuum
Mixed Reality
Real Augmented Augmented VirtualEnvironment Reality (AR) Virtuality (AV) Environment
Reality - Virtuality (RV) Continuum
![Page 21: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/21.jpg)
Metaverse
Neal Stephenson’s “SnowCrash”The Metaverse is the convergence of: The Metaverse is the convergence of:
1) virtually enhanced physical reality 2) h ll l 2) physically persistent virtual space
Metaverse Roadmapphttp://metaverseroadmap.org/
![Page 22: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/22.jpg)
Metaverse Dimensions• Augmentation technologies that layer information onto
our perception of the physical environment.• Simulation refers to technologies that model reality • Intimate technologies are focused inwardly, on the Intimate technologies are focused inwardly, on the
identity and actions of the individual or object;• External technologies are focused outwardly towards • External technologies are focused outwardly, towards
the world at large;
![Page 23: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/23.jpg)
Metaverse Components
Four Key ComponentsVirtual WorldsAugmented RealityMirror WorldsMirror WorldsLifelogging
![Page 24: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/24.jpg)
![Page 25: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/25.jpg)
Mirror Worlds
Mirror worlds are informationally-enhanced virtual models of the physical world.p y
Google Earth, MS Street View, Google Maps
![Page 26: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/26.jpg)
![Page 27: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/27.jpg)
LifeLogging
Technologies record and report the intimate states and life histories of objects and usersj
Nokia LifeBlog, Nike+, FitBits
![Page 28: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/28.jpg)
Steve Mann - LifeLogginggg g
![Page 29: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/29.jpg)
Gordon Bell: LifeLogging
1 TB to store 65 years of data1 TB to store 65 years of data
![Page 30: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/30.jpg)
Summary
Augmented Reality has three key featuresCombines Real and Virtual ImagesgInteractive in real-timeRegistered in 3DRegistered in 3D
AR can be classified alongside other technologiesMilgrams Mixed Reality continuumMetaVerse MetaVerse
![Page 31: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/31.jpg)
AR HistoryAR History
![Page 32: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/32.jpg)
A Brief History of AR (1)1960’ S h l d / S ll’ 1960’s: Sutherland / Sproull’s first HMD system was see-throughthrough
![Page 33: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/33.jpg)
A Brief History of AR (2)
1960 - 70’s: US Air Force helmet mounted displays (T Furness)displays (T. Furness)
![Page 34: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/34.jpg)
A Brief History of AR (3)
1970 - 80’s: US Air Force Super Cockpit (T. Furness)p p ( )
![Page 35: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/35.jpg)
A Brief History of AR (4)
990’ “A ” Early 1990’s: Boeing coined the term “AR.” Wire harness assembly application begun (T. Caudell, D. Mizell). E l t id 1990’ UNC lt d i li ti j tEarly to mid 1990’s: UNC ultrasound visualization project
![Page 36: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/36.jpg)
A Brief History of AR (5)
1994: Motion stabilized display [Azuma]1994: Motion stabilized display [Azuma]1995: Fiducial tracking in video see-through [Bajura / Neumann]1996: UNC hybrid magnetic-vision trackery g
![Page 37: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/37.jpg)
A Brief History of AR (6)
1996: MIT Wearable Computing efforts1998: Dedicated conferences beginL 90’ C ll b i d i iLate 90’s: Collaboration, outdoor, interactionLate 90’s: Augmented sports broadcasts1998 - 2001: Mixed Reality Systems Lab1998 - 2001: Mixed Reality Systems Lab
![Page 38: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/38.jpg)
History Summary
1960’s – 80’s: Early Experimentation1980’s – 90’s: Basic Research1980 s 90 s: Basic Research
Tracking, displays
1995 – 2005: Tools/ApplicationsInteraction, usability, theoryy y
2005 - : Commercial ApplicationsG M di l I dGames, Medical, Industry
![Page 39: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/39.jpg)
Gartner Hype Cycle
![Page 40: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/40.jpg)
2007 - AR Reaches Mainstream
MIT Technology ReviewMarch 2007list of the 10 most exciting technologiesexciting technologies
EconomistDec 6th 2007Dec 6th 2007Reality, only better
![Page 41: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/41.jpg)
Gartner’s top 10 disruptive technologies 2008-2012:Multicore and hybrid processors Virtualisation and fabric computing S i l k d i l f Social networks and social software Cloud computing and cloud/Web platforms Web mash s Web mashups User Interface Ubiquitous computing Ubiquitous computing Contextual computing Augmented reality Augmented reality Semantics
![Page 42: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/42.jpg)
2009 - AR in Magazines
Esquire MagazineDec 2009 issue12 pages AR content
M OthMany OthersWiredColorsRed BullRed BullEtc
![Page 43: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/43.jpg)
Google Searches for AR
![Page 44: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/44.jpg)
2008 - Browser Based ARFlash + camera + 3D graphicsHigh impactg p
High marketing value
Large potential install baseLarge potential install base1.6 Billion web users
Ease of developmentEase of developmentLots of developers, mature tools
L f Low cost of entryBrowser, web camera
![Page 45: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/45.jpg)
![Page 46: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/46.jpg)
![Page 47: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/47.jpg)
Impact of Web-based AR
Boffswana Living Sasquatchhttp://www.boffswana.com/news/?p=605p p
In first month100K 100K unique visits 500K page views6 minutes on page
![Page 48: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/48.jpg)
Mobile Phone ARMobile Phones
cameracameraprocessord ldisplay
AR on Mobile PhonesSimple graphicsOptimized computer visionOptimized computer visionCollaborative Interaction
![Page 49: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/49.jpg)
AR Advertising (HIT Lab NZ 2007)
T d l d AR li i (200K)Txt message to download AR application (200K)See virtual content popping out of real paper advertTested May 2007 by Saatchi and SaatchiTested May 2007 by Saatchi and Saatchi
![Page 50: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/50.jpg)
2008: Location Aware Phones
Nokia NavigatorMotorola Droid
![Page 51: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/51.jpg)
2009 - Outdoor Information OverlayM bil h b dMobile phone basedTag real world locations g
GPS + Compass inputOverlay graphics data on live videoOverlay graphics data on live video
ApplicationsTravel guide, Advertising, etc
Wikitude, Layar, Junaio, etc.., y , J ,Android based, Public API released
![Page 52: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/52.jpg)
Layar (www.layar.com)
Location based dataGPS + compass locationpMap + camera view
AR L l ldAR Layers on real worldCustomized dataAudio, 3D, 2D content
Easy authoringEasy authoringAndroid, iPhone
![Page 53: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/53.jpg)
$784 million USD in 2014
![Page 54: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/54.jpg)
Some Commercial AR Companies
ARToolworks (http://www artoolworks com/)ARToolworks (http://www.artoolworks.com/)ARToolKit, FLARToolKit, SDKs
Metaio (http://www.metaio.com/)Marketing, Industry, SDKsMarketing, Industry, SDKs
Total Immersion (http://www.t-immersion.com/)Marketing, Theme Parks, AR Experiences
Qualcomm Qua co (http://developer.qualcomm.com/dev/augmented-reality)
Mobile AR QCAR SDKMobile AR, QCAR SDK
![Page 55: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/55.jpg)
FLARToolKit (ARToolworks)
Flash version of ARToolKitFLARToolKit + Papervison3D = AR on the webFLARToolKit + Papervison3D = AR on the webExample - GE Ecomagination Website
1.2 million views on YouTubehttp://ge.ecomagination.com/smartgrid/#/augmented_realityp g g g g y
![Page 56: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/56.jpg)
Software Platform (Metaio)
Unifeye software platformModular platform for building AR applicationsp g pp
![Page 57: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/57.jpg)
Markerless Tracking (Total Immersion)
D’Fusion markerless tracking platform Turn key solutiony
Example - Topps baseball cards AR h f l b b ll dAR characters on top of real baseball cards
![Page 58: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/58.jpg)
Summary
Augmented Reality has a long history going back to the 1960’sInterest in AR has exploded over the last two years and is being commercialized quicklyyears and is being commercialized quicklyAR is growing in a number of areas
Mobile ARWeb based ARWeb based ARAdvertising experiences
![Page 59: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/59.jpg)
Sample AR ApplicationsSample AR Applications
![Page 60: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/60.jpg)
Applications
MedicineManufacturingInformation overlayInformation overlayArchitectureMuseumMarketingMarketingGaming
![Page 61: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/61.jpg)
Applications: medical“X-ray vision” for surgeonsAid visualization, minimally-invasive operations. Aid visualization, minimally invasive operations. Training. MRI, CT data.
Ul d j UNC Ch l HillUltrasound project, UNC Chapel Hill.
CourtesyUNCChapelHill
![Page 62: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/62.jpg)
Medical AR TrialsSauer et al. 2000 at Siemens Corporate Research, NJStereo video see throughStereo video see through
F. Sauer, Ali Khamene, S. Vogt: An Augmented Reality Navigation System with a Single-Camera Tracker: System Design and Needle Biopsy Phantom Trial,Single Camera Tracker: System Design and Needle Biopsy Phantom Trial,MICCAI 2002
![Page 63: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/63.jpg)
![Page 64: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/64.jpg)
Assembly and maintenance © 1996 S. Feiner, B. MacIntyre, & A. Webster, Columbia University
© 1993 S F i B M I t &© 1993 S. Feiner, B. MacIntyre, & D. Seligmann, Columbia University
![Page 65: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/65.jpg)
PS3 - Eye of Judgment (2007)C t Vi i T kiComputer Vision TrackingCard based battle gameC ll b ti ARCollaborative AROctober 24th 2007
![Page 66: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/66.jpg)
![Page 67: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/67.jpg)
AR Books – Markerless Tracking
![Page 68: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/68.jpg)
AR Jam story bookAR Jam story book
![Page 69: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/69.jpg)
AR A t tiAR Annotations
Columbia University
© 1993 S. Feiner, B. MacIntyre, M. Haupt, & E. Solomon,C l bi U i i
© 1997 S. Feiner, B. MacIntyre, T. Höllerer, & A. Webster,
Columbia University, ,
Columbia University
HRL
![Page 70: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/70.jpg)
Applications: Annotating Environment
P bli d i iPublic and private annotationsAid recognition, “extended memory”g , y
![Page 71: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/71.jpg)
The World = Your User Interface (Feiner)
E E h Al
© 2002, Scientific American
Everyone, Everywhere, Always
![Page 72: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/72.jpg)
Application: Broadcast Augmentation
Adding virtual content to live sports broadcasts“First down” line in American footballFirst down line in American footballHockey puck trails, virtual advertisementsNational flags in swimming lanes in 2000 OlympicsNational flags in swimming lanes in 2000 Olympics
Commercial applicationPrinceton Video Image is one company
- http://www.pvi.tv/
![Page 73: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/73.jpg)
Broadcast Examples
![Page 74: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/74.jpg)
Interactive Museum ExperiencesBlackMagic
Virtual America’s Cup410,000 people in six months
MagicPlanetTeManawa science museumVirtual AstronomyCollaborative AR experience
AR VolcanoInteractive AR kioskScienceworks museum, Melbourne
![Page 75: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/75.jpg)
Museum Archeology
LifePlus (2002-2004) Natural feature trackinggVirtual charactersMobile AR systemMobile AR system
Archeoguide (2000-2002)Cultural heritage on-site guideHybrid trackingHybrid trackingVirtual overlay
![Page 76: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/76.jpg)
SummaryAR h l b d d l d AR technology can be used to develop a wide range of applicationsPromising application areas include
GamesGamesEducationEngineeringEngineeringMedicineMMuseumsEtc..
![Page 77: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/77.jpg)
AR Experience DesignAR Experience Design
![Page 78: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/78.jpg)
“The product is no longer The product is no longer the basis of value The the basis of value. The
experience is ”experience is.
Venkat RamaswamyThe Future of Competition.
![Page 79: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/79.jpg)
Gilmore + Pine: Experience EconomyGilmore Pine: Experience Economy
E tiexperiences Emotion
services
productsproducts
components Function
Sony CSL © 2004
![Page 80: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/80.jpg)
The Value of Good User Experience
5050c
$3.50
20c
![Page 81: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/81.jpg)
Good Experience DesignReactrixReactrix
Top down projectionCamera based inputCamera based inputReactive GraphicsNo instructionsNo instructionsNo training
![Page 82: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/82.jpg)
![Page 83: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/83.jpg)
![Page 84: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/84.jpg)
Using the N-gage
![Page 85: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/85.jpg)
SideTalkinghttp://www.sidetalkin.com
![Page 86: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/86.jpg)
![Page 87: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/87.jpg)
![Page 88: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/88.jpg)
Interaction Design
“Designing interactive products to support people in their everyday and working lives”everyday and working lives
Preece, J., (2002). Interaction Design
Design of User Experience with TechnologyHigher in the value chain than product designHigher in the value chain than product design
![Page 89: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/89.jpg)
![Page 90: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/90.jpg)
![Page 91: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/91.jpg)
Interaction Design involves answering three questions:What do you do? - How do you affect the world?What do you feel? – What do you sense of the world?What do you know? – What do you learn?
![Page 92: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/92.jpg)
Interaction Design Process
![Page 93: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/93.jpg)
Who are your Users?
Everyone!y
![Page 94: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/94.jpg)
Designing for Everyone
Designing for Everyone pleases No one
![Page 95: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/95.jpg)
Understanding Specific Needs
![Page 96: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/96.jpg)
![Page 97: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/97.jpg)
Interaction Design is All About You
Users should be involved throughoutinvolved throughout the Design ProcessConsider all the needs Co s de a t e eedsof the user
![Page 98: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/98.jpg)
![Page 99: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/99.jpg)
![Page 100: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/100.jpg)
B ildi C lli AR E iBuilding Compelling AR Experiences
experiencesUsability
applications Interaction
tools Authoringtools Authoring
components Tracking, Display
![Page 101: COSC 426 Lect. 1 - Introduction to AR](https://reader034.vdocuments.site/reader034/viewer/2022051110/54c8c8794a79597f2a8b45a6/html5/thumbnails/101.jpg)
Summary
In order to build AR applications you need to focus on the user experiencepGreat user experience is based on
L l l AR h lLow level AR component technologyAuthoring toolsApplication/Interaction designUser experience textingUser experience texting