wt: augmented reality browserswt: augmented reality browsers ... attach to a person’s surroundings...

38
WT: AUGMENTED REALITY BROWSERS Eduardo Veas Graz University of Technology December 2017

Upload: buihanh

Post on 18-Apr-2018

225 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

WT: AUGMENTED REALITY BROWSERS

Eduardo Veas

Graz University of Technology December 2017

Page 2: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR … WHAT?

WHAT AR ??

2

AUGMENTED REALITY MOBILE INTERACTION

Page 3: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

3

AUGMENTED REALITY MOBILE INTERACTION

AR … WHAT?

Page 4: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR … WHAT?

Attach to a person’s surroundings computer generated information

- registered in 3D

- in real-time.

4

AUGMENTED REALITY MOBILE INTERACTION

Page 5: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR … WHAT?

5

AUGMENTED REALITY MOBILE INTERACTION

Page 6: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR … WHAT?

Attach to a person’s surroundings computer generated information

- registered in 3D

- in real-time. 6

AUGMENTED REALITY MOBILE INTERACTION

Page 7: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR – TOPICS.

• Accurate registration = tracking.

• Rendering content in 3D

• Adapting to real world conditions

• View management

• Interaction with physical / virtual content

7

AUGMENTED REALITY MOBILE INTERACTION

Page 8: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

• Rendering content in 3D

• Adapting to real world conditions

8

AUGMENTED REALITY MOBILE INTERACTION

AR – TOPICS.

Page 9: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

9

AUGMENTED REALITY MOBILE INTERACTION

• View management

• Interaction with physical / virtual content

AR – TOPICS.

Page 10: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR … WHY?

mobile (wearable) computer + display

+ computers and sensors everywhere

= seamless gateway to a digital world about the physical world.

10

AUGMENTED REALITY MOBILE INTERACTION

Page 11: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR … WHY?

• Natural interaction

• Information integrated in single space

• Reveal the invisible

11 AUGMENTED REALITY MOBILE INTERACTION

Page 12: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR VISION

• Show video here

12

AUGMENTED REALITY MOBILE INTERACTION

Page 13: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR - Technology

13

AUGMENTED REALITY MOBILE INTERACTION

Page 14: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Tech: History

14

AUGMENTED REALITY MOBILE INTERACTION

[Sutherland, 1965] Sutherland, I. E. (1965). The ultimate display. In

Proceedings of the IFIP Congress, pages 506–508.

Page 15: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Tech: History

15

AUGMENTED REALITY MOBILE INTERACTION

[Rekimoto, 1995] Rekimoto, J. (1995). The Magnifying Glass Approach to Augmented Reality Systems. In International

Conference on Artificial Reality and TeleExistence, volume 95, pages 123–132.

Page 16: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Tech: History

16

AUGMENTED REALITY MOBILE INTERACTION

1995 -------------------------------- 2002 -------------------------------- 2007

Page 17: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Tech: History

17

AUGMENTED REALITY MOBILE INTERACTION

Columbia University: MARS ‘97

Page 18: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

MARS BARS TINMITH

18

AUGMENTED REALITY MOBILE INTERACTION

AR Tech: History 1995 -------------------------------- 2000 -------------------------------- 2002

Page 19: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR - Technology

19

AUGMENTED REALITY MOBILE INTERACTION

Page 20: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR - Technology

20

AUGMENTED REALITY MOBILE INTERACTION

1995 -------------------------------- 2008 ------------------------------------------- 2017

CPU:300 Mhz HDD: 9 GB RAM: 512Mb Camera: VGA 30FPS Graphics: 500k poly/sec

CPU: 600 Mhz HDD: 16GB RAM: 128Mb Camera: VGA 30FPS Graphics: ~7 Mio poly/sec

Page 21: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR - Applications

• Advertisement

• Navigation

• Tourism

• Entertainment

• UI for appliances

• Maintenance

• Military

21

AUGMENTED REALITY MOBILE INTERACTION

Page 22: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Navigation

22

AUGMENTED REALITY MOBILE INTERACTION

Page 23: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

Subsurface information: Motivation

Visualize location of underground infrastructure, to determine position of asset.

23

AR INTERFACES FOR MOBILE SPATIAL INTERACTION

Page 24: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

Subsurface information

Goals: survey position of new asset. Estimate position of existing asset.

24

AR INTERFACES FOR MOBILE SPATIAL INTERACTION

Page 25: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

Subsurface information

• (GIS provider)

• Clients: Utility companies ( electricity, water, gas), government, railroad companies.

• Requirements: precise registration.

25

AR INTERFACES FOR MOBILE SPATIAL INTERACTION

Page 26: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Browsers

• Real World Overlay – GPS + compass

– Graphics on live video

• SDKs – Metaio

– Wikitude

– Layar

– AccrossAir

26 AUGMENTED REALITY MOBILE INTERACTION

• Overlay Real Object – Computer Vision

– Graphics on live video

• SDKs – Qualcomm’s

VUFORIA

– Metaio/Junaio

– Layar

Page 27: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Browsers:

27

AUGMENTED REALITY MOBILE INTERACTION

Page 28: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Browsers:

28

AUGMENTED REALITY MOBILE INTERACTION

Open Channel

Open Channel

Request POI

Request POI

Display POI

Display POI

Parse/ Load content

Parse/ Load content

Callback channel Callback channel

XML Fwd XML Fwd

Create POI

Create POI

Format XML

response

Format XML

response

Page 29: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Browsers: Client

29

AUGMENTED REALITY MOBILE INTERACTION

Page 30: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Browsers

30

AUGMENTED REALITY MOBILE INTERACTION

Page 31: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Browsers

• Comercial outdoor LB applications – Metaio, Layar, Wikitude

• No uniform language – Wikitude: ARML

– Junaio: XML

31

AUGMENTED REALITY MOBILE INTERACTION

Page 32: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

VUFORIA SDK

32

AUGMENTED REALITY MOBILE INTERACTION

Page 33: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

33

AUGMENTED REALITY MOBILE INTERACTION

VUFORIA SDK

Page 34: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Browsers: Limitations

• Slow Memory

• Poor access to camera (but IOS camera API)

• Bad camera quality

• No floating point unit

34

AUGMENTED REALITY MOBILE INTERACTION

Page 35: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Browsers

• Layar (http://www.layar.com/)

• Metaio (http://www.metaio.com/)

• Wikitude (http://wikitude.com/)

• Ausrasma (http://www.aurasma.com/)

• AR Lab (http://www.arlab.com/)

• Argon (http://argon.gatech.edu/)

• MixARe (http://www.mixare.org/)

35

AUGMENTED REALITY MOBILE INTERACTION

Page 36: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

AR Projects

• AR Spaces: using space around you to display information ad-hoc.

• AR Reading Aid: using wearable devices to show information related to a piece of text

• AR Guide: using wearable devices to collaboratively build LEGO stuff together.

• Interested? Know C++? Contact [email protected]

36

AUGMENTED REALITY MOBILE INTERACTION

Page 37: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

Closing video

37

AUGMENTED REALITY MOBILE INTERACTION

Page 38: WT: AUGMENTED REALITY BROWSERSWT: AUGMENTED REALITY BROWSERS ... Attach to a person’s surroundings computer generated information ... (wearable) computer + displaykti.tugraz.at/staff/vsabol/courses/wt/slides_ar-browser.pdf ·

Eduardo Veas Dec. 2017

Thank you

38

Eduardo Veas | [email protected]