Augmented RealityApplication Examples by VTT

BLUE workshop, Turku 21.8.2018

Dr. Charles WoodwardVTT Technical Research Centre of Finland

Augmented Reality (AR)§ Adding of virtual objects in view of real world§ C.f. Virtual Reality (completely virtual worlds)§ Properties: real-time, interactive, 3D registration§ Display devices: mobile phone/tablet, data glasses etc.

Introduction – AR

Related technologies§ Augmented Virtuality§ Mediated Reality§ Diminished Reality, …<-> Mixed Reality (MR)

Reality Virtual RealityAugmentedReality

AR at VTT

Augmented Reality / 3D Tracking research at VTT§ Research topic started in 2001§ Today team of 25 people based in Espoo & Tampere§ AR/MR core technology & high-end applications§ Human factors, usability, user experience

Leading edge technology§ First in the world with various AR applications§ ALVAR SDK (A Library for Virtual and Augmented Reality)§ Marker, multimarker, 2D template and 3D point cloud tracking§ See www.vtt.fi/multimedia

Applications, incl.§ Games, Entertainment§ Print media, Advertising§ Interior design, Furniture§ Virtual Worlds, Telepresence§ Industrial Maintenance, Assembly§ Architecture, Engineering & Construction

Dibidogs – 3D animated children’s TV series§ By Futurecode (Finland) and Blue Arc (China)§ Launched April 2010, MTV3 / SubTV Junior

Augmented TV magazine§ TV-magazines Katso and TVSeiska, March 2010§ 3D animations appear augmented from magazine

Augmented storybook§ Kustannus Paasilinna, Aug 2010§ Photorealistic rendering etc.

Mobile phoneimplementationat ShanghaiWorld Expo 2010

Augmented Print Media

Print Media / Real Characters

Flash implementation§ Easy 2,5 D content creation§ Live person videod in chroma key studio§ Combined with special 3D effects

Applications§ Seiska magazine: augmented movie trailers§ DNV (Det Norske Veritas): Technology Outlook 2020§ Augmented business cards (Painonet)

Mobile Advertising

Sparkly promotion campaign§ The new Sparkly Brut drink, which is the newest line extension to

Sinebrychoff's Golden Cap range, launched in October 2011§ Promotion by mobile AR advertisement in Elle Magazine (by Aller)§ Addressing target customer group for Sparkly & lot of iPhone owners

Features§ Download from AppStore§ Play with 3D bottle§ Start AR game§ Keep the 3D bottle standing for 15

seconds§ As reward get a mobile discount

coupon for Sparkly§ Share coupon with friends§ Read product info§ Find closest bar / restaurant§ Utilize your mobile discount coupon

City Planning / Future Buildings

Examples§ Hotel plans at Billnäs ironworks site§ Clarion hotel building planned in Helsinki§ Mobile AR visualizations for city planning councils

Citizen Participation

Examples§ Wind generator park at Pörtom,

visualization for authorities & local farmers§ Koskela hospital, four alternative plans

presented to local residents

Historical Buildings

Examples§ Tourist info at Senate Square, Helsinki (Nokia)§ Colosseum (Inglobe Technologies, Italy)

Point cloud based tracking§ 3D point clouds obtained from photos§ Automatic, accurate, robust, fast

Visualizing the Past

Augmenting historical photos§ Pilot cases in Turku, Helsinki and Lahti§ Augmenting historical photos at real locations§ Showing how the city looked in the good old times

AR Storytelling

Project Futuristic History§ In co-operation with VTT and Turku University§ AR storytelling, bringing historical places to life§ Including 40 minute tour around site§ Several AR scenes and interactions§ Based on VTT’s point cloud tracking

SelfieWall

http://www.kauppalehti.fi/uutiset/selfie-seinalla-voi-sukeltaa-keskelle-menneisyytta/kjnAPDBw

Interactive augmented large screen§ Extracts people from background, throws them

into the picture§ Correct perspective, depth layers, color

adjustments etc.

Grabs your attention§ Engaging and memorable experience, surprise

element, playfullnes§ Brand advertising, sharing of augmented selfies

in social media

Installations§ Maritime Museum Vellamo, Kotka§ Autodesk Technology Museum, San Fransisco§ Helsinki City Museum§ Helsinki Opera House§ Ateneum, Helsinki§ Many others

ALVAR Tracking

A Library for Virtual and Augmented Reality§ Computer vision based camera tracking for AR

ALVAR Desktop§ Windows / Linux – marker based – Open Sourced§ Users incl. Google, NASA, MIT, Vuzix, ROS etc.

ALVAR Mobile§ Marker, multimarker, 2D image and 3D point cloud tracking§ Generality, works from close range to wide areas§ ALVAR for Unity, enabling easy content authoring§ Point Cloud Tool for optimizing performance§ HoloLens and ARCore extensions§ Platforms: iOS, Android, UWP, Windows, Mac

Summary

Some VTT’s applications§ Augmented print media§ Historical buildings§ Historical photos§ Historical people§ Augmented photos, artwork

Implementation, alternatives§ Augmented vs. Mixed Reality – whatever works best§ Tracking – marker / image / point could based / geo located§ Content creation – text, pictures, 3D, animated, open data, crowd sourced§ Display devices – mobile phone, data glasses, large screen§ Interaction, gamification – visualization alone is not enough

New applications, themes e.g.§ AR games (c.f. Pokemon Go)§ AR guidance, information§ Social media, comments and memories§ Finnish Brands (e.g. Santa Calus, Kalevala, …)§ Etc.

Thank you!

Dr. Charles Woodward, VTT

charles.woodward@vtt.fihttp://www.vtt.fi/multimedia

www.youtube.com/user/VTTAugmentedRealitywww.youtube.com/user/VirtualAndAugmented/videos