Augmented reality and mobile learning: the state of the art

Borys Pratsiuk, Ph.D.Senior Android Consultant

Ciklum Interactive Technology

Our story today• Introduction• What is augmented reality• How to start?• Technical challenge, skills. • Code for Android developers • AR near future• Demo

What is augmented reality (AR)?

• Goal of AR is to add information and meaning to a real object or place

• Enables learners to “explore” the physical world without assuming any prior knowledge

• Superimpose “information overlays” or layers, onto the world around you, using a handheld device

• Add audio commentary, location data, historical context or other forms of content that can make a user’s experience of a thing or a place more meaningful

Current uses of AR

• Sports coverage• Retail/marketing• Networking (‘Augmented ID’) or find someone in a crowd• Aviation (‘head-up displays’ on windscreen of plane)• Training or task support• Navigation • Sightseeing e.g. outdoor venues; museums and art galleries

Future of AR

• Google glass

• Holo leans

• Oculus Rift

• Mobile apps

• Car navigation

• Wearable IoT

• TV with 3D extensions

Defining technology-enhanced realities: virtual, mixed and augmented

• Fusion of digital information in real world settings• 3 essential properties:

– real and virtual objects in real environment– a system that aligns these objects– that runs interactively in real time

• Not just graphical media: can also be textual, audio, video, haptic• Context is key; also explicit intentionality of media

QR code scaner

• SDK:• https://github.com/zxing/zxing• https://github.com/ZBar/ZBar• Install client: https://play.google.com/store/apps/details?

id=com.google.zxing.client.android

Existing SDK for object draw

• Vuforia - now 2015 www.qualcomm.com/products/vuforia• Metaio - now 2015 www.metaio.com/index.html• NyARToolkit - now 2015 https://github.com/nyatla/NyARToolkit• ARLab - 2012 ($) www.arlab.com/• DroidAR - 14 Dec 2013 https://github.com/bitstars/droidar• AndAR - 29 Nov 2010 https://code.google.com/p/andar/

Skills

• Location (GPS)• Sensors• Image processing (OpenCV)• openGL + 3D modeling• NFC, Bluetooth

AndAR viewer

• Camera capturing (android.hardware.Camera)• Draw openGL android.opengl.GLSurfaceView;)• Create openGL model in Blender https://www.blender.org/support/

tutorials/• Model parser http://www.opengl-tutorial.org/beginners-tutorials/

tutorial-7-model-loading/• AndAR library build (NDK)

Source code of AndARModelViewer

https://github.com/bosicc/AndARModelViewer

Let’s try

Questions

Contacts