google's project tango seminar ppt

AAMIR HILAL

Seminar by

Google is an American multinational technology company specializing in Internet-related services and products. These include online advertising technologies, search,

cloud computing, and software.Google also have many some research and development sub-companies like Google

ATAP and Google X. These companies work on developing future techs.

What is Project Tango?

Project Tango is a smartphone and tablet project by Google's Advanced Technology and Projects group (ATAP), formerly a division of Motorola. The "Project Tango" prototype is an Android smartphone-like device which tracks the 3D motion of the device, and creates a 3D model of the environment around it without using GPS or other external signals.

Project Tango strives to give mobile devices a human-like understanding of space and motion through advanced sensors and computer vision.

Google unveiled Project Tango, an experimental project from the company’s Advanced Technology and Projects (ATAP)

group.

• Project Tango was introduced by Google initially in early 2013, they described this as a Simultaneous Localization and Mapping (SLAM) system capable of

operating in real-time on a phone. Google’s ATAP teamed up with a number of organizations to create Project Tango from this description.

Project Tango was developed by a team led by computer scientist Johnny Lee, a core

contributor to Microsoft's Kinect.

INTRODUCTION

A device which tracks the 3D motion of the device, and creates a 3D model of the environment around it.

First device launched in 2014, but only for developers.

A mobile device that shares our sense of space and movement, that understands and perceives the world the same way we do.

Why Project Tango?

What if you could capture the dimensions of your home simply by walking around with your

smartphone before you went furniture shopping? What if you never again found yourself lost in a

new building? What if you could search for a product and see where the exact shelf is located

in a store?

To help emergency response workers such as firefighters find their way through buildings by

projecting the blueprints onto the screen.

WHAT DOES THE PHONE LOOK LIKE?

Hardware

Front View

Back View

External Hardware

Internal Hardware

Snapdragon 800 quad core (up to 2.3 GHz per core) CPU with 2 GB LPDDR3 RAM Movidius Two Movidius Myriad

1 computer vision co-processors.

Two AMIC A25L016 16 Mbit low voltage serial flash memory ICs

9-axis

gyroscope/accelerometer/com

pass MEMS motion tracking device

multiband power amplifier module

PrimeSense PSX1200 Capri PS1200 3D sensor SoC

Camera and sensors in Tango phone

Front 4MP CAMERAand Rear RGB-IR Camera

Fisheye Camera

IR Projector

IR PROJECTOR : The IR projector projects a pattern of IR light which falls on objects around it like a sea of dots. We can't

see the dots because the light is projected in the Infra-Red color range

RGB-IR CAMERA : Red Green Blue -Infrared Camera

RGB-IR camera single sensor that captures high-resolution images and video as well as IR information, enabling depth analysis.

FISHEYE CAMERA : The fisheye lens enables a 180º FOV used to track objects, while the sensor balances resolution

and frames per second to record black and white images for motion tracking.

Working Concept

• Project Tango devices combine the camera, gyroscope and accelerometer to estimate six degrees of freedom motion tracking,

providing developers the ability to track 3D motion of a device while simultaneously

creating a map of the environment.

• The phone emits pulses of infrared light from the IR projector and records how it is

reflected back allowing it to build a detailed depth map of the surrounding space.

Myriad 1 vision processor platform.

The sensors allow the device to make "over a quarter million 3D measurements every second, updating its position and orientation in real time, combining that data into a single 3D model of the space around you.“

Myriad 1 low-power computer-vision processor, process thedata and feed it to apps through a set of APIs.

TANGO’S PROCESSOR

Project Tango Concepts

Motion Tracking

Area Learning

Depth Perception

Motion Tracking

Project Tango’s core functionality is measuring movement through space and understanding the area moved through.

Google API’s provide the position and orientation of the user’s device in full six degrees of freedom.

Area Learning

Using area learning, Project Tango device can remember the visual features of the area it is moving through and recognize when it sees those features again. These features can be saved in an Area Description File.

Project Tango devices can use visual cues to help recognize the world around them. They can self-correct errors in motion tracking and relocalize in areas they've seen before

Depth Perception

Project Tango devices are equipped with integrated 3D sensors that measure the distance

from a device to objects in the real world.

Because the technology relies on viewing infrared light using the device's camera, there are some situations where accurate depth perception is

difficult. Areas lit with light sources high in IR like sunlight or incandescent bulbs, or objects that do

not reflect IR light cannot be scanned well.

By combining depth perception with motion tracking, you can also measure distances between

points in an area that aren't in the same frame.

Things Project Tango can do .

DIRECTIONSWhen you need directions inside a building or structure that current mapping solutions just don’t provide.

Indoor Mapping and NavigationIt tracks position all around the world and also make a 3D map of that

Game DevelopmentIt could combine the room-mapping with augmented reality. “Imagine competing against a friend for control over territories in your own home with your own miniature army.

The Future

• Google Tango With NASAATAP over at Google announced that they will be partnering with NASA

to build autonomous robots. Using the technology developed for Project Tango, the Spheres robot will be able to do tasks the astronaut

previously had to do themselves.

• Google GlassDevelopers are proposing to connect technology in project

tango with google glass.

Companies Working With Google

Thank You!