diploma thesis inaugural lecture: sensor-driven indoor-localization/-navigation

32
Stephan Linzner & Daniel Kersting Diploma Thesis Inaugural Lecture

Upload: android-thesis

Post on 10-Apr-2015

1.704 views

Category:

Documents


0 download

DESCRIPTION

Diploma Thesis Inaugural Lecture: Sensor-Driven Indoorlocalization and Indoornavigation

TRANSCRIPT

Page 1: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Stephan Linzner & Daniel Kersting

Diploma Thesis Inaugural Lecture

Page 2: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Who we are

Stephan Linzner

Student, fifth year

major in computer

science at University

Tübingen

[email protected]

http://twitter.com/onlythoughtwork

Daniel Kersting

Student, fifth year

major in computer

science at University

Tübingen

[email protected]

http://twitter.com/drewenut

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 2

Page 3: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Lost Indoors

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 3

Page 4: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Lost Indoors…

Shopping center Product search

CBR (Consumer Based Routing)

IBR (Interest Based Routing)

Museums Family quiz, navitainment

Fairs i.e. CEBIT

Car park, airport, subway, concert hall, sewerages

Emergency evacuation and guidance service Fire, earthquake, terror attacks

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 4

Page 5: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Motivation

Common outdoor navigation systems

are freely available today.

GPS is based on satellite networks and

can therefore only be used outdoors.

Today there is no ubiquitous localization

and navigation system for confined

spaces.

20 million sensor powered handsets

sold in 2008.

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 5

Page 6: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Key questions

What are use cases to be handled?

How to create a data model of confined spaces?

Which (sensor) data is required?

Where could that data come from?

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 6

Page 7: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Objectives of our work (1)

Evaluate methods and practices to realize a real-time sensor-driven indoor positioning system (SD-IPS) for mobile handsets.

Develop innovative approaches for mapping the most common characteristics of outdoor navigation systems to indoor application scenarios and expand them by dedicated confined spaces requirements.

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 7

Page 8: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Objectives of our work (2)

Create an Android based application framework to easily build sensor-driven indoor positioning applications. Rely as much as possible on standard handset

hardware and not heavily depend on environment infrastructure.

Keep a lightweight design approach for concepts and the resulting framework.

Deliver augmented reality end user experience to make peoples indoor lifeseasier.

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 8

Page 9: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Framework objectives

Lightweight design

Portable (iPhone, Symbian OS, RIM)

Blackboxed

Focused on data providing

Data representation

SD-IPS API

Not a GUI framework

No data visualization

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 9

Page 10: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Initial schedule

June 2009 – dig through sources Android

Kernel

Drivers

Libraries (Zxing)

July/August 2009 – try and research Test and evaluate the sensors

Localization by 2D codes

Explore possibilities (WLAN, Bluetooth…)

Build the first prototypes

September/October 2009 – implement framework

November 2009 – elaboration

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 10

Page 11: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

What is Android?

Mobile operating system

Linux kernel version 2.6.x

Middleware

Application framework

11Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS

Page 12: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Why Android?

Open

All applications are created equal

Breaking down application boundaries

Fast & easy application development

12Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS

Page 13: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

13Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS

Page 14: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

14Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS

Page 15: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Rooted Android Developer Handset

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 15

Page 16: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Android Developer Handset Sensors

Accelerometer

Gyroscope

Compass (Magnetic Field)

Camera (Imaging, scanning 2D-Barcodes)

GPS

Radio Network

WLAN

Bluetooth

Audio (Microphone)

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 16

Page 17: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Inertial Navigation Set (IRBM S3)

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 17

Page 18: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

6-axis electronic compass (G1)

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 18

Asahi Kasei Microsystems

(AKM) AK8976A

Page 19: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Technologies vs. Techniques (1)

Ambient technologies

WLAN

○ Trilateration

○ Time of arrival (ToA)

○ Received signal strength (RSSI)

Bluetooth

○ Received signal strength (RSSI)

Audio

○ Echo

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 19

Page 20: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Technologies vs. Techniques (2)

Optical technologies Camera

○ Visual detection

○ Augmented reality

○ 2D Barcodes Data Matrix

QR-Codes

Microelectromechanical technologies Sensors

○ Accelerometer

○ Gyroscope

○ Magnetic Field

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 20

Page 21: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Localization/Positioning Techniques

No infrastructure No additional hardware needed

Infrastructure Based Environmental hardware needed

Marker based localization Fixed synchronization points

Inertial navigation

Dead reckoning

Continuous localization Real-time position tracking

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 21

Page 22: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Localization/Positioning

Techniques (2)

Infrastructure No Infrastructure

Marker based • Wlan

• Bluetooth

• Audio

• Camera

Continuous • Wlan

• Bluetooth

• Audio

• Bluetooth

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 22

Page 23: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Navigation Techniques

Inertial Navigation

Accelerometer

Gyroscope

Compass (Magnetic field)

Dead reckoning (DR)

Process of estimating one's current position

based upon a previously determined position

Estimate position by speeds over elapsed time

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 23

Page 24: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Accelerometer/* x<0 x>0

* ^

* |

* +-----------+--> y>0

* | |

* | |

* | |

* | | / z<0

* | | /

* | | /

* O-----------+/

* |[] [ ] []/

* +----------/+ y<0

* /

* /

* |/ z>0 (toward the sky)

*

* O: Origin (x=0,y=0,z=0)

*/

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 24

Page 25: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Gyroscope Z-Rotation

25Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS

Page 26: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Gyroscope X-Rotation

26Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS

Page 27: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Gyroscope Y-Rotation

27Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS

Page 28: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Responsibilities

Localization

Framework design

Domain modeling

Reusability

Navigation

Framework design

Platform independency

Portability

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 28

Stephan Linzner Daniel Kersting

Page 29: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Summary

Comprehensive exploration of the Android operating system and the SDK.

Requires solid Java and C knowledge

Identify indoor localization and navigation key concepts.

Implement the most promising solution, which delivers the best trade of between accuracy, efficiency and usability, for the desired scenarios in a conceptual framework.

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 29

Page 30: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Future Prospects (1)

Visualization framework

Augmented reality framework

Wikitude:

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 30

Page 31: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Future Prospects (2)

Routing algorithms

Consumer based routing (CBR)

Interest based routing (IBR)

Proximity based applications

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 31

Page 32: Diploma Thesis Inaugural Lecture: Sensor-Driven Indoor-localization/-navigation

Follow our diploma thesis

http://twitter.com/androidthesis

http://friendfeed.com/androidthesis

http://www.youtube.com/user/androidthesis

http://www.scribd.com/androidthesis

[email protected]

Diploma thesis: Sensor-driven indoor-localisation/-navigation with Android OS 32