Mobile Outdoor Gaze-Based

GeoHCI

Ioannis Giannopoulos, Peter Kiefer, Martin Raubal

27 April 2013

GeoHCI Workshop, Paris

2

GIScience & Cognitive Engineering

The 3 Spatial Components

3

‘Spatial for HCI’

• Geographic Information Science

– systematic study of all aspects regarding

geographic information

– foundation for development of geospatial tools

& services that support people in their spatio-

temporal decision-making

• Useful & useable solutions => principles

of human spatial cognition regarding

representation & processing of spatial and

temporal aspects of phenomena

4

BR

IDG

E T

HE

GA

P

5

Gulf of evaluation

Goals, intentions, concepts, spatial and

cognitive abilities

Gulf of execution

Physical system variables

6

Cognitive engineering

• Donald Norman: integrate cognitive &

computer science approaches to the

design and construction of machines.

• ‘a type of applied cognitive science’

• People’s interactions with everyday

things (telephones, faucets, doors)

=> discrepancy between

psychological user variables &

physical system variables.

7

Spatial cognitive engineering

• Human-computer interaction regarding

spatial & temporal aspects of phenomena

in the world.

• Spatio-temporal reasoning is complex.

• People’s queries when using geospatial

tools have a spatio-temporal context =>

geographic relevance [Raper]

• Goes beyond user-interface level!

8

Mobility

© Rüdiger Wölk

9

Mobile Location Based Services

• Deliver information to user based on her

current location.

• Navigation and information

services

• Emergency services

• Field applications

• Geoservices for

mobile phones, PDA,

etc.

10

WikEar – educational audio tour

by Johannes Schöning

11

Spatio-temporal constraints

Multiple spaces,

types of times,

cognitive & social

processes, …

[Raubal & Panov 2009; Richter, Dara-Abrams, & Raubal 2010]

12

GIScience & Cognitive Engineering

The 3 Spatial Components

13

Eye Tracking

Gaze Recording

– «Where has a person looked at?»

– Assumption: gaze implies perception.

– Fixations and saccades.

Mobile Eye Tracker Remote Eye Tracker

© S

ensom

oto

ric I

nstr

um

ents

(C)

Erg

oneers

Reading Research

Wik

imedia

: P

ublic

Dom

ain

14

Wayfinding Assistance

Gaze-based wayfinding assistant location-aware mobile gaze-based interaction

w.r.t. three spatial components.

15

The 3 spatial components

• The space the user interacts in (i.e., the

position of the user).

• The spatial information the user interacts

with (e.g., the information on the map).

• The space the user interacts with (i.e., the

objects in the environment gazed at).

16

The spatial information the user

interacts with

17

Gaze Map Matching

Interpretation with respect to vector features.

18

GeoGazemarks

• Interactive concept to

represent the view

(usage) history on

mobile maps.

• Fixations are clustered

geospatially, and

visualized when the

user zooms out.

• Visual clue to facilitate

orientation.

19

The space the user interacts

with

20

The objects in the environment

gazed at

21

The objects in the environment

gazed at

automate the analyses for recorded eye

tracking data.

interaction with the real environment.

Object of regard

identification through

eye, location and head

tracking.

22

Augmented Reality Glasses

• Example: Google

Project Glass

http

://com

mons.w

ikim

edia

.org

/wik

i/File

:Google

_G

lass_deta

il.jpg

GN

U F

ree

Do

cu

menta

tion L

icense, V

ers

ion 1

.2, A

uth

or: A

nto

nio

Zu

gald

ia

(C) Google, http://www.youtube.com/watch?v=9c6W4CCU9M4

http://www.techradar.com/news/portable-devices/google-patents-eye-

tracking-for-google-glass-1091428

23

Mobile Eye Tracking Lab

For video demos of our research, search for gis@ethz http://www.youtube.com/user/ETHzurichGIS

Thank you for your attention!