integrated ubiquitous computing - designing urban space with digital media - florian resatsch and...

Integrated Ubiquitous Computing – Designing Urban Space with Digital MediaFlorian Resatsch & Daniel Michelis May, 8th 2006Uni Debrecen – Hungary

/ 2Florian Resatsch/Daniel Michelis

Agenda

1. Introduction

2. Ubiquitous Computing

3. Design Integration

4. Designing Ubiquitous Computing Applications –

IEB Experiments and Learnings

4.1 High D (Interface)

4.2 Hypertagging (Human-Computer

Interaction)

4.3 Bluespot (Infrastructure)

4.4 Magical Mirrors (Participation)

5. Integrated Ubiquitous Computing in Public Space

Institute of Electronic Business – I

The Institute of Electronic

Business (IEB) is an

affiliated institute of the

University of Arts, Berlin

Consultancy and research in the area of electronic business, communications and design

Network to connect scientists and practitioners

Institute of Electronic Business – II

Main Research AreasDigital Communication

e-Government

Ubiquitous Computing

Performance Marketing

Human Computer Interface

Key Facts

Employees: 25

Number of students: 160

Public-Private-Partnership

Director: Prof. Dr. Dr. Thomas Schildhauer

Agenda

1. Introduction

Interaction)

Ubiquitous Computing (UbiCom)

Definitions Ubiquitous Computing

“The most profound technologies are those that

disappear. They weave themselves into the fabric of

everyday life until they are indistinguishable from

it” (Weiser, M., 1991)

Ubiquitous Computing is

(1)numerous, casually accessible, often invisible

computing devices,

(2)frequently mobile or imbedded in the environment

(3)connected to an increasingly ubiquitous network

structure. (Source: National Institute for Standards and Technology, www.nist.gov/pc2001)

Development Stages

Mainframe-Era:one Computer,many Users

PC-Era:one Computer,

one User

Ubiquitous-Computingmany Computers,

one User

01001 01001

010010100101001

UbiCom: Ubiquitous Connectivity

Mainframe-Era:Beginning connections

PC-Era:Internet

Ubiquitous-ComputingWeb of Objects

01001 01001

010010100101001

Technological Advancements Enable UbiCom

2001 2005 1998 2002

Five year market forecast for numbersof MEMS chips produced for microelectronics(Source: MEMS Industry Group)

Five year trend:Number of stories in the New York times including the word „Sensor“(Source: Lexis-Nexis)

(Source: McCullough, M, 2004)

Extending Connection

Ubiquitous-ComputingDigital augemented physical objects and

new ways of interaction

01001 01001

010010100101001

Internet (Virtual World)Real World

Information

Open Questions On UbiCom

What can we expect in terms of interaction,

information, data security, privacy?

What are successful applications in UbiCom scenarios?

(Source: Alois Ferscha, Uni Linz)

The IEB UbiCom Initiative

Cooperation of Universities and Industry

Management

Communication Technology

Why We Should Look At UbiCom?

• There is a paradigm shift from cyberspace to

pervasive or ubiquitous computing

• Digital technology pours out of the screen

into our daily life under the laws of physics

• The everywhere and ubiquitous approach will

be part of everyone‘s life

• To avoid scenarios as shown in „Minority

Report“ it is important to shape this vision

• Ubiquitous Computing is already here

Excursus: UbiCom Has Many Faces

Everyday life support via invisible data

gathering: Weather data with mobile phone

networks.

(Source: Tel Aviv University)

Excursus: UbiCom Has Many Faces

Using Near Field Communication and RFID to

support daily processes.

(Source: NTT DoCoMo)

Theoretical Overview of Intersecting Domains

Extending the science of human-computer

interface and programming into a culture of

situated interaction design:

(Source: M.McCullough, 2004)

UbiquitousComputing

Environmentalknowing

DesignValue &

Integration

InterfaceDesign

GeoWares

Types &Patterns

Basic Principlesof UbiCom

Content,

Infrastructure

and Interface

• Content needs to be prepared, processed,

stored and channelled to the user via an

appropriate medium. • The millions of single transactions and

interactions between microchips and human

actions determine the infrastructure.• The human-computer interface is the

contact point between man and machine and

the single point of contact in Ubiquitous

Computing scenarios.

„To anyone with too much gear and too little time, the mere

availability of technical capabilites [and functions]

hardly guarantees utilization“ (Clement Mok, Designer)

(Source: M.McCullough, 2004 and John Dewey)

Basic Principlesof UbiCom

Context,

Participation

and Value

• Whether features are understood depends

on the context in which they are

encountered.• Well-being requires a better state of

human activity. Much of our sense of

environment emerges from participation.• Value emerges from interactions and

(ex)change. Things have no value in

itself – they only have value for

someone.

„To anyone with too much gear and too little time, the mere

availability of technical capabilites [and functions]

hardly guarantees utilization“ (Clement Mok, Designer)

(Source: M.McCullough, 2004 and John Dewey)

The question is …

Interface

Content

Context

Infrastructure

What are the success factors on …

Participation

How Can We Solve The Open Issues? Example: Interface

New ways of interaction are needed to create

context-sensitive, participatory interfaces

that create value

Foreground

Background

Virtual Physical

Graphical UserInterface

HapticInterface

InhabitableInterface

(smart space)

Ambientinterface

(Source: McCullough, M, 2004)

Infrastructure Levels of UbiCom

RFID Physical World

Network Process Center

Interfaces

Applications

Middleware

OS, Network

Hardware (PDA, Handy)

Processes Vertrags-abschluß

Trans-ponder-Einbau

KFZOrtung

on demand

Finder-prozess

KFZ-Rück-

führung

Transponder

Aktivierung

Deaktivierung

0 1 2 3 4 5 6

Billing

Transponder

Vertrags-Daten

Management

Design

Partners

Agenda

1. Introduction

Interaction)

Developing Products In Two Worlds

Quelle: Beat Schmid

Implementation

World IFunctions in materials

World IISymbols in Hearts and

Integrative Design

Quelle: Beat Schmid

Technology Perception

Business

Examples: Failures and Successes of Design-Integration

Quelle: Beat Schmid

SuccessFailures

Increasing Importance of Implementation II

Implementation I

Implementation IIrequired time

Quelle: Beat Schmid

Agenda

1. Introduction

Interaction)

Agenda

1. Introduction

Interaction)

Implementation II – Reducing Complexity or „Ways Beyond Graphical Interfaces“

The starting point is to optimize the learned

way of interaction of GUIs and work into the

Inhabitable Smart Spaces

Foreground

Background

Virtual Physical

HapticInterface

(smart space)

Ambientinterface

Implementation II – Reducing Complexity or „Ways Beyond Graphical Interfaces““

The starting point is to optimize the learned

way of interaction of GUIs and work into the

Inhabitable Smart Spaces

Foreground

Background

Virtual Physical

HapticInterface

(smart space)

Ambientinterface

1. Optimization of the GUI

Implementation II – Reducing the Complexity

(Source: Avero, Berlin, www.avero.de)

Visualization ofmultidimensionaldata

before

Complexity Reduction Through Abstraction

Implementation II – Complexity Reduction

handy-tool

handy-tool Select Direction [5]

handy-tool Select Starting Time [>]

handy-tool Calculate Driving Time [3/7]

handy-tool Legend [*]

Agenda

1. Introduction

Interaction)

Implementation II – Reducing Complexity or „Ways Beyond Graphical Interfaces“

The next step was the trial of interfaces

beyond the screen itself into the smart

space.

Foreground

Background

Virtual Physical

HapticInterface

(smart space)

Ambientinterface

2. Extending the interfacebeyond the screen

Explorative research projecthypertagging

Installation DATACARRIER

• Installation in the German Historical Museum Berlin

• Traditional roles where exchanged, participants became DATACARRIERs

• RFID-tags embedded in personal invitations

• Participants become passive data carriers, that revealed their personal data unknowingly

We tagged the event tickets...

... to personalize executives, ...

...scanned their personal data,

displayed it on public screens,

... and observed the audience.

Installation FLOATING THOUGHTS

• Prototype at the International Symposium of Electronic Arts 2004

• Hypertags used as medium of communication

• Personal information could be stored and transmitted

• Data was physically attached to the vessel

• Goall: Explore usage patterns and “data drift”

Data was linked to RFID and...

... attached to physical objects.

Users could share thoughts and...

... locate them on the vessel.

What we expected...

What we expected ....

...and what we found.

... and what we found.

Agenda

1. Introduction

Interaction)

bluespot – The Future Advertising and Shopping Mile

The „Future Advertising and Shopping Mile“

is a research project on the integration

of various (digital) media in highly

frequented shopping areas in public

space.

Prototype went live on April, 26th 2006 in

Berlin, Germany in the area of the

„Kurfürstendamm“.

The idea: Ubiquitous availability of

services in public space!

The Area of the Prototype

Research Area

WittenbergplatzWittenbergplatz

George-Grosz-PlatzGeorge-Grosz-Platz

How Many People Are in The Areal?

People on a Regular Saturday

Samstag 11.00h bis 13.00h

1999 2000 2001 2002 2003

Kurfürstendamm Tauentzienstrasse

Average amount9285 Personen

The Company Wall AG as the Intermediate

Available Street Furniture

Bus Stop Shelters

Kiosk Systems

City Info Panel

City Light Board

Aut. Public Toilet

Information Terminal

e-Info Terminals

Screen rounded

Indoor Cases

Some Examples

^4. bluespot

Process of the Project

Description of Different Projects Phases

1. Analysis1. Analysis 3. Recommendation for Future Activities

3. Recommendation for Future Activities

Results of the Analysis:

• Definition Target Groups

• Potentials of Different Media Categories

Results of the Analysis:

• Definition Target Groups

• Potentials of Different Media Categories

Description of the Conception:

• Concept of a Possible Infrastructure

• Based on a Portal System

Description of the Conception:

• Concept of a Possible Infrastructure

• Based on a Portal System

Precise Suggestions for Future Activities

• Build a Prototyp of the Portal System Including all Wall Key Accounts

Precise Suggestions for Future Activities

• Build a Prototyp of the Portal System Including all Wall Key Accounts

2. Conception2. Conception

4. The Prototype (Pilotphase)

The Combination of Advertising and Shopping

AdvertisingClients

Local Advertising Clients

Canalize Marketing Messages

Target Group:SHOPPER

Target Group:CONSUMER

Target Group:TOURIST

Mobile Devices e-Info Terminals Posters

Feedback Channel

Integration of the Media on Three Levels

Future ShoppingFuture Advertising

PORTAL

The Portal

Requirements

The Portal is Used by Different Groups with

Different Needs

Advertising Clients Passers-by Wall Employees

Functionalities• Log-In/Log-Out• Advertising Booking

Centre• Statistics

Functionalities• Mobile Couponing• Location-Based

Information• Maps of the City • WLAN

Functionalities• Content Administration• Advertising Clients

Administration• Statistics

Portal und Services

GUI Online GUI Online GUI Mobil GUI Terminal GUI Online

Parts of the Concept: The Integration of City Light Posters Into the Scenario

Bluetooth Poster

Bluetooth Sender

CustomerProfiles

GUI Personal Identity

Assistant

User Profile Agent

ServiceAgents

for ContentSyndication

andDistribution

Browsing

Technical Concept/Infrastructure

Content Integration System

PORTAL

Content BUS

InhalteWerbekunden

InhaltePassantenDatenbank

Profile

Inhaltevon

WALL AGe-Info Terminal

oder Mobile Endgeräte

Advertising Portal

Transfer of data

Wall AG

TOURIST

AdvertisingClients

CONSUMER

SHOPPER

TOURISTCONSUMER

SHOPPER

TOURISTCONSUMER

Datavisuals

GSM, UMTSWLAN

TCP/IPTrans-missionLayer

Content Producer

The real thing…

The following

services were

distributed:• Free Wireless

Lan• Free Internet

Access• Free Telephone• Savings in a

Couponing

System• Cityinformation• New products in area

bluespot: WLAN Hotspots Locations

The First Shot:Bluespot Live

Reality: Passenger Survey

Which services of bluespot are you familiar with?

0 5 10 15 20 25 30 35

Stadtinformationen

Aktions-/Sparcoupons

Telefonie

Internetzugang amTerminal

W-LAN Zugang

% der Angaben

Shopping T

staltu

ngsüber

trotip

NightL

ife In

Kinopr

Hotel-I

swürd

iten (K

ultur&

Stadtp

Hinwei

uf öffe

he Toile

Reality: Passenger Survey

What kind of city information do you need in

public space?

Very Interesting

Interesting

No answer..

Not Interested in

Passenger Survey

Why did you just use the terminal?

staltu

Gastro

NightL

ife In

Kinopr

Hotel-

Kultur

Telefo

Digita

le Sta

Main reason:

Curiosity!

Learnings from bluespot

Infrastructure and Interface Success ComponentsThe access component (“can”): This factor assumes that there

is a required infrastructure - ranging from streets to

mobile phone networks - that must be available and the

corresponding devices to use the infrastructure.

The attention component (“know”): In addition, availability

alone is not sufficient to trigger the use of a service in

a public space, potential users must know about the

availability of the service and be informed where and how

to use it.

The willingness component (“want”): Finally, the potential

user must decide whether they are interested and willing

to use the service in the proposed way, another way or not

at all. The willingness component highlights the

importance of the contextual factors as discussed above.

To want something also includes that the services are to

be adapted to the relevant target group in terms of the

corresponding needs.

Shot #2

Agenda

1. Introduction

Interaction)

6. Outlook

Implementation II – Remediation

"The content of any medium is always another medium.

The content of writing is speech,

just as the written word is the content of print, a

nd print is the content of the telegraph“ (McLuhan)

Remediation • Jay David Bolter/Richard Grusin • New medium is always the representation of older medium

• transparent remediation – „The digital medium wants to erase itself,

so that the viewer stands in the same relationship to the content as

she would if she were confronting the original medium." • translucent remediation – visible difference between the new and the

old medium through enhanced funcitions • refashioning remediation – New technologies refashion the older

medium completly, while the origin of the older medium remains

visible • absorbing remediation – the older medium is completly absorbed by

newer medium

Quelle: Bolter/Grusin

Applied Remediation: SAP Media Facade

Agenda

1. Introduction

Interaction)

The answer is …

Interface

Content

Context

Infrastructure

Participation

CombiningApplication

a serious combination of the factors..

What answers do we have???

The success factors … on only a few aspects.More research needs to be done.

- Face recognition as Interface/Participationdevice?

- Infrastrucural process centers?- Business Cases?

Every great advance in science has issued from a new audacity of imagination. John Dewey

KontaktFlorian Resatschresatsch@ieb.net

Daniel Michelis michelis@ieb.net

integrated ubiquitous computing - designing urban space with digital media - florian resatsch and...

ubiquitous computing3

urban space

high d interface

bluespot infrastructure

magical mirrors participation5

uni debrecen hungary

design integration4

Economy & Finance

florian rodler

michelis - estetica arhitecturii

abang.com - florian

florian spdm1

de michelis

florian resatsch servtag company presentation

nicola de michelis

nicola de michelis...nicola de michelis coronavirus: l’ue...

nfc and consumers - success factors and limitations in...

jennifer michelis fit challenge creators!. obesityanorexia...

präsentation marketin2 für herrn daniel michelis von julia...

florian boer

vicenzo de michelis op.25

filip florian matei florian -...

florian - florian klein - der profi zauberer aus der schweiz

gheorghe florian

florian resatsch - interaktion in der zukunft - rfid...

new interaction models for digital signage - florian...

vanguardias michelis

community applications for near field communication -...