SEMpIA From Mplayer Ubiquitous Games towards distributed systems for

U-cities

Professor E. Gressier-SoudanCNAM, Paris, France

CEDRIC Lab, Team SEMpIA

20/07/2010 2

SEMpIA

Who Am I ? (Research)� Head ofEmbedded and Mobile Systems for

Ambiant Intelligence (SEMpIA ) research team atCEDRIC since 2008� Ubiquitous architectures for ubiquitous Mgames,

� Involved in Interactive Applications related to Musée des Arts et Métiers (MAM) Paris

� Head of thePLUG (PLay Ubiquitous Games andplay more) project, founded by the French National Research Agency ended march 2010 -410K€/3labs/3companies

20/07/2010 3

SEMpIA

Research profile of the team

� Project driven research (found rising required)

� Application awareness

� Partnership based research

20/07/2010 4

SEMpIA

Roadmap of the presentation

� Mixed Reality Games Projects,

� Towards U-cities

� Conclusion

SEMpIA

SoundPark:Towards Highly Collaborative GameSupport in a Ubiquitous Computing

ArchitectureR. Pellerin1, N. Bouillot2, T. Pietkiewicz1, M. Wozniewski2,

Z. Settel3, E. Gressier-Soudan1, J. R. Cooperstock2

1CNAM-CEDRIC-SEMpIA, 2McGILL-CIM-SRH,3University of Montréal

DAIS'2009, June 2009, Lisbon, Portugal

20/07/2010 6

SEMpIA

SoundPark: a mixed realityubiquitous game, audio based

� The goal : � A team collects sounds spread in the Jane Mance park in Montreal� The winner is the first team who gathers the complete assembling� Have fun (researchers had fun !)

� Two types of players :� Scouts are clue discoverers, Clues provide hints to get piece of sounds� Hunters are sound catchers, guided by scout’ indications, they bring

sounds back to their home base

� They play in a real world and evolve in a 3D audio virtual world

� Public is able to watch the game session as a 3D world on a PC

20/07/2010 7

SEMpIA

Players’ devicesAudio 3D from virtual world (music from instruments)

hints

BlueTooth WIFI

more hintsthe panini

the panini

HUNTER(blind in the virtual world)

SCOUT

20/07/2010 8

SEMpIA

Scout

BlueTooth

Mobile phone reads RFID clues

Nokia 6131NFC

20/07/2010 9

SEMpIA

Video available from :

http://www.audioscape.org/srewiki/bin/view/Audioscape/SoundPark

20/07/2010 10

SEMpIA

Soft/Hard Architecture

Game logicInherit from OMA-Gaming

Services specificationSound Processing

Samearchitecture used in thePLUG project

20/07/2010 11

SEMpIA

uGASP Server :Service/Component Architecture

oriented

� uGASP server is SCA compliant : OSGi based, thatmeans it is implemented as a set of components

� OSGi bundles can bedynamically loaded using

Injected Plain Old Java Objectbrings

20/07/2010 12

SEMpIA

uGASP components

20/07/2010 13

SEMpIA

SoundPark projectConclusion

� SoundPark has been issued in three months� Resources : 10,5 man.month full time

� SoundPark is a proof of concept of :� what an ubiquitous computing architecture can be right now

using off-the-shelf components

� what a mixed reality ubiquitous game can be today

� Challenge : be a real game with hundreds of players

SEMpIA

PLUG PLay Ubiquitous Games

and play more(A government founded project by Agence

Nationale de la Recherche)

20/07/2010 15

SEMpIA

Musée des Arts et Métiers:History and Thematic Collections

Construction Scientific instrumentationMechanics

Communication Transport Energy

20/07/2010 16

SEMpIA

The Musée des Arts et Métiers� Mission:

� teach the history of science and innovations (edu team)

� promote science as a whole

� create a community of people around a scientific heritage

� Patrimony:� Historical artifacts that visitors can’t manipulate

20/07/2010 17

SEMpIA

Goals of PLUG

� To experiment ubiquitous games and theirarchitecture

� To define new ways to interact with museumsand their content

� To study acceptance of ubiquitous games and associated technology

27 months, R&D project, started January 2008

SEMpIA

PLUG the Secret of the Museum "RFID technology:

fostering human interactions"

IADIS’2009, June 2009, Carvoeiro, Portugal

Annie Gentes, Camille Jutant, Aude Guyot, Michel Simatic

20/07/2010 19

SEMpIA

ApplicationGame design

ContentMuseum

TechnologyRFID (IoT, WSN)

UsersVisitors / Players/Citizens

Pervasive Computing applied to MAM

20/07/2010 20

SEMpIA

PLUG: Reconsidering RFID

Challenge�To augment reality: add contents, create new links

between places, people, artifacts

�To foster new forms of interactions between people

To invent a new technical architecture

20/07/2010 21

SEMpIA

Goals of the Game

Research contribution (experimentedsummer 2007 by SEMpIA)

20/07/2010 22

SEMpIA

Some kind of geo-localized information system

20/07/2010 23

SEMpIA

A fully ubiquitous Architecture…

Nokia 6131NFC

RFID powering & read/write

2.5G/3G+ mobile communications

+

Internet

20/07/2010 24

SEMpIA

Conclusion

and visitors enjoyed…

Ubiquitous passive RFID based architecture

+ NFC enabled devices

+ game strategy

+ specific context

Revealing and fostering social interactions

20/07/2010 25

SEMpIA

PLUG the Paris Overnight University

� Main Features :� More teachingrelated to history of sciences and technologies (a

weakness of the first game… find the righttradeoff/balancewith game)� Content centric� Quest or Tresor Hunt oriented� Non player characters to enhance immersion and provide atmosphere

(players are under cover agents)… Flow oriented approach vs magiccircle approach

� Gameplay is enriched with Affective Computing features� Players are monitored (how they follow the game design rules and how

they can be helped)� i-Phone based and RFID based� uGASP middleware based

20/07/2010 26

SEMpIA

Immersion & non-player characters

Inspector/Guide

degree

exam

Players/Infiltration

Big Z,

Prof Augustine Meulard,

Students Advisor

Becoming a real student of thesecret Université Paris Nuit

20/07/2010 27

SEMpIA

iPhone and RFID based

ObjectTAGS

Room TAGS

20/07/2010 28

SEMpIA

Affective Computing

� Players' heart rate

� RF communications : ZigBeebased

� Monitoring� DB and a monitoring Laptop� Emotional states

0

20

40

60

80

100

120

140

Fréquence cardiaque Déplacement

Joueur 1

Joueur 2

20/07/2010 29

SEMpIA

Game states consider :– Socialization

– Race condition

– Progression

– Physical and Emotional state

Game statesApproach :

Define steady state values and thresholds

– A priori

– Monitor and ajust values

Change Gameplay if needed,

Change Game Design if required

Graphic of how the player progress and value analysis

20/07/2010 30

SEMpIA

Tracability of players' behavior

… sorry it is in french !

20/07/2010 31

SEMpIA

Game master Interface

20/07/2010 32

SEMpIA

Network Management (Nagios based)

20/07/2010 33

SEMpIA

And U-cities ?

� Lets present some more projects !�FireMen rescue inside buildings (SURPAT)

�Electric Car Recharging

�Cloud Computing for MMO (PLAYONLINE)

SEMpIA

SURPAT : Background -Application Context

� Disasters show a great potential of destruction

� Lost of Lifes and Goods… potential Lost of Rescuers

Fire in the lunneville Castle

SEMpIA

SURPAT : Background –Urgency Plan

An urgency plan is given to the firefighters

20/07/2010 36

SEMpIA

Keys of our solution

� WSN :� 6lowpan over 802.15.4� Fault tolerant and adaptative routing� Safe implementation� Reliable & Trustable network� Distributed Memory vs REST/SOA application layer

� Localization/Identification of rescuers and goods : active RFID based solution

� Pervasive Information System

� All are building blocks of Ubiquitous Computing that canbereused for U-cities

20/07/2010 37

SEMpIA

� Buildings are reduced town

� Same problems but you have to scale :� from thousands of sensors to millions of sensors

�From thousands of people to millions of people

� More complex interactions

� Social Aspects have to be taken into account

From buildings to towns

20/07/2010 38

SEMpIA

Cities from past to future

Luc Shuiten (proj 2100)

Shanghai today

Metropolis Fritzlang1927

New Songdo City South KoreaLas Vegas today

Films Brazil, Blade Runner… REN Towers

20/07/2010 39

SEMpIA

� Smart user, smart car, smart house, smart office, smart city…

Mobility

Future life will lead to… U-Cities

20/07/2010 40

SEMpIA

CS Research for U_cities

ATAWAD

Real

Virtual

SN

AnyTime AnyWhere AnyDevice

Mobile Networks

Internet

iPh

iPh WN

Middleware(REST/SOA)pervasive

IS/DB

I3D/IIHM

Cloud Computing

Mixed Reality

20/07/2010 41

SEMpIA

The Age of The Pussyfoot by Frederik Pohl, 1965

� Science Fiction Inventions andIdeas : http://www.technovelgy.com/ct/AuthorSpecAlphaList.asp?BkNum=287

� Have a close look to the "Joymaker", the ultimate smartphone

20/07/2010 42

SEMpIA

…Groupe Archigram : Computer City

Denis Crompton

1964

"Speculative proposal for a computer system detecting and facilitating patterns of activity amongst a ‘city’ area of 100,000 people "

Social Interaction and digital ubiquity

20/07/2010 43

SEMpIA

U-Songdo in south Korea !(try U-songdo.com)

� 500 000 citizens :

�Every citizen is connected (thru handset/specific device)

�The Information System gathers data in a U-mediacenter(centralized approach)

�U-services, U-education, U-health, U-Transportation…

�U-Cities like U-Songdo are connected

20/07/2010 44

SEMpIA

Conclusion (1) : "U-SU" project or

the U-Stanford University� Stanford University is a reduced city� All skills exist :

� Computer Science research� Electronics� Humanities : Affordance/Acceptance� Design� New Energies

� Leaders drive the business and the standards� Downgrade the goals :

� U-CSSU (U-Computer Science of Stanford U), a U-buildingproject� U-SFMOMA

� Rise Foundings, how ?

20/07/2010 45

SEMpIA

Conclusion (2) :Research Skills of SEMpIA

• Computing Model and Synchronous approach for embedded systems(JF. Susini)

• MANET Routing (S. Boumerdassi)

• Fault Detection in WSN (F. Sailhan)

• Indoor Localization (A. Wei, joining us in september)

• Trust and Security in Smart Cards (S. Bouzefrane)

• Verification (N. Trèves)

• Scalability in Distributed Systems (we are recruting)