university college dublin dublin city university tyndall national institute sixth middleware :...

UNIVERSITY COLLEGE DUBLIN DUBLIN CITY UNIVERSITY TYNDALL NATIONAL INSTITUTE

SIXTH Middleware : Toward Autonomic Sensor Networks

Professor Gregory O’Hare, Dr Rem Collier & Dr Micheal O’Grady

Research Proposal to Vodafone

10th July 2011


Research Overview: Middleware for Sensor Web


1960 1970 1980 1990 2000 2010 2020

1M

10M

100M

1Bn

10Bn

100M

1B+

10B-100B

Mainframe1M Units

Minicomputer10M Units

PC100M Units

Cellphone1B+ Units

Sensor Devices10B+ Units

Devic

es/U

sers

(Log

Scale

) DigitalWorld

PhysicalWorld

100Bn

The Sensor Web


Middleware for the Sensor Web

• Sensor Web:– The aggregation of physical and cyber sensing technologies

within a single unified framework.

• Sensor Web Middleware:– The enabling software layer that delivers the core

functionality necessary to realise the Sensor Web.

• Core Functionality:– Uniform Data Access Model– Sensor Discovery Mechanisms– Data and Sensor Security– Sensor Management and Configuration


Existing Solutions


Our Approach: Middleware for Sensor Web


SIXTH OverviewSIXTH’s goal is:

“an extensible, scalable, intelligent middleware for the Sensor Web based on OGSi”

SIXTH Philosophy:SIXTH is targeted at dynamic and adaptive Sensor Web deployments and is focused on runtime re tasking of sensors and in-situ intelligence

SIXTH Components:Sensor Model: Properties-based model for control of and access to sensing devices.Adaptors: Links sensor specific implementations to a standardised interface that can be accessed via higher-level APIs.APIs: Core functionality of the SIXTH architecture, covering: data access, re-tasking, notification, security and discovery.Services: Data processing layers that build on the APIs.Intelligence: Integrated multi-agent system to support in-situ reasoning and management.


SIXTH ArchitectureAdaptors:Virtual Sensor creationSensor-SIXTH integration

Discovery Service:Secure Sensor Access

Receivers:Streaming of sensor data

Notifiers:Filtered sensor data streams

Services:Data processing / Dissemination


DeploymentsApplication(s)

Gateway Deployment

In-Network Deployment

Cyber Deployment


SIXTH Toolkit

Data Visualisation Sensor Deployment

http://sourceforge.net/projects/sixth/

http://sourceforge.net/projects/sixth/


SIXTH Uniqueness Informed by Emerging Standards

OSGi, OGC Sensor Web Enablement Standards, IEEE 1451 (PnP standard for device configuration)

Sensing the Sensor WebCyber Sensors for online data streams (RSS, Twitter, Gowalla, Facebook, …)Physical Sensors for heterogeneous sensing devices

Dynamic re-tasking of SensorsSupport diverse applications across multiple sensors and WSN subnets

Realizing Intelligent Sensor Networks (iSNs)Enables collaborative and distributed decision-making throughout the WSN.

Interoperable with existing abstractions/programming models Database Models (TinyDB, GSN), REST, HOOD, Abstract Regions, AToM, …


Illustrative Demonstrators


Technology Vision

CLARITY-SIXTH Sensor GatewayPre-packaged, off-the-shelf, sensor gateway;Integrated NGN modem;Configurable out-of-the-box;OSGi-based Dynamic Web-Based Software Configuration;

CLARITY-SIXTH Sensor DeploymentSupports extensibility, heterogeneity and scalability of deployment;Delivers autonomic sensor network management capabilities;Seamless integration of cyber and physical sensor sources;Abstraction of data streams, agnostic of source (physical or cyber);

CLARITY-SIXTH Data Fusion & WarehousingSupport for integration, analysis, fusion and archiving of data;Dissemination of (personalised) data to key stakeholders;


Personalised Insurance

Insurance Provider

I wish I could reducemy insurance premiumby agreeing to certaindriving conditions

I wish I couldincentivise saferdriving… by monitoringdriving behaviour ?

?


Personalised Insurance


Home Services

How will I cope living alone?

How can we facilitateindependent livingfor our aging population?

Medical CentreHow can I feel secure in my home…

How can I reduce my ever increasingelectricity bills?

How can we ensure thesecurity, safety, and well-beingof our aged community?


Home Services


Core Focus: Sensor Discovery


The Problem to Be Solved• Sensor Discovery

– Approaches: Web-based versus Ad-hoc– Web-based well established, but ad-hoc less so– No integrated solution

• Security– Harness existing solutions (existing encryption algorithms,

utilize IPv6 Security model, …)

• Our Approach:– Offer integrated solution through SIXTH– Utilization of mobile phone as the integration platform– Validation through range of demonstrator applications.


OGC SWE Standards• Sensor Web Enablement (SWE) 1.0 Standard (2007)

– Consists of Conceptual Models, XML Schemas & Web Services– Observations & Measurement: Supports transmission of sensor data– Sensor Model Language: Describes sensors systems and processes– Transducer Markup Language: Standard for describing transducers

and supporting real-time streaming– Sensor Observation Service: Web Service for requesting, filtering, and

retrieving observations and sensor system information– Sensor Planning Service: Web Service for requesting user-driven

acquisitions and observations.– Sensor Alert Service: Web Service for publishing and subscribing to

alerts from sensors.

• Sensor Web Enablement (SWE) 2.0 Standard– Currently Under Development as of 2011


Web-Based Sensor Discovery

1: Uses an automated system to convert SWE Observations and Measurements to a custom format.

2: Required an agreed level of metadata within SensorML to enable discovery

3: Requires users to subscribe, possibly with a fee

4: Must know type of sensor in advance of deployment

SWE Compliant

Location encoded

Sensor Descriptions

Security Web Accessible

Sensor Actuation

Low Level Discovery

LinkedSensorData 1 X X X

OSIRIS 2 X X X

GSWSN X 3 X X

GSN X X4 X X X

SIXTH Proposal


Ad-hoc Sensor Discovery

• Less studied area, most focus on SWE-style deployments

ZigBee Bluetooth GSM Actuation Security

TinyLime X X X X

In-Motes X X X

Impala X X X

SIXTH Proposal


Why Integrate?• Web-based approaches are more established:

– Emerging standards exist– Are external to the underlying sensor network- Focus on data aggregation and smoothing- Time lags in receipt of data.

• Ad-hoc discovery is more challenging:- No emerging standards or even accepted approaches- Heterogeneity must be handled in-network- Greater access to individual sensors- Provide access to real time raw data feeds

- Integration allows us to harness the benefits of both approaches in a single unified framework…


The Solution: SIXTH & Sensor Discovery• Modularity sits at the core of SIXTH:

– Facilitates adoption of diverse discovery models ranging from web-based approaches to ad-hoc in-network approaches.

• Aims to bridge divide between web-based and ad-hoc approaches.

• Seamless transition between approaches:– Use web-based interaction when ad-hoc access is not

possible / available. – Support switching to ad-hoc interaction when possible.


Example Demonstrator


Use Case: Surfing Advisor 1

• Consumer wishes to know the weather/surf conditions at surfing sites in his/her vicinity

• User searches for this information on his/her phone

• The phone application automatically connects to the sensors deployed at the various locations.


Use Case: Surfing Advisor 2

• Remotely gathered information is displayed in a contextually sensitive manner

• Various options are given an intuitive rating

• Information from multiple WSNs are fused to give complete description of area


Use Case: Surfing

• Upon arrival at the selected location, the phone discovers the WSNs via Zigbee/Bluetooth

• receives updated telemetry from the sensors

• WSN information can be viewed individually to make a choice as to where in the area to go to


Basic Funding & IP ModelTargeted Joint Project :

A specific dedicated project undertaken in collaboration with Vodafone; Possibility with participation of another partner ( Alactel Lucent); Ring Fenced IP;

Project Duration :3 Year Duration; 6 Month Milestones;Early and rapid prototype development and user trials;

Indicative Project Costing :Dependant upon duration, scope. Typically this would involve:

Vodafone FTE 0.1 pa fully weighted2 X UCD Post Doc (approx cost €50K per Post Doc Year)

300k2 Ph.D Student 25k per annum

150kEquipment

30kTravel 3k per annum per person year

36k Anticipated Overheads 40%

206kTOTAL

722k


Vodafone Engagement

Exchange & Embedding of Staff for short durations :Short term embedding and exchange of research staff betweenCLARITY and Vodafone; Market informed research;

Access to Vodafone Core Network :Access and exposure to Vodafone mobile network test beds;Access to Vodafone Network Engineers;

Support for Potential Spin out Company :Potential investment in spin out company;


Appendices


The Clarity Centre


University College Dublin

University College Dublin (UCD) has been ranked as the top university for Computer Science in Ireland, and the only Irish university to be ranked within the top 100 in the world by the first ever international subject ranking by the QS World University Rankings.


CLARITY OverviewUCD / DCU / TNI

100+ (PhD/PD) Researchersplus Principal Investigators

Diverse Expertise

Health / Environment / Media

Strong Industry Focus

Award-Winning Research & Commercialization

UNIVERSITY COLLEGE DUBLIN DUBLIN CITY UNIVERSITY TYNDALL NATIONAL INSTITUTE UNIVERSITY COLLEGE DUBLIN DUBLIN CITY UNIVERSITY TYNDALL NATIONAL INSTITUTE 35

Research TeamAlmost a decade of working together

Prof. Barry SmythCLARITY DirectorRP 6 Leader

Prof. Alan SmeatonDeputy DirectorRP 5 Leader

Prof. Dermot DiamondRP1 Leader

Prof. Greg O’HareRP3 Leader

Prof. Noel O’ConnorRP4 Leader

Dr. Brian CaulfieldRP3, RP6

Prof. Niall MoynaRP1

Dr. CianO’MathunaRP2 Leader

Personalization, Recommender Systems, User Modeling

Materials science, novel sensorTechnologies, wearables.

Physiotherapy, Human motion, Body sensing technologies,…

Sports science, human Performance, ….

Sensor platforms and hardware,Power management, …

Middleware, agent orientedcomputing, mobile computing.

Signal processing, audio/videoprocessing, data analysis.

Information retrieval, multimediaInformation, video retrieval,…

Dr. DonnachaO’DriscollCentre Manager

2


Summary Technical Programme

Dev

ices

& P

latf

orm

s

Devices & Platforms

Content & People

De

mo

ns

tra

tors

Sensor Web Middleware


€ 615,603

€ 6,639,415

€ 4,285,971

€ 11,820,000

€ 3,169,529

Total Centre Funding

Excq

Additional Industry

SFI

CoreIndustry

Non-Excq

CSET Grant

Centre funding to date >€26m. 55% CSET Grant / 45% Additional (March2011)

IRCSETEPA

SFIEI

EU F

P7

Marie Curie

Note: New core partners in Q1


Cumulative Publications

Journal Conference Other0

50

100

150

200

250

300

77

225

33

162

ActualTarget

139 additional non-CSET funded papers (93 conference, 46 journal).Across the centre this represents a PI publication rate of approximately 20 papers p.a.


SOCIAL/AGENCY COLLABORATORS

INDUSTRY COLLABORATORSCSET CORE

CLARITY Centre & Ecosystem

39

SOCIAL/AGENCY COLLABORATORS

INDUSTRY COLLABORATORSSOCIAL/AGENCY

COLLABORATORS

INDUSTRY COLLABORATORS

June 2011


CLARITY Demonstrators

Personal Health & Sports

Personal Health & Sports

Energy & the EnvironmentEnergy & the Environment

Ambient Assisted Living

Ambient Assisted Living

Sensing the Real-Time Web

Sensing the Real-Time Web


CLARITY Demonstrators1. Sensing the Realtime Web• The host of online services now available to us are regarded

as sensors - FaceBook, Twitter, FourSquare, etc.• Many examples of how these help in emergency and other

situations, but especially in non-emergency situations, regular ‘transactions’ correspond to sensor values;

• For text we can analyse sentiment, in real time;• For location-based services, we can combine these with

sensors from the physical world - environment, weather, traffic, events, etc.

• Companies involved in this work include IBM SmartCities centre (Dublin), other SMEs.


CLARITY Demonstrators2. Personal Health and Sport• Applications in tennis, hockey, boxing, cycling, golf, stroke

rehabilitation, cystic fibrosis;• New sensing technologies for motion capture using our own

CLARITY WIMUs;• New sensing technologies for sensing the person through

respiration, perspiration;• Both of these are novel, unique, and benchmarked against

others, shown to be world-class;• Combine these with off-the-shelf sensors;• Company involvement from Disney, QinetiQ


CLARITY Demonstrators3. Energy and the Environment• We develop novel sensors for real time environmental

monitoring of water (phosphates and other nurtients) and air (CO2, CH4, etc.);

• We prototype these and build end-to-end systems which we deploy in the field, working with Environmental Protection Agency and Marine Institute;

• Combine these with off-the-shelf sensors to create web-based visualisations of health of an environment;

• With industry partners we deployed smart energy meters in domestic/industry trials to monitor, incentivise and reward customers through various interventions

• This included appliance recognition• Company involvement from Episensor, IBM


CLARITY Demonstrators4. Ambient Assisted Living and Lifelogging• Lifelogging one of the most active research areas in CLARITY• Most-used device is SenseCam but also Looksie, VeeCam,

Android, wearable classes and others;• CLARITY AAL work on deployments of fall detectors, activity

profiling, disturbances in public places, energy monitoring;• Companies sponsoring this work include Microsoft Research,

IBM Research, FAST Search and Transfer (Norway), Research Council of Norway, and previously Samsung Electronics (Korea), Mitsubishi Electric Research Labs (US), HP Ireland.


CLARITY RelationshipsThe industry partner slide shown earlier shows current industry engagement;

In addition we have 16 ongoing FP7 projects - large multi-partner projects to smaller STREPs.

Wide range of areas - energy management and smart buildings, material science, healthcare, media

Very many industry partners, very industry-facing


Clarity Projects in the Building Energy Management Space


CLARITY EU- EnPROVE

EnPROVE: Maximising return of investment (ROI) when investing on energy saving solution


CLARITY -FIEMSER

CLARITY-UCDCSTBTHALESTECNALIA LabeinFraunhoferPhilips AccionaTENESOL

FIEMSER (Friendly Intelligent Energy Management System for Existing Residential Buildings)


CLARITY - HOBNET

RACTI Ericsson Mandat International Sensimode CLARITY-UCD University of Geneva University of Edinburgh

university college dublin dublin city university tyndall national institute sixth middleware :...

Documents

sensor web sensor web

sensor web slide

sensor web middleware

sensor model

virtual sensor creation

sensor web cyber sensors

b units sensor devices

secure sensor access