Microsoft Research Faculty Summit 2007

John A. StankovicBP America Professor, UVAMicrosoft Corporation

Problems of interestUniv. of Virginia AlarmNet Microsoft interactions

HealthGearSensorMap

Summary

Home health care

Home health care(Large scale) assisted living facilities

Home health care(Large scale) assisted living facilitiesFlexible targeting of care to a person’s health conditionLongitudinal studies

Assisted Living and Residential Monitoring Network

Internet

InternetNurses Stations

With Harvard

With Harvard

With MARC UVA Medical School

* With the Univ. of Illinois

Activity of daily living classificationFive two-axis accelerometer network for classifying activities with a HMM

Internet

Internet

PDAs

Nurses Stations

DustLightPollenHumidityTemperatureMotionActivities

Internet

InternetNurses StationsPrivacySecurity

PatientsPatients family and friendsDoctor – what advantages for them in treating patientsNurseTechnicianOrderlyAdminSocial Worker

Personal medical dataPersonal activity dataEnvironmental dataContextual dataLongitudinal dataSystem Performance data

Request Authorizer

Privacy Policy

Policy ManagerContext Manager

Context

Data mining analysis

Request History

Database

User’s Request

Reply

Inconsistency Check

Real-Time

Internet

InternetPrivacySecurity

Internet

Nurses Stations

AlarmGate SW AlarmGate SW on stargateon stargate

DDBB

Internet

InternetPrivacySecurityNurses Stations

Circadian activity rhythm per room for 70 days

0

10

20

30

40

50

60

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

24 hour cycle

Cir

cad

ian

act

ivity

rh

yth

ms

(min

)

Bedroom

Kitchen

LivingroomBathroom

WC

Life Habitsat-home Learning

period

Diurnal/nocturnalactivity

Support for heterogeneous health care systems

Utilize Cell phonesBlueGate, WiGate, EtherGateUnobtrusive body networks

Behavior based systems managementExploiting circadian activity rhythms

Blood Blood Pressure Pressure

Sensor, ECG, Sensor, ECG, ……

WiGateWiGateGatewayGateway

PC, DB,PC, DB,AlarmNet AlarmNet BackendBackend

Pulse Pulse OximeteOximete

rr

SmartSmartphonephone

BlueGateBlueGateGatewayGateway

POGPOGAA

StarGateStarGateGatewayGateway

EtherGatEtherGatee

GatewayGateway

SeeMotSeeMoteeA

larm

Net

Healt

hG

ea

r

Bluetooth

IEEE 802.15.4 WiFi, Ethernet

AlarmsAny Data

Bluetooth

IEEE 802.15.4

Ala

rmN

etH

ealth

Gea

r

WiFi,

Ethernet

Pulse Pulse OximeteOximete

rr

SmartSmartphonephone

Motion, Light BP ScaleTripwirePulse, SpO2

Dust ECG Switch Environmental

SeeMote

WiGateBlueGate

BlueGateBluetooth to MICAz, 802.15.4, 2.4GHzRFBluetooth to MICA2, 4xx/9xx MHz RF

WiGate802.15.4 to WiFi (802.11b/g)

EtherGate 802.15.4 to wired Ethernet with POE

NordGate Nordic RF (ECO mote, Poga2) to 802.15.4 and/or Bluetooth

Classify and detect ADLs - accelerometerTwo versions

Tmote-Mini based – 802.15.4 compatible (designed/built)

Fast design time using Tmote moduleTinyOS compatiblePHY-compatible with ZigBee

Nordic RF chip based (future work)Smaller form factor/cost (expected 10x20mm w/o battery)

RF, MCU, RF, MCU, Accl.Accl. Li Ion BatteryLi Ion Battery

AntennaAntenna

Main board Main board

Activity pattern Activity pattern inferenceinference

Through Circadian Through Circadian Activity AnalysisActivity Analysis

Detection of irregularDetection of irregularbehaviors and behaviors and

anomaliesanomalies

Alerts and MessagesAlerts and Messagesfor the caregiversfor the caregivers

Base Station

Motion sensorsMotion sensorsOther SensorsOther Sensors

Detection ofDetection ofmultiple peoplemultiple people

Sensor network Backbone

Context AwareContext AwarePowerPower

ManagementManagement(CAPM)(CAPM)

UserUserIdentificationIdentification

Power consumption estimation

0

2000000

4000000

6000000

8000000

10000000

1 2 3 4 5

Users

Po

wer

co

nsu

mp

tio

n

(J)

Total energy requiredconsumption with CAPM

Total energy requiredconsumption withoutCAPM

Total energy saved

Publishing and searching private data streams

Privacy guaranteesAnonymous aggregates

Quality control for search resultsRank real-time/archived sensor data search results

AlarmNetPrivileged applicationsOne administrative domain

MetroNetPublic informationMany administrative domains

Must supportPrivacyMobilityData annotation

Rank data streams like PageRank algorithm ranks web pages

All data need not be at central databases

Aggregated streams created by users – can be ranked

MicrosoftUniv. of Virginia Medical SchoolHarvard: (some) body networksJohns Hopkins: Triage moteUniv. of Illinois: Smart clothing

http://www.cs.virginia.edu/wsn/medical/

© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation.

Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN

THIS PRESENTATION.