idea lab presentation
DESCRIPTION
IDEA Lab PresentationTRANSCRIPT
![Page 1: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/1.jpg)
Using wearable motion sensors to recognize human gestures
Peng Deng, Qifeng Mao{pdeng,qmao}@students.csse.unimelb.edu.au
CSSE University of MelbourneLabSUM∑
![Page 2: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/2.jpg)
2
Agenda
• Introduction– Wireless sensor network– Normal applications– WSN in HCI
• Our HCI project– Idea– How it works using Sun SPOT– Challenges and solutions
• Demos
• Future apps and comments
![Page 3: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/3.jpg)
3
Introduction: Sensor Networks1. Deploy2. Network setup3. Query and response
User
Event
CommunicationProcessing Element
Sensing Element
P S O U W PE PR L
Y
SENSORS
ADC MICRO
PROCESSOR
MEMORYRADIO
REAL TIME OS
ALGORITHMS
Limited Lifetime
Require Supervision Slow
Processing
Limited Memory
1 kbps – 1 Mbps, 3 – 100 m, Lossy
Transmission
![Page 4: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/4.jpg)
4
Applications
• Environmental monitoring
• Security
• Defence
• Bioinformatics and health
• Transportation management
• Chemical detection and emergency response
Pictures from [3]
![Page 5: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/5.jpg)
5
Accelerometer based HCI
![Page 6: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/6.jpg)
6
Our idea
• “Off the desk” interaction
• Multiple sensor nodes on body– 1*hand held � 2*wrists+1*waist+2*feet
• Recognize gestures � recognize actions
• Use different sensors (not limited to accelerometer) to interact with environment near by
![Page 7: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/7.jpg)
7
Sun SPOT
![Page 8: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/8.jpg)
8
Sun SPOT
• 3-axis accelerometer• Temperature sensor• Light sensor• LEDs• Analog inputs• Switches• General purpose I/O
Embedded sensorsEmbedded sensors
2.4 GHz IEEE 802.15.4 radiowith integrated antenna
RadioRadio
512K RAM/4M FlashMemoryMemory
180 MHz 32 bit ARM920TCPUCPU
32 uADeep sleepDeep sleep
720 mAh lithium-ion batteryBattery capacityBattery capacity
Sun SPOTPlatformPlatform
NetBeans 5.0IDEIDE
JavaProgramming LanguageProgramming Language
Sun Java Squawk VMFrameworkFramework
[7] [8]
![Page 9: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/9.jpg)
9
Sun SPOT Applications [7]
![Page 10: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/10.jpg)
10
3-axis Accelerometer
General purpose. Depends on developers’ implementation
Carefully tuned to optimize performance in determining hand and arm motion
PurposePurpose
250~30050Acceleration Noise DensityAcceleration Noise Density
850 uA @ 3.3 VSleep mode support
300 uA @ ~3VPower consumptionPower consumption
+/- 2G (600 mv/g)+/- 6G (200 mV/g)
+/- 3 G (300 mv/g)Range & SensitivityRange & Sensitivity
USD $10.82USD $8.97PricePrice
ST Microsystems LIS3L02AQAnalog Devices ADXL330 ChipChip
Sun SPOT [18]Wii Remote Controller [17]
Hzg /µ Hzg /µ
![Page 11: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/11.jpg)
11
How it works
Base
Station
CU-
HTKApps
![Page 12: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/12.jpg)
12
How it works cont.
• CU-HTK: a speech recognition toolkit– Supervised machine learning (HMM)
• Training phase– 5 samples per gesture
• Recognition phase– Find most similar trained gesture
![Page 13: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/13.jpg)
13
Challenges and solutions
• Human gestures are inexact and vary every time– HMM
• Real time data stream segmentation– Manually– Threshold level– Machine Learning (DTW, SVM, LDA …)
![Page 14: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/14.jpg)
14
Demos
Pictures from [15] [16]
![Page 15: IDEA Lab Presentation](https://reader033.vdocuments.site/reader033/viewer/2022052617/547bacad5806b5d63f8b4675/html5/thumbnails/15.jpg)
Q & A