skinput
TRANSCRIPT
04/12/23SKINPUT 1
Nikitha VidyadharNO : 32
04/12/23SKINPUT 2
Can You Ever Can You Ever Imagine Imagine
Human Body Human Body As AAs A
TOUCH TOUCH SCREEN?????SCREEN?????
04/12/23SKINPUT 3
YEAH !!!YEAH !!!
THERE IS A SOLUTIONTHERE IS A SOLUTION AND AND
THAT IS THAT IS
SKINPUTSKINPUT
STRUCTURE OF PRESENTATIONSTRUCTURE OF PRESENTATION
04/12/23SKINPUT 4
Motivation
Overview Principle of Skinput
Mechanism and Processing model
Experiment
Advantages And Disadvantages
Skinput in future
Conclusion
MOTIVATIONMOTIVATION
Touch screens are familiar nowadays.Certain drawbacks of them are : Limited interaction space
Less accurate interactions
Cannot make buttons and screens larger without losing the primary benefits of small size
04/12/23SKINPUT 5
OVERVIEWOVERVIEWGiving input through skin.
Skinput turns human body into touch screen input surface.
Developed by Chris Harrison, Desney Tan, and
Dan Morris of the Microsoft Research's
Computational User Experiences Group. Its first public appearance was at Microsoft's
Tech Fest 2010
04/12/23SKINPUT 6
WHAT SKINPUT DOESWHAT SKINPUT DOES??Primary functions areControl audio devices.Make phone calls.Navigate browsing systems.Play games.
Uses series of sensors to determine where user tapped on skin
04/12/23SKINPUT 7
PRINCIPLE OF SKINPUTPRINCIPLE OF SKINPUT
It listens to vibrations in your body.
Skinput also responds to the various hand gestures.
The arm is an instrument
04/12/23SKINPUT 8
WHAT MAKES IT WORKWHAT MAKES IT WORK??
04/12/23SKINPUT 9
PICO PROJECTORPICO PROJECTOR
It is also known as pocket projector or mobile projector. Displays Menu. The system comprises three main parts:
The Laser light source The Combiner optics The Scanning mirror
04/12/23SKINPUT 10
BIO ACOUSTICSBIO ACOUSTICS
Study of sound waves inside living body.
When a finger taps the skin, several distinct forms of acoustic energy are produced.
Longitudinal WavesTransverse Waves
04/12/23SKINPUT 11
TRANSVERSE WAVESTRANSVERSE WAVESCreated by the displacement of the skin
from a finger impact.
They are visible when we slow down it 14 times.
Tapping on soft regions of the arm create higher amplitude transverse wave than tapping on boney areas.
Sensors activated as wave passes under it. 04/12/23SKINPUT 12
LONGITUDINAL WAVESLONGITUDINAL WAVESSome of the energy is transmitted inwards
towards the Skelton.
Causes internal skeletal structure to vibrate.
These waves travel through the soft tissues of the arms, exciting the bone .
It responds to mechanical excitation by rotating rigid body.
04/12/23SKINPUT 13
BIO ACOUSTICS : BIO ACOUSTICS : SENSINGSENSING
Each body part creates different type of vibrations
depending on:BonesMusclesTendons
These signal need to be sensed and worked upon.
This is done by wearing wave sensor armbands.
Sensing elements detect vibrations transmitted through the body.
04/12/23SKINPUT 14
ARMBANDARMBAND
04/12/23SKINPUT 15
INSIDE VIEWINSIDE VIEW
OUTSIDE VIEW
OUTSIDE VIEW
ARMBAND ARMBAND MECHANISMMECHANISM
Detect vibrations transmitted through the body.
Arm band device consists of two components: 1. Projector 2. Detector
Armbands are placed in 2 ways.Above the elbow Below the elbow
04/12/23SKINPUT 16
ARMBAND PROTYPEARMBAND PROTYPE
04/12/23SKINPUT 17
Two arrays of 5 sensing elements incorporated into an armband.
2 Sensor packages focus on the arm of armband
One package was located near the Radius other near the Ulna.
BLUETOOTHBLUETOOTH
04/12/23SKINPUT 18
Armband is connected to Mobile Device or Computer via Bluetooth
MECHANISMMECHANISM
Arm band detects the acoustic signals and convert them to electronic signals which
easily enable the users to perform simple tasks as
browsing through a mobile phone menu,
making calls, controlling portable music players etc.
04/12/23SKINPUT 19
PROCESSINGPROCESSING MODELMODEL
04/12/23SKINPUT 20
Projector display image
on arm
Vibrations are captured from
sensors
This is connected to Mobile Device via Bluetooth.
A software to match sound
frequencies to specific skin location is
used.
Corresponding action is
implemented in device
Finger taps on arm
PROCESSING(PROCESSING(detaileddetailed))
04/12/23SKINPUT21
Employ a Mackie Onyx 1200F audio interface to
digitally capture data from ten sensors.
Connected via Fire Wire to a conventional
computer
Each channel was sampled at 5.5
KHZ(55KHZ total)by
ATmega168 processor
Data was sent to our primary application
written in JAVA
04/12/23SKINPUT 22
This program perform three key functions:-
Provides a live visualization of the data
It segments inputs from the data stream into independent instances(taps).
Classified these input instances
The audio stream was segmented into individual taps using an absolute exponential average of all 10 channels
SEGMENTATIONSEGMENTATION
04/12/23SKINPUT 23
04/12/23SKINPUT 24
After the input has been segmented ,the wave forms are analyzed.
Employing a brute force learning approach computing 186 features in total( includes combinationarily).
186 features includes
Average amplitude, SD and total energy of the waveforms in each channel(30 features).
Average amplitude ratios b/w channel pairs(45 features).
Average of these ratios(1 feature). 256 point FFT for all 10 channels (take only lower 10
values ie (100 features). a rough estimation of the fundamental frequency of the
signal displacing each sensor (10 features).
04/12/23SKINPUT 25
BRUTE FORCE LEARNING approach computes 186
features in total.
Support Vector Machine
Classify Input instances using Weka Machine Learning Tool
Kit.
Event associated with location is instantiated.
Interactive feature bounded to that event fired.
EXPERIMENTEXPERIMENT
04/12/23SKINPUT 26
Participants 13 ->7 female, 6 male. Ages ranged from 20 to 56. Body mass indexes (BMIs) ranged
from 20.5 (normal) to 31.9 (obese).
Three input groupings from the multitude of possible location combinations to test .
From these groupings,5 experimental conditions was derived.
LOCATIONSLOCATIONS
04/12/23SKINPUT 27
TRAINING AND CLASSIFICATIONTRAINING AND CLASSIFICATION
04/12/23SKINPUT 28
RESULTSRESULTSFIVE FINGERSFIVE FINGERS
04/12/23SKINPUT 29
Accuracy remained high for five finger
condition averaging 87.7%
When classification was incorrect, the system believed the input to be an adjacent finger 60.5% of the time.
Ring finger constituted 63.3% of the misclassifications.
WHOLE ARMWHOLE ARM
04/12/23SKINPUT 30
Below-elbow placement performed the best posting at 95.5% accuracy.
Moving the sensor above the elbow reduced accuracy to 88.3 (7.2% drop).
The eyes free input condition yielded lower accuracies than other conditions averaging
85%(10.5% drop)
FOREARMFOREARM
04/12/23SKINPUT 31
Classification accuracy for the 10 location forearm condition stood at 81.5%.
Higher accuracies can be achieved by collapsing the 10 locations into groups.
BMI EFFECTSBMI EFFECTS
04/12/23SKINPUT 32
High BMI is correlated with decreased accuracies.
No direct relation with gender of the participants
WALKING AND JOGGINGWALKING AND JOGGING
04/12/23SKINPUT 33
Each participant trained and tested the system while walking and jogging on a treadmill.
3 input location were used to evaluate accuracy .
In walking trials system never produced a false input.
In jogging trials the system had 4 false-positive input events over 6 min of continuous jogging.
Accuracy decreased to 83.3% and 60% for male and female participants respectively.
04/12/23SKINPUT 34
04/12/23SKINPUT 35
ADVANTAGESADVANTAGES No need to interact with the gadget directly.
Don’t have to worry about keypad.
People with larger fingers get trouble in navigating tiny buttons and keypads on mobile phones. With skin put this problem disappears.
The body is portable and always available, and fingers are a natural input device.
DISADVANTAGESDISADVANTAGES
04/12/23SKINPUT 36
Band seems easy enough to slip on, people found difficult to wear a very big band around their arm for the day.
Not enough research has been conducted product to test the possible skin diseases get from using this product.
Very high cost which will not be affordable for the common man.
SKINPUT IN FUTURESKINPUT IN FUTURE
04/12/23SKINPUT 37
A person might walk toward their home, tap their palm to unlock the door and then tap some virtual buttons on their arms to turn on the TV and start flipping through channels.
Extensive Research is going on Currently on Skinput to
make the armband more smaller.Incorporate More Devices with This System.Extend accuracy level.
04/12/23SKINPUT 38
With small sized Pico-projectors ,Skinput oriented systems are emerging trend.
Research carried out for smaller wrist band watch sized sensor armband.
FUTURE IMPLICATIONS
CONCLUSIONCONCLUSION
04/12/23SKINPUT 39
Skinput allows the human body as an input surface.
It describes a novel, wearable bio-acoustic sensing array that we built into an armband in order to detect and localize finger taps on the forearm and hand.
We conclude with descriptions of several prototype applications that demonstrate the rich design space we believe Skinput enables.
BIBLIOGRAPHYBIBLIOGRAPHY
04/12/23SKINPUT 40
http://research.microsoft.com/enus/um/redmond/groups/cue/skinput Official Home Page of Skinput.
http://www.chi2010.org Home Page of Computer & Human Interactions Conference, April,2010.
http://www.chrisharrison.net/projects/skinput Personal Homepage of Chris Harrison.
http://research.microsoft.com/en-us/um/people/dan Homepage of Dan Morris.
SKINPUT: Appropriating the Body as an Input Surface Chris Harrison , Desney Tan , Dan Morris
04/12/23SKINPUT 41