emg application in game - weebly · 2018. 9. 6. · 0x02 emg accy 0x03 emg accz 0x01 emg accx...
TRANSCRIPT
![Page 1: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/1.jpg)
Project: Muscle Fighter
서울대학교 의용전자연구실
박덕근,권성훈,김희찬
EMG application in GAME
생체근전도신호처리에기반한새로운무선 HCI 개발에관한연구
![Page 2: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/2.jpg)
Contents
Introduction
Hardware
Software
Evaluation
Demonstration
![Page 3: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/3.jpg)
Introduction
About EMG
About Fighting Action Games
Purpose of Project Muscle Fighter
![Page 4: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/4.jpg)
About EMG
Electromyogram(EMG): recording of the electrical activity of muscle by means of surfaceor needle electrodesClinical EMG : investigation of the electrical activity of normal & diseased skeletal muscle
![Page 5: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/5.jpg)
Schematic of the differential amplifier configurationfor EMG measurement
EMG measurement
![Page 6: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/6.jpg)
Amplitude : stochastic(random), Gaussian distributionMagnitude : 0~10mV(peak-to-peak), 0 ~ 1.5mV(rms)Frequency range : 0~500 Hz with dominant energy in 50~150 Hz
Magnified EMG Signal
Frequency spectrum of the EMG signal detected from the Tibialis Anterior muscle during a constant force isometric contraction at 50% of voluntary maximum.
Characteristics of the EMG signal
![Page 7: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/7.jpg)
CMRR : > 90dBInput impedance : > 100MOhmFiltering : 20∼500Hz with 12dB/oct roll-offElectrode position, distance, size, stability, etc.Active Electrode : differential amplifier close to electrode
The amplitude and frequency spectrum of the EMG signal is affected
by the location of the electrode DELSYS’s Active Electrode device
(www.delsys.com)
Electrical characteristics of the Electrode unit and Amplifiers for EMG
![Page 8: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/8.jpg)
To determine the activation timing of the muscle (delay time from excitation)To estimate the force produced by the muscle (rms or avr value)To obtain an index of the rate at which a muscle fatigues(frequency spectrum analysis)
Initiation of activation of the EMG signal Force / EMG signal relationship Spectral modification during sustained contraction
Applications of the EMG Signal
![Page 9: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/9.jpg)
The arrangement of the factors is designed to demonstrate the flow of the influences and interactions among the factors.
Factors affecting the EMG signal
![Page 10: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/10.jpg)
Laptop computer
PDA
EMG AMPX 5000
Filtering Thresholding ComposingMorse Code
ASCII
Morse CodeTo Text
RS- 232
T e x t T o
S p e e c h
M o d u l e
Remote Controlleror Home
Automation
Text To Speech Module
– Seoul National University– EMG from jaw-moving muscle (Masseters)– Transformed to morse code– Communication, HCI, Remote control for machines
Communication Device for Disabled
![Page 11: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/11.jpg)
University College LondonGraphic input device controlled by wrist motionEMG from 4 muscles processed by Neural Network
Position of the electrodes on the forearm
The Biofeedback Pointer
![Page 12: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/12.jpg)
About Fighting Action Games
System ConfigurationControl
Advanced Skill
+ A
Making Force Blow
Command Input
![Page 13: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/13.jpg)
Continued – new trend
Tekken
Body Simulator
![Page 14: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/14.jpg)
Continue – new trend
Fighting Game – Based on motion
![Page 15: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/15.jpg)
Project Muscle Fighter
Natural Control of Fighting Game
More intuitive than joystick
Skill System using accumulated force
Reasonable delay and lock
Pleasure of hitting
![Page 16: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/16.jpg)
System Block Diagram
Amplifier On Electrode
RF transmitter
RFreceiver
Software for Analysis
Force
Accelerometer Acceleration
Game Input
![Page 17: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/17.jpg)
Hardware
AOE
Accelerometer
RF transceiver
![Page 18: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/18.jpg)
Amplifier on electrode
Cut off frequency30~300 Hz
Gain30~40dB
Size20x30 mm
No wireReduction of motion artifactImproved SNR
![Page 19: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/19.jpg)
Accelerometer
Acceleration range-5g ~ +5g
Output range0 ~ 5V
Channels2 orthogonal x, y
Size15 X 23 mm
![Page 20: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/20.jpg)
RF transceiver
Data rate 19200bpsSerial port1.5V AAA BatteryWork well in 5 m away
![Page 21: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/21.jpg)
Software
Firmware
Analysis Software tool
Muscle Man
![Page 22: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/22.jpg)
AccXEMG0x01AccZEMG0x03AccYEMG0x02
Firmware
Data Format for RF transceiver
To give EMG signal maximum sampling rate within 19200 bps
EMG signal sampling rate 500Hz
Accelerometer signal sampling rate is 500/3 for each axis
AccXEMG0x01
![Page 23: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/23.jpg)
Analysis Software tool
Realtime display and recordingOff-line analysis
RMS valuePower spectrum analysis
Programmed withLabView
![Page 24: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/24.jpg)
Muscle Man
EMG analysisForce
Acceleration
Mouse, Keyboard emulation
![Page 25: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/25.jpg)
Force estimation
Root mean squareWindow size 200 msec = 100 sample
Capacitor modelUser accumulates force by contraction
Force gauge discharges with time constant
More force, more fast charging !!
RF noise and EMG difference in people is barrier to practical use.
![Page 26: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/26.jpg)
Acceleration analysis
We just used one axis in determining when the user moved his hand.
Simple algorithm based on threshold and delay
More study is needed to determine more type of action, for example, hook.
![Page 27: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/27.jpg)
Total System Developed
![Page 28: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/28.jpg)
Advantage
It makes fun!
It is easy to understand and use
![Page 29: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/29.jpg)
Drawback
Sticky electrode
Different result for different people
Wrong reaction resulting from noise
![Page 30: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/30.jpg)
Future Works
Insert calibration module at start up to make more reasonable decision
Get more information from accelerometer signals
Make electrode easy and robust
Develop game software designed for this interface
![Page 31: EMG application in GAME - Weebly · 2018. 9. 6. · 0x02 EMG AccY 0x03 EMG AccZ 0x01 EMG AccX Firmware Data Format for RF transceiver To give EMG signal maximum sampling rate within](https://reader035.vdocuments.site/reader035/viewer/2022062416/61034f75f40cb454826b057d/html5/thumbnails/31.jpg)
Demonstration