a personalized body motion sensitive training system based on auditive feedback
DESCRIPTION
Hoelzl Gerold. A personalized body motion sensitive training system based on auditive feedback. Overview. Motivation System design Summary Future work. Motivation. Motivation. During training (jogging) it is fun to listening to music problem: - PowerPoint PPT PresentationTRANSCRIPT
Hoelzl Gerold
Overview
Motivation System design Summary Future work
20.04.23 2Hoelzl Gerold
Motivation
20.04.23 3Hoelzl Gerold
Motivation
During training (jogging) it is fun to listening to music problem:
rhythm of the music ≠ rhythm of the runner
20.04.23 4
music rhythm (bpm) running rhythm
≠
Hoelzl Gerold
Motivation
Idea adaptive selection of music according to the
running respectively the walking pace
additionally playing auditive status information like
heart rate speed, distance warnings if predefined limits are exceeded …
20.04.23 5Hoelzl Gerold
System design
20.04.23 6Hoelzl Gerold
System design
3 tasks movement analysis audio analysis mapping: movement<-> music
20.04.23 7Hoelzl Gerold
System design Movement analysis
20.04.23 8
[Scholich M., 1978, S.93]
acceleration maximum during heel- and toe ground contact g > 1,75 m/s²
recognition of a footstep: phase 7: „front support phase“phase 8,9: „rear support phase“
phase 7, 8 ,9 : „support phase“
[Larch R., 2001, S.3]
Hoelzl Gerold
System design Movement
acceleration values
extracted footsteps
distance calculation ->d(i)[ms]
20.04.23 9
d(0)d(1)
d(2)d(3) d(4)
1
0
])[(1 n
i
msidn
mftFeature for classifying running rhythm defined as mean footsteptime (mft)
Hoelzl Gerold
System design
Audio analysis audio feature
beats per minute (bpm) (beat-tracking) recognized as a binary regular pulse
underlaying the music
separate calculation too computational intensive on mobile
devices stored as metadata
20.04.23 10Hoelzl Gerold
System design
Mapping
O[bpm] = F(M,f[mft]) mapping function
M = {m1,…,mn} set of music piecesf[mft] feature
O[bpm] M set of fitting music pieces
20.04.23 11
O = F(M,f)mft [ms]
feature f output O
music pieces [bpm]
Hoelzl Gerold
System design - Hardware
20.04.23 12Hoelzl Gerold
System design
20.04.23 13Hoelzl Gerold
System design
Hardware sensors
acceleration-sensor (movement analysis) ECG-sensor (biofeedback) GPS-sensor (speed, route, tracking)
communication technology Bluetooth
controller mobile phone (JavaME)
20.04.23 14Hoelzl Gerold
System design Hardware (prototype)
acceleration-sensorSparkfun WiTilt v33-axis acceleration sensor with integrated Bluetooth capabilities
ECG-sensorPolar Heart Rate Monitor Interface +AMB2300-EV-Bluetooth-Board
GPS-sensor (integrated in mobile phone)
20.04.23 15Hoelzl Gerold
System design - Software
20.04.23 16Hoelzl Gerold
System design Software design
20.04.23 17
Sensor-Controller
ECGSensor
Acceleration
Sensor
GPSSensor
Controller-
View
Audioplayer
Feature-calculation
Mappingmft<->bpm
Actors(pulse,
speed,..)
Hoelzl Gerold
System design
Software JavaME
API´s JSR 82: Bluetooth JSR 179: Location (GPS) JSR 135: Media (Audio, Video)
SonyEricsson JP8 current JavaME platform implementation
20.04.23 18Hoelzl Gerold
Summary & Future work
20.04.23 19Hoelzl Gerold
Summary
adaptive selection of music according to the running- respectively the walking pace
additionally playing auditive status information like
heart rate speed, distance warning if predefined limits are exceeded …
20.04.23 20Hoelzl Gerold
Summary
Experimental results prototype showed high accuracy and
stability in both laboratory and naturalistic environments
short response time giving realtime “feeling”(~50ms)
Unexpected: crash of Bluetooth connections when built
in GPS sensor was used
20.04.23 21Hoelzl Gerold
Summary
mapping function difficult to define one function for many
users music rhythm / speed is perceived very
subjective learning „on the fly“
20.04.23 22Hoelzl Gerold
Summary
integrated sensors usage possible (less components) but restriction of device usage likely
(e.g. fixed position of acceleration sensor for movement analysis)
20.04.23 23Hoelzl Gerold
Future work
support training programs in adaptively selecting forcing / retaining music pushing music if beneath a defined limit assuasive music if above a defined limit
20.04.23 24Hoelzl Gerold
Future work
tracking with status information (using remote computer)
„control sportsman“ competitions (without borders)
20.04.23 25Hoelzl Gerold
Questions?
20.04.23 26Hoelzl Gerold