human body movement analysis decoding the movement and emotion yunyu wang, professor c. c. lin,...

Human Body Movement Analysis Decoding the Movement and

Emotion

Yunyu Wang, Professor

C. C. Lin, Associate Professor

W. C. Chen, Professor

A three years researchresearch and application developmentdevelopment project

2

Origin--2003Origin--2003 The Exchange/Discussion

PeoplePeople from Animation, Dance, Laban Movement Analysis, Computer Science and Sports Science.

TopicsTopics about Movement Quality, Emotion, Expression, Skill Analysis, Dance Innovation and LMA Application.

3

Project DescriptionProject Description

Period:Three-year: 2006 to 2009First year: April 1, 2006

ParticipantsProfessors: 5Graduate students: 18Full time staffs and technicians: 5

4

TNUATNUA

The College of DanceThe College of DanceGraduate School of Technology and ArtsGraduate School of Technology and ArtsCenter for Art and TechnologyCenter for Art and TechnologyThe E Motion LabThe E Motion Lab

5

The E Motion LabThe E Motion Lab

6

Partner Organizations and InstitutionsNCPESNCPES (National College of Physical Educatio

n and Sports)

ITRIITRI (Industrial Technology Research Institute)

Academia SinicaAcademia Sinica (http://www.sinica.edu.tw/as/intro/hist_e.html)

7

WHY WHY ？？

In DanceIn Dance In AnimationIn Animation In Exercise and SportsIn Exercise and Sports In health industryIn health industry

8

Sub-Project I Motion Database and Metadata

10

Motion Database and MetadataProject Leadership and Project integrationTheory development, movement knowledge

analysisMovement Data Collection Motion Database Schema and StructureMetadata

11

Sub-project IIMotion Synthesis and Detection

Motion Synthesis and Detection

13

Motion Synthesis and Detection A kernel Engine for Laban motion and emotio

n analysis Laban motion

Effort Shape Body

Emotion Cyclic Non-Cyclic

14

Motion SynthesisLabanmocap

emotionalmocap

Construction of Basis Functions(LM and EM separately)

EmotionalMocap(EM)

LabanMocap(LM)

DdPCA FTDynamicSystems

Movement Primitive Lib.(LM and EM)

Motion compiler

Output Motion

LearningAlgorithm

Task Objective

Construction of Basis Functions

EM MotivesLM

15

Motion Detection/Classification

Labanmocap

emotionalmocap

Construction of Basis Functions(LM and EMCAP)

EmotionalMocap

LabanMocap

DdPCA FT Neural Net

Movement Primitive Lib.(LM and EM)

Motion Classifier Construction

Motion DetectionLearningAlgorithm

Unclassified MotionUnclassified Motion

Motion Classifier Lib.

16

Example Result: PCA elbow up

17

Demo(Man’s arm up movement)

Mocap original motion PCA motion synthesis

Sub-project III Industry Applications

19

Application…Application…in Dance Dance

Dance engine for ChoreographyDance analysisDance creationInteractive Dance

Sub-3

20

Application…Application…

in movie and animationMotion/Emotion Quantity Model

and Synthesis techniquesCommon Motion LanguageAnimation Plug-inGame engine

Sub-3

21

Application…Application…In Exercise and Sports

Efficient and safe (Basketball shooting and Discus throwing)

Online instruction and learning Skill Analysis and diagnosis

Sub-3

22

Application…Application…

In Health industry Better Rehab. --Motivating Moves

Janet Hamburg (University of Kansas)

Fitness Instructor ---My Best FriendOnline Stretching, exercise monitoring, …

Sub-3

The End

In describing movement, we must make a mental note of the most important intermediary positions.