1

Gesture Recognition SystemSpeaker Bo Hung ChenAdviser Dr. Shih Chung ChenOutlineIntroductionPaper ReviewMaterialMethodsResultsConclusionFuture WorksReference 2IntroductionWhat is Gesture Recognition?It is the process by which the gestures made by the user are recognized by the receiver

MotivationRanging from sign language through medical rehabilitation to virtual reality

IntroductionWide-ranging applications such as the following

Developing aids for the hearing impairedEnabling very young children to interact with computersDesigning techniques for forensic identificationRecognizing sign languageMedically monitoring patients emotional states or stress levels

Reference Gesture Recognition: A Survey , Sushmita Mitra, Senior Member, IEEE, and Tinku Acharya, Senior Member, IEEE , , , ,

4IntroductionWide-ranging applications such as the following

Lie detectionNavigating and/or manipulating in virtual environmentsCommunicating in video conferencingDistance learning/tele-teaching assistanceMonitoring automobile drivers alertness/drowsiness levels, etc

Reference Gesture Recognition: A Survey , Sushmita Mitra, Senior Member, IEEE, and Tinku Acharya, Senior Member, IEEE , , , , / 5IntroductionCommonly typeMorphological

Moving path tracking

Paper ReviewAlphanumeric Shape Recognition of Fingertip Writing TrajectoryRuei-Tang Lin , Ming-Fang Wu Kun Shan University , Department of Electrical Engineering, 2010

25 307Paper Review

Paper ReviewSign Language for Numbers Recognition to Speech Translation System Student : Rubie Fernando Vinas, Advisor : Dr. Shih-Chung ChenSouthern Taiwan University Department of Electrical Engineering Masters Thesis

ANDMaterial

Use USB camera

LabVIEW2010

PCMethodsImage processingSkin Color Swatches

Fill Hole

Remove Particle

Dilate

ThinMethodsTags

MethodsTags

MethodsRecognition rulesROI

ExtractExtract Long

ROI Range Of InterestingMethodsRecognition RulesROI

ROI Range Of InterestingMethodsMouse Control

MethodsMouse Move

ResultsRecognition Results

ResultsProblem

Huge Particle(Item, background, etc) will not be removed

In somehow ,Webcam is just not good enough for recognition(too much limited)

ConclusionGesture Recognition System can be use to control mouse or else human computer interfaceUsers must be trained to get used to the camera(Distance, Angle, etc)USB webcam is not only the cheapest one, but also the most limitations one

Future WorksTry to use another camera(But not too expensive)Fix skin color problemTry to use new tag rule

Reference[1], 3D , , 96[2], , , 99[3], ,, 95[4] 2009[5] Yunli Lee, Seungki Min, HwangKyu Yang, and Keechul Jung , Motion Sensitive Glove-based Korean Fingerspelling Tutor HCI Lab, School of Media, College of Information Technology, Soongsil University,2007[6] Bui, T.D.; Nguyen, L.T. Recognizing Postures in Vietnamese Sign Language With MEMS Accelerometers Sensors Journal, IEEE Volume 7, Issue 5, May 2007[7] Rubie Fernando Vinas, Sign Language for Numbers Recognition to Speech Translation System , [8] Stan Z. Li Anil K. Jain, Handbook of Face Recognition Second Edition , Springer-Verlag London Limited 2011

Thanks for your attention!