Mirror Me

Meng-Chieh YuKenneth

2008/6/201

@ Ubicomp 2008S

Outline

2

1. Introduction2. Related Work3. Method

Bio-signal Computer Vision Multimedia

4. Interaction Design5. Future Work

Outline

3

1. Introduction

2. Related Work3. Method

Bio-signal Computer Vision Multimedia

4. Interaction Design5. Future Work

Importance of Respiration

Respiration - Important for Life, Important for your performance

Respiration functions can be changed by learning.(Fried R, et al., 1993)

Correct respiration might make the person be relaxed, reduces the blood pressure and promotes a healthy body.(Rosenbaum E., 2004; Litchfield P.M., 2006)

4

5

Mirror me

• Improve the respiration habits for common user• Encourage users to use belly respiration•Correct breathing exercise can make the person be relaxed, reduces the blood pressure and promotes a healthy body.

Bluetooth Display

Outline

6

1. Introduction

2. Related Work Computer Vision Biofeedback

3. Method Bio-signal Computer Vision Multimedia

4. Interaction Design5. Future Work

Computer Vision - Logitech

7http://www.logitech.com/index.cfm/webcam_communications/

Detect the features of user’s face Make your webcam with special effects that put more fun into chatting

http://www.wilddivine.com/

Healing Rhythms transform your physical and mental health is in your hands -- literally.

Finger sensors connect to your and measure :- Heart Rate Variability, a key indicator of your long-term health- Skin Conductance Levels, literally the level of your perspiration and a

sensitive measure of stress, or relaxation.

8

Biofeedback – Wild Divine

http://www.thoughttechnology.com/9

Biofeedback – BioGraph Infiniti

BioGraph Infiniti provides a multimedia rich graphical experience, while capturing and analyzing raw data.

Outline

10

1. Introduction

2. Related Work3. Method

Bio-signal Computer Vision Multimedia

4. Interaction Design5. Future Work

Respiration Sensor

11

Bio-signal 1 2

Total Volume

Belly Volume

Chest Volume

• Exhale/Inhale Time• Respiration Freq.• Respiration Time• Exhale/Inhale Ratio• Chest/Belly Ratio

Air Change Point

12

Bio-signal 1 2

13

Computer Vision 1 2

Original Image Gaussian Background Model Face Detection

• Color : RGB image

• Resolution : 320 * 240 640 * 480

• Effective Background Subtraction Method

• Single Gaussian Model

• Face Detection (using OpenCV lib.)

− Face Position− Face Size

• Chest/Belly Detection• Shoulder Detection

14

Computer Vision 1 2

Detecting the Human Face

Estimate User’s Chest & Belly

Estimate User’s Shoulder

15

Multimedia

SoundSound

• Respiration Guidance

−Inhale Time / Exhale Time

• Evaluation

−Silver Crown / Golden Crown

Outline

16

1. Introduction

2. Related Work3. Method

Bio-signal Computer Vision Multimedia

4. Interaction Design5. Future Work

Guidance– Butterfly– Vibrator

Reflection– Air Flow

Evaluation– Crown– Command Message

17

Interaction Design

18

Interaction Design

Visual Sound Touch

Guidance

Reflection

Evaluation

Mirror ME

19

Outline

20

1. Introduction

2. Related Work3. Method

Bio-signal Computer Vision Multimedia

4. Interaction Design5. Future Work

• Computer Vision– Face Detection (auto login)

– Detecting the Face Features

• Mirror interaction– Transparent Mirror– Touch Screen

• Developing Environment (Virtools)

– Advanced Effect– Particle System– 3D Animation

21

Future Work