silent interaction: healthcare ux,지금 우리가 질문해야 할 몇 가지

Silent Interaction:

Healthcare UX,지금 우리가 질문해야 할 몇 가지

2017Billy(최병호)/[email protected]

중앙대학교 교수

홍익대학교 영상대학원(HCI개론 강의)/연세대학교 공학대학원(서비스디자인경영 강의)/

성균관대학교 일반대학원 휴먼ICT융합학과(교수)/HEDcentric UX미래융합전략연구소(연구소장)

InnoUX(대표이사)

Research Data: http://www.slideshare.net/BillyChoi/Blog: http://blog.naver.com/soularchitec

Twitter/Facebook: ILOVEHCI

© 2017 Billy All rights reserved.Silent Interaction: Healthcare UX, 지금 우리가 질문해야 할 몇 가지

Table of Contents

1. Speech + Deep learning + Finding + Quality of life + Personality → Healthcare

+ Silent UX?

2. Pause + Diffuser + Everywhere + Life → Healthcare + Silent UX?

3. Kids + Sports + Play + Space → Healthcare + Silent UX?

1

1. Speech + Deep learning + Finding + Quality of life + Personality → Healthcare+ Silent UX?

Sources: • Khushboo Batra, Swati Bhasin, Amandeep Singh: Acoustic Analysis of voice samples to differentiate Healthy and Asthmatic persons(2015)• Rachna, Dinesh Singh, Vikas: FEATURE EXTRACTION FROM ASTHMA PATIENT’S VOICE USING MEL-FREQUENCY CEPSTRAL COEFFICIENTS(2014)• Saloni, R. K. Sharma, and A. K. Gupta. "Disease detection using voice analysis: a review." International Journal of Medical Engineering and Informatics 6.3(2014): 189-209.• Sonu, R. K. Sharma “Disease detection using analysis of voice”, TECHNIA – International Journal of Computing Science and Communication Technologies, VOL.4 NO. 2, January 2012.

• Speech is produced by vocal folds. It involves the interaction of various body parts*. It can hurt the sound quality of the voice.

• Asthma is a lung disease that affects airflow to and fro from lungs. A whistling sound comes when asthmatic patient breathes.

* This includes various components like abdominal, ribcage, lungs, pharynx, oral cavity and nose and each performs its own function in speech production.


Asthma patient’s voice & Voice Recognition

4

Source: Rachna, Dinesh Singh, Vikas: FEATURE EXTRACTION FROM ASTHMA PATIENT’S VOICE USING MEL-FREQUENCY CEPSTRAL COEFFICIENTS(2014)

In the above graphs an analysis of mean of five vowels (a,e,i,o,u) for males and females are presented for various voice parameters like JITTER and SHIMMER of different asthma and healthy persons are compared.


Asthma patient’s voice & Voice Recognition(cont.)

• Asthma has no cure, just it can be controlled. Major risk factors are bedding dust, carpet, furniture dust, also family history or allergy.

• It can be controlled during asthma stages by doing long term meditation daily, regular check up by doctor in case of serious patients, taking some drugs through inhalers when asthma attack came etc.

• Further these extracted coefficients will be analyzed for finding similarities between patients and normal persons.

5

Source: Rachna, Dinesh Singh, Vikas: FEATURE EXTRACTION FROM ASTHMA PATIENT’S VOICE USING MEL-FREQUENCY CEPSTRAL COEFFICIENTS(2014)


Voice Analysis of Parkinson Disease & Voice Recognition

6

Sources: • Saloni, R. K. Sharma, Anil K. Gupta: Voice Analysis for Telediagnosis of Parkinson Disease Using Artificial Neural Networks and Support Vector Machines (2015)• Max A. Little, P. E. Macsharry, E. J. Hunter, J.Sielman, L. O. Raming, “Suitability Of Dysophonia Measurements for Telemonitoring of Parkinson’s Disease, IEEE Transaction on biomedical engg,Vol.

56,2009, pp 1015-1022.


The emotion detection based on speech signal analyses features

1. Pitch

2. Energy (computing Teager Energy Operator – TEO)

3. Energy fluctuation

4. Average level crossing rate (ALCR)

5. Extrema based signal track length (ESTL)

6. Liner prediction cepstrum coefficients (LPCC)

7. Mel frequency cestrum coefficients (MFCC)

8. Formants

9. Consonant vowel transition

7

Source: Batalla, J.M., Mastorakis, G., Mavromoustakis, C.X., Pallis, E.: Beyond the Internet of Things: Everything Interconnected(2017)

The OCC modelSource: Ortony, A., Clore, G.L., & Collins A. (1990). The Cognitive Structure of Emotions Cambridge Univ. Press

Reference: Dormehl, Luke (2014-04-03). The Formula: How Algorithms Solve all our Problems … and Create More. Ebury Publishing.

Quantified Self movementSelf-knowledge through numbers

(숫자를 통한 자기 이해)

Based upon speech patterns, the particular words they used, and even details as seemingly trivial as whether they said “um” or “err” – and then utilise these insights to put them through to the agent best suited for dealing with their emotional needs?

(Chicago’s Mattersight Corporation does exactly that. Based on custom algorithms, Mattersight calls its business “predictive behavioral routing”.)



Based upon speech patterns, the particular words they used, and even details as seemingly trivial as whether they said “um” or“err” – and then utilise these insights to put them through to the agent best suited for dealing with their emotional needs?(Chicago’s Mattersight Corporation does exactly that. Based on custom algorithms, Mattersight calls its business “predictive behavioral routing”.)

The man behind Mattersight’s behavioural models is a clinical psychologist named Dr Taibi Kahler. Kahler is the creator of a type of psychological behavioural profiling called Process Communication.

What Kahler noticed was that certain predictable signs precede particular incidents of distress, and that these distress signs are linked to specific speech patterns. These, in turn, led to him developing profiles on the six different personality types he saw recurring.




Based upon speech patterns, the particular words they used, and even details as seemingly trivial as whether they said “um” or“err” – and then utilise these insights to put them through to the agent best suited for dealing with their emotional needs?(Chicago’s Mattersight Corporation does exactly that. Based on custom algorithms, Mattersight calls its business “predictive behavioral routing”.)

The man behind Mattersight’s behavioural models is a clinical psychologist named Dr Taibi Kahler. Kahler is the creator of a type of psychological behavioural profiling called Process Communication. What Kahler noticed was that certain predictable signs precede particular incidents of distress, and that these distress signs are linked to specific speech patterns. These, in turn, led to him developing profiles on the six different personality types he saw recurring.

A person patched through to an individual with a similar personality type to their own will have an average conversation length of five minutes, with a 92 percent problem-resolution rate. A caller paired up to a conflicting personality type, on the other hand, will see their call length double to ten minutes – while the problem-resolution rate tumbles to 47 percent.


Personality type Personality traits How common?

“Thinkers”Thinkers view the world through data. Their primary way of dealing with situations is based upon logical analysis of a situation. They have the potential to become humourless and controlling.

1 in 4 people

“Rebels”Rebels interact with the world based on reactions. They either love things orhate them. Many innovators come from this group. Under pressure they can be negative and blameful.

1 in 5 people

“Persisters”Persisters filter everything through their opinions. Everything is measured upagainst their world view. This describes the majority of politicians.

1 in 10 people

“Harmonisers”Harmonisers deal with everything in terms of emotions and relationships. Tight situations make this group overreactive.

3 in 10 people

“Promoters”Promoters view everything through action. These are the salesmen of the world, always looking to close a deal. They can be irrational and impulsive.

1 in 20 people

“Imaginers”Imaginers deal in unfocused thought and reflection. These people operate in vivid internal worlds and are likely to spot patterns where others cannot.

1 in 10 people

Dr Taibi Kahler’s the six different personality types


2. Pause + Diffuser+ Everywhere + Life → Healthcare+ Silent UX?

Sources: • https://ksr-video.imgix.net/projects/2773429/video-742380-h264_high.mp4• https://www.kickstarter.com/projects/1947880314/kunk-smart-diffuser?ref=nav_search


SMART DIFFUSE

• Without the use of allergenic particles or solvents existent in candles and perfumes.

• No wheezing and no sneezing.

• Precisely the 124 colors of the spectrum.

• Turn on or off through voice commands or with a simple shake motion of your smart phone.

• We only utilize 100% organic oils based on natural floral water. No artificial methods are used in manufacturing, allowing us to provide a truly natural scent. We are starting with 5 basic fragrances and will continue to research and develop additional scents to meet the future needs of our customers.

17

• Source: https://www.kickstarter.com/projects/1947880314/kunk-smart-diffuser?ref=nav_search

3. Kids + Sports + Play + Space → Healthcare+ Silent UX?

Image source: http://blog.naver.com/PostView.nhn?blogId=rabu_rabu&logNo=220770319639

Image source: http://www.popphotos.net/media/BOui2GAgsD_

Image source: http://www.playtime.co.kr/brand/brand007.php


Sensing and Managing Vehicle Behavior Based on Occupant Awareness

• Disney patent would alter rides immediately based on passenger emotions

• Disney’s patents seeks to read rider’s emotions or predetermined interests to alter rides and make them more enjoyable.

• For example, the patent states that via a camera on the vehicle or a wearable ID device — say Disney's MagicBands — a ride system could read rider facial expressions such as being excited or bored, and then alter the course of the attraction to increase/decrease speed, spin more or less often, change the tone of display scenery and/or more to improve the ride for guests.

20

Sources: • http://www.bizjournals.com/orlando/news/2017/01/30/disney-patent-would-alter-rides-immediately-based.html• http://www.bizjournals.com/orlando/news/2017/01/30/disney-patent-would-alter-rides-immediately-based.html#i1

경청해주셔서고맙습니다!

silent interaction: healthcare ux,지금 우리가 질문해야 할 몇 가지

Design