papaer4 ea

19
[1] Fit Your Hand: Personalized User Interface Considering Physical Attributes of Mobile Device Users Authors: Hosub Lee and Young Sang Choi Samsung Electronics Co., Ltd., Source: ACM. UIST’11, (October 16–19, 2011), Santa Barbara, California, USA. [2] BLUI: Low-cost Localized Blowable User Interfaces Authors: Shwetak N. Patel and Gregory D. Abowd Georgia Institute of Technology, Source: ACM. UIST’07, (October 7–10, 2007), Newport, Rhode Island, USA. http://www.youtube.com/watch?v=34SEm

Upload: selina-chang

Post on 01-Nov-2014

263 views

Category:

Technology


1 download

DESCRIPTION

presentation

TRANSCRIPT

Page 1: Papaer4 ea

[1] Fit Your Hand: Personalized User Interface Considering Physical Attributes of Mobile Device Users Authors: Hosub Lee and Young Sang Choi Samsung Electronics Co., Ltd., Source: ACM. UIST’11, (October 16–19, 2011), Santa Barbara, California, USA.

[2] BLUI: Low-cost Localized Blowable User Interfaces Authors: Shwetak N. Patel and Gregory D. Abowd Georgia Institute of Technology, Source: ACM. UIST’07, (October 7–10, 2007), Newport, Rhode Island, USA. http://www.youtube.com/watch?v=34SEmMxbNkQ

Page 2: Papaer4 ea

[3] WUW - Wear Ur World - A Wearable Gestural Interface Authors: Pranav Mistry and Pattie Maes and Liyan Chang MIT Media Lab , Source: ACM. CHI 2009,( April 4 -9, 2009), Boston, MA, USA http://www.pranavmistry.com/projects/sixthsense/

[4] Light-tech Interaction Used in Ubiquitous Interface Design Authors: Feng Xian Tsinghua University , Source: ACM. RDURP’11, (September 18, 2011), Beijing, China.Adviser: Geeng Neng You Speaker: 張靜蓉 Date: 2012/01/3

Page 3: Papaer4 ea

User interface WUW BLUI FUH Light-tech

Name of interface

Wearable Ur World

Localized Blowable User Interfaces

Fit Your Hand Light-tech Interaction

Scenario Augmented Reality

EntertainmentAssistive technology

Easy-to-touch positions

Ubiquitous

Usage Freehand Gestures

Hands-free Interaction

Handedness Face /visual recognition

Operation 1. Gestures supported by multi-touch systems 2. Freehand gestures 3. Iconic gestures

BlowableSelectionScrollingDraggingPhysical Blow Metaphor

HandednessLeft-handerRight-handerFinger lengthUsage habits

Emotional lampof Chameleon

Page 4: Papaer4 ea

Expression Intuitive experience of full-sized gestural systems

Intuitive directly control certain interactiveLocalized Blowable

Intuitive user interactionDynamically reformulatesthe layout

Intuitive Emotional recognition

Equipment Laptop ProjectorCameraColor markers

Laptop Computer screenMicrophone

SmartphoneTablet

Laptop Computer screen

Application Microsoft Windows platform using C#, WPF and openCV.

C++ applicationJava applicationconnects via a TCP connection FFT application Machine learningKNN

Divided interface into 3x3 , 4x4, 5x5, 6x6 regions

AndroidMachinelearning algorithm

Divided interface into4x5=20 cells

MCUs (Microprocessor Control Unit) used in Arduino, which is a very popularopen-source interactive hardware platform

Page 5: Papaer4 ea

Fit Your Hand: Personalized User Interface Considering Physical Attributes of Mobile Device Users

A mobile user interface.Dynamically reformulates the

layout. Integrate machine learning

algorithm. It infers users’ physical

characteristics.handedness, finger length, or usage habits.

Calculates the optimal touch area for the user.

[1]

Page 6: Papaer4 ea

Workflow of the Proposed System

A03=11×1.3=14.3

A12=13×1.3=16.9

A13=16×1.3=20.8

A21=22×1.3=28.6

A22=18×1.3=23.4

A30=20×1.3=26

A40=13×1.3=16.9

A41=15×1.3=19.5

Page 7: Papaer4 ea

The User Interface Architecture

Page 8: Papaer4 ea

Implementation

Page 9: Papaer4 ea

BLUI: Low-cost Localized Blowable User Interfaces A unique form of hands-free

interaction. Blowing at a laptop or computer

screen to directly control . Localization where on the screen the

person is blowing. Rely solely on a single microphone. Java application performs the machine

learning.

[2]

Use k-Nearest Neighbor (KNN) classification for inferring which of those regions is targeted.

Page 10: Papaer4 ea

Selection Hands-free way to directly select objects.Scrolling Top or the bottom of the scroll bar

(vertical) to cause the page to move.Dragging Panning a document or cursor

movements.Physical Blow Metaphor Gaming or entertainment applications. Use blowing to richly convey a physical

phenomenon. Blowing out birthday candles, dust & whack-a-mole.

Page 11: Papaer4 ea

BLUI uses real-time audio analysis and fingerprinting on the incoming microphone data.

Wind noise produces a broadband frequency response through the microphone , which is very high in amplitude for low frequency components.

Event-based system. The BLUI engine recognizes blowing activity. Application programmers can register

callbacks for these blowing events. Create special purpose widgets that

respond appropriately.

Page 12: Papaer4 ea

Performance of the BLUI localizer for various resolutions (% of correctly identified regions).

25-50 blows

Page 13: Papaer4 ea

WUW - Wear Ur World - A Wearable Gestural Interface

Bring information out into the tangible world.

Projector and the camera are mounted on a hat.

Coupled in a pendant like wearable device.

Connected to laptop.

[3]

Page 14: Papaer4 ea
Page 15: Papaer4 ea

Stylus-based interface

intuitive experience of full-sized gestural systems.

Page 16: Papaer4 ea

Light-tech Interaction Used in Ubiquitous Interface Design

Light-tech interaction as a methodology used for realize ubiquitous interface.

Light-tech interaction modules should be low power consumption and embedded.

Microprocessor Control Unit (MCU) is usually the core of a product.

The light-tech interaction means that using light-tech approaches to help users interact with products more learnable and natural.

[4]

Page 17: Papaer4 ea

Emotional lamp uses visual recognition technology to detect people and transmit signals via embedded MCU modules or network directly to local devices or the far-end.

The receiver controlled by an Arduino based module in local or in remote will turn on lamp when signals received.

The lamp can recognize human’s expressions and emotions.

When person is happy, the lamp will turn to the warm tone, whereas it will turn to the cold tone to calm person down whenever a person seems angry or fury.

Page 18: Papaer4 ea

Toy design prototype. The main structure of it is made by handiwork in where a micro RFID module is embedded as the sensor and reader.

Page 19: Papaer4 ea

When children put different cards or models on the game board, the computer, which connected to the game zone, will receive the id of them.

And then the computer will play different interactive content to users according to the id. This toy is benefit for kids’ social emotional development when kids play with each other or with parents.