inputdevices-090902030649-phpapp01
TRANSCRIPT
-
8/11/2019 inputdevices-090902030649-phpapp01
1/60
Amir Dotan - www.amirdotan.com
Input Devices
-
8/11/2019 inputdevices-090902030649-phpapp01
2/60
Amir Dotan - www.amirdotan.com
Input evolution
As computers become smaller and ubiquitous(everywhere and in everything), they can not graball of our attention (sitting in front of a screen)
and their size doesnt allow us to use are fingersto communicate with them
Alternative input methods (speech, movement,gazing) are considered as ways to makecomputing less attention demanding and more
intuitive (Accessibility benefits)
-
8/11/2019 inputdevices-090902030649-phpapp01
3/60
Amir Dotan - www.amirdotan.com
Input evolution
Punch cards
Keyboard
Mouse
Face recognition Facial expression
Gaze / eye movement
Touch / Multi-Touch
Speech recognition
Body movement (gestures)
-
8/11/2019 inputdevices-090902030649-phpapp01
4/60
Amir Dotan - www.amirdotan.com
-
8/11/2019 inputdevices-090902030649-phpapp01
5/60
Amir Dotan - www.amirdotan.com
Punch Cards
-
8/11/2019 inputdevices-090902030649-phpapp01
6/60
Amir Dotan - www.amirdotan.com
Text Entry Input - Keyboards
and Keypads The primary mode of textual data entry
Keyboard size and packaging influences userssatisfaction and usability
Large keyboards with many keys give animpression of professionalism and complexitybut may deter novice users
Small keyboards seem lacking in power to someusers, but their compact size is an attraction formobile devices
-
8/11/2019 inputdevices-090902030649-phpapp01
7/60
Amir Dotan - www.amirdotan.com
The QWERTY layout
The most commonly used keyboard layout is theQWERTY layout
Also known as the Sholes keyboard, it was
invented by Christopher Sholes who invented thetypewriter in 1868
His layout slowed down users enough that keyjamming was infrequent
-
8/11/2019 inputdevices-090902030649-phpapp01
8/60
Amir Dotan - www.amirdotan.com
Dvorak Layout (Schneiderman, 2005)
Developed in the 1920s, supposedly reducesfinger travel, thereby increasing the typing rate ofexpert typists from about 150 words per minute
to more than 200 words per minute Acceptance of the Dvorak layout has been very
limited, despite the work of devotees
People who have tried it report that it takes abouta week of regular typing to make the switch, but
most users have been unwilling to invest mucheffort
-
8/11/2019 inputdevices-090902030649-phpapp01
9/60
-
8/11/2019 inputdevices-090902030649-phpapp01
10/60
Amir Dotan - www.amirdotan.com
The Keyboard
-
8/11/2019 inputdevices-090902030649-phpapp01
11/60
Amir Dotan - www.amirdotan.com
Alternative Ergonomic and
Adjustable Keyboards
-
8/11/2019 inputdevices-090902030649-phpapp01
12/60
-
8/11/2019 inputdevices-090902030649-phpapp01
13/60
Amir Dotan - www.amirdotan.com
Keyboards and Keypads for
Mobile Devices
http://amirdotan.multiply.com/video/item/98/The_Evolution_of_Mobile_Phones_1985_-_Today
-
8/11/2019 inputdevices-090902030649-phpapp01
14/60
Amir Dotan - www.amirdotan.com
Keyboards and Keypads for
Mobile Devices Mobile-phone functionalities are increasing
considerably while their size is still shrinking
Most devices combine normal static keys with
dynamically labelled softkeys whose functionsare dependent on status and context
-
8/11/2019 inputdevices-090902030649-phpapp01
15/60
Amir Dotan - www.amirdotan.com
Alternative Mobile Phone
Keypads
http://www.digitwireless.com Nokia 7600
-
8/11/2019 inputdevices-090902030649-phpapp01
16/60
Amir Dotan - www.amirdotan.com
Pointing Devices
A device such as a mouse, trackball, or graphicstablet that allows users to move a pointer abouton the workspace and point to graphical objects
A direct-manipulation approach - No need tolearn commands or type, attention is focused onthe display
Important for small devices and large walldisplays that make keyboards impractical as
input devices
-
8/11/2019 inputdevices-090902030649-phpapp01
17/60
Amir Dotan - www.amirdotan.com
Pointing Devices
Direct control devices Lightpen
Touchscreen (Single input point)
Multitouch (Multiple and simultaneous input points)
Stylus
Indirect control devices Mouse
Trackball
Joystick
Touchpad
Trackpoint (for laptops)
Graphics tablet
Novel devices and strategies Foot controls
Eye tracking
DataGloves
Tangible user interfaces
Digital paper
Haptic feedback
-
8/11/2019 inputdevices-090902030649-phpapp01
18/60
-
8/11/2019 inputdevices-090902030649-phpapp01
19/60
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- The Lightpen (MITs Sketchpad 1963)
-
8/11/2019 inputdevices-090902030649-phpapp01
20/60
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- The Lightpen Had several disadvantages:
Users arm got tired
Users hand obscured part of the screen
Users had to remove their hands from thekeyboard to pick up the lightpen
The lightpen was too fragile for public-accessenvironments
-
8/11/2019 inputdevices-090902030649-phpapp01
21/60
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- Touch Screen
-
8/11/2019 inputdevices-090902030649-phpapp01
22/60
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- The Stylus
-
8/11/2019 inputdevices-090902030649-phpapp01
23/60
Amir Dotan - www.amirdotan.com
An Alternative to the Stylus -
Shift (Microsoft Research)
http://uk.youtube.com/watch?v=kkoFlDArYks
http://research.microsoft.com/users/baudisch/projects/shift/index.html
-
8/11/2019 inputdevices-090902030649-phpapp01
24/60
Amir Dotan - www.amirdotan.com
Indirect-Control Pointing
Devices(Schneiderman, 2005)
Eliminate the hand-fatigue and hand-obscuring-the-screen problem
They do however require the hand to locate the
device and demand more cognitive processingand hand/eye coordination to bring the onscreencursor to the desired target
Among the indirect pointing devices the mousehas been the most popular
-
8/11/2019 inputdevices-090902030649-phpapp01
25/60
Amir Dotan - www.amirdotan.com
Pointing Device - The Mouse
On December 9, 1968 in San Francisco, Douglas Engelbart
presented for the first time the computer mouse
http://uk.youtube.com/watch?v=1MPJZ6M52dI
-
8/11/2019 inputdevices-090902030649-phpapp01
26/60
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
Multi-Touch Input
-
8/11/2019 inputdevices-090902030649-phpapp01
27/60
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- Multi-Touch Input
http://uk.youtube.com/watch?v=9zGDNFpOMcA
http://amirdotan.multiply.com/video/item/56/iBar_-_Interactive_Bar_largest_multitouch_touchscreen
-
8/11/2019 inputdevices-090902030649-phpapp01
28/60
Amir Dotan - www.amirdotan.com
Direct-Control Pointing Device
- Multi-Touch Input
http://amirdotan.multiply.com/video/item/47/Microsoft_Surface_Business_2.0_Demo
-
8/11/2019 inputdevices-090902030649-phpapp01
29/60
Amir Dotan - www.amirdotan.com
Touch Input Gestures
-
8/11/2019 inputdevices-090902030649-phpapp01
30/60
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
Small controls are difficult to use
The size of the controls greatly affects your ability
to interact effectively. Controls that are at least
23x23 pixels are usable with a finger, but largercontrols of at least 40x40 pixels are even more
comfortable to use
-
8/11/2019 inputdevices-090902030649-phpapp01
31/60
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
Task locality helps
While you can move the pointer across a 14-inchscreen with a 3-inch mouse movement, using
touch requires you to move your hand the full 14inches
Repeatedly moving between targets that are farapart can be tedious, so it's much better to keeptask interactions within the range of a resting handwhenever possible
Context menus are convenient because theyrequire no hand movement
-
8/11/2019 inputdevices-090902030649-phpapp01
32/60
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
Hover must not be required
Most touchscreen technologies don't detect a
hovering finger, even if they can detect a hovering
pen. If a program has tasks that depend on hover,you won't be able to perform them efficiently using
touch
-
8/11/2019 inputdevices-090902030649-phpapp01
33/60
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
Text input and selection are difficult
Lengthy text input is especially difficult using
touch, so auto-completion and acceptable default
text values can really simplify tasks. Text selectioncan also be quite difficult
-
8/11/2019 inputdevices-090902030649-phpapp01
34/60
Amir Dotan - www.amirdotan.com
Touch Input - Considerations(Windows Vista User Experience "Touch" guidelines)
Small targets near the edge of the display can
be very difficult to touch
Some touchscreen technologies are less sensitive
at the edges, making controls near the edge
harder to use. For example, the Minimize,
Maximize/Restore, and Close buttons on the title
bar can be harder to use when a window is
maximized
-
8/11/2019 inputdevices-090902030649-phpapp01
35/60
-
8/11/2019 inputdevices-090902030649-phpapp01
36/60
Amir Dotan - www.amirdotan.com
Comparison of Pointing
Devices Each input device has its strengths and
weaknesses
The keyboard is best for text input and giving
commands with minimal hand movement The mouse is best for efficient, precise pointing
Touch is best for object manipulation and givingsimple commands
A pen is best for freeform expression, as withhandwriting and drawing
-
8/11/2019 inputdevices-090902030649-phpapp01
37/60
Amir Dotan - www.amirdotan.com
Comparison of Pointing
Devices(Schneiderman, 2005)
Early studies found that direct pointing devicessuch as a lightpen or touchscreen were often thefastest but the least accurate
Studies have shown that the mouse is the moreaccurate and efficient than alternative devices
Users tasks matter when comparing devices
Joysticks and trackball are often preferred overmice by users with motor disabilities
-
8/11/2019 inputdevices-090902030649-phpapp01
38/60
Amir Dotan - www.amirdotan.com
Comparison of Pointing
Devices(Schneiderman, 2005)
Pointing devices, especially indirect-controldevices such as the mouse, are particularlychallenging for users who have vision
impairments - Well designed cursors andadjustable size and shape can help
Alternative keyboard or keypad navigationoptions should be provided whenever possible
-
8/11/2019 inputdevices-090902030649-phpapp01
39/60
Amir Dotan - www.amirdotan.com
Novel Devices (Schneiderman, 2005)
The popularity of pointing devices and the questfor new ways to engage diverse users for diversetasks has led to provocative innovations
Since users hands might be busy on thekeyboard, designers have explored othermethods for selection and pointing
In some cases, the device is too small or too bigto be used with a keyboard or a conventional
pointing device
-
8/11/2019 inputdevices-090902030649-phpapp01
40/60
Amir Dotan - www.amirdotan.com
Gestural Interface
Head gestures
Hand gestures
Body gestures
-
8/11/2019 inputdevices-090902030649-phpapp01
41/60
Amir Dotan - www.amirdotan.com
Gestural Interface
-
8/11/2019 inputdevices-090902030649-phpapp01
42/60
Amir Dotan - www.amirdotan.com
Gestural Interface - Example
G-Speak http://vimeo.com/2229299
-
8/11/2019 inputdevices-090902030649-phpapp01
43/60
Amir Dotan - www.amirdotan.com
Gestural Interface - Example
http://amirdotan.multiply.com/video/item/148/HITACHI_Gesture_operation_TV
-
8/11/2019 inputdevices-090902030649-phpapp01
44/60
-
8/11/2019 inputdevices-090902030649-phpapp01
45/60
Amir Dotan - www.amirdotan.com
Gestural Interface - Example
http://amirdotan.multiply.com/video/item/80/ShadowReaching_New_Perspective_on_Wall_Display_Interaction
-
8/11/2019 inputdevices-090902030649-phpapp01
46/60
-
8/11/2019 inputdevices-090902030649-phpapp01
47/60
Amir Dotan - www.amirdotan.com
Gestural Interface - Example
http://uk.youtube.com/watch?v=7uixUmxH-Z0
-
8/11/2019 inputdevices-090902030649-phpapp01
48/60
-
8/11/2019 inputdevices-090902030649-phpapp01
49/60
Amir Dotan - www.amirdotan.com
Wii Fit
-
8/11/2019 inputdevices-090902030649-phpapp01
50/60
Amir Dotan - www.amirdotan.com
Input - Using physical objects
http://amirdotan.multiply.com/video/item/101/reactable_basic_demo_
-
8/11/2019 inputdevices-090902030649-phpapp01
51/60
Amir Dotan - www.amirdotan.com
Eye tracking systems
Our eyes are an essential output device with isused to point to objects. We use it tocommunicate to the world our intents (Eyecontact)
Combined with head gesture, this method ofpointing can be a powerful communicationchannel
-
8/11/2019 inputdevices-090902030649-phpapp01
52/60
Amir Dotan - www.amirdotan.com
Eye tracking - Example
Squidoo EyeTracking
http://www.youtube.com/watch?v=ilq9qeyVjT0
-
8/11/2019 inputdevices-090902030649-phpapp01
53/60
Amir Dotan - www.amirdotan.com
The future?
Gamers will soon be able to interact
with the virtual world using their
thoughts and emotions alone.
BBC NEWS 20.02.08
http://news.bbc.co.uk/1/hi/technolo
gy/7254078.stm
-
8/11/2019 inputdevices-090902030649-phpapp01
54/60
Amir Dotan - www.amirdotan.com
Thought Control
http://amirdotan.multiply.com/video/item/81/Brainloop_-_Thought_Control
-
8/11/2019 inputdevices-090902030649-phpapp01
55/60
Amir Dotan - www.amirdotan.com
Speech and Auditory Input(Schneiderman, 2005)
Hardware designers have made dramaticprogress with speech recognition, generation,and processing but current success are far from
achieving the results we see in Sci-Fi movies They also recognize that voice commanding is
more demanding of users working memory thanis hand/eye coordination and thus may be moredisruptive to users while they are carrying out
tasks
-
8/11/2019 inputdevices-090902030649-phpapp01
56/60
Amir Dotan - www.amirdotan.com
Speech and Auditory Input(Schneiderman, 2005)
Planning and problem solving can proceed inparallel with hand/eye coordination, but they aremore difficult to accomplish while speaking
Background noise and variations in users speechperformance make the challenge of speechrecognition still greater
The benefits to people with certain disabilitiescan be immense, but general users are not
rushing to implement speech input
-
8/11/2019 inputdevices-090902030649-phpapp01
57/60
Amir Dotan - www.amirdotan.com
Speech Systems -
Opportunities(Schneiderman, 2005)
When users have vision impairments
When the speakers hands are busy
When mobility is required
When the speakers eyes are occupied
When harsh or cramped conditions preclude useof a keyboard
-
8/11/2019 inputdevices-090902030649-phpapp01
58/60
Amir Dotan - www.amirdotan.com
Speech Systems -
Technologies(Schneiderman, 2005)
Discrete-word recognition -
Recognize individual words spoken by a specificperson
90%-98% reliable 100-10000-word or larger vocabularies
Continuous-speech recognition
-
8/11/2019 inputdevices-090902030649-phpapp01
59/60
Amir Dotan - www.amirdotan.com
Speech recognition -
Examples
Flight Simulator Voice Recognition
http://www.youtube.com/watch?v=wZf9Ni6Qocc
Speech recognition in Windows Vista
http://www.youtube.com/watch?v=v9o72XJcFQI
-
8/11/2019 inputdevices-090902030649-phpapp01
60/60
Amir Dotan - www.amirdotan.com
Speech recognition -
Examples
Google Mobile App for iPhone, now with Voice Search
http://uk.youtube.com/watch?v=y3z7Tw1K17A