basic input operations complex input operations€¦ · the advantages of these "flying...

1

111203 LMU Muumlnchen hellip Mensch-Maschine-Interaktion hellip WS0304 hellip SchmidtHuszligmann 1

Vorlesung Mensch-Maschine-Interaktion

Input devices amp technologies

Ludwig-Maximilians-Universitaumlt Muumlnchen LFE Medieninformatik

Heinrich Huszligmann amp Albrecht Schmidt WS20032004

httpwwwmedieninformatikuni-muenchende


Table of Content

Input DevicesDegree of Freedom


Basic Input OperationsText Inputbull Continuous

- Keyboard and alike- Handwriting- Spoken

bull Block- Scandigital camera

and OCR

Pointing amp Selectionbull Degree of Freedom

- 1 2 3 6 ltmoregt DOFbull Isotonic vs Isometricbull Translation functionbull Precisionbull Technologybull Feedback

Direct Mapped Controlsbull Hard wired buttonscontrols

- Onoff switch- Volume slider

bull Physical controls that can be mapped

- PalmPilot buttons- ldquointernet-keyboardrdquo buttons- Industrial applications

Media capturebull Media type

- Audio- Images- Video

bull QualityResolutionbull Technology


Complex Input OperationsExamples of tasksbull Filling a form = pointing

selection and text inputbull Annotation in photos =

image capture pointing and text input

bull Moving a group of files = pointing and selection

Examples of operationsbull Selection of objectsbull Grouping of objectsbull Moving of objectsbull Navigation in space


1D Pointing DeviceExample Computer Rope Interface

Interface to move up and downVisualisation of Rainforest vegetation at the selected heightExhibition scenarioUsers kids 4-8

httpwebmediamitedu~winCanopy20ClimbIndexhtm


Example Computer Rope Interface

2



Low tech implementationMouse scrolling


Rope Interface Video

httpwebmediamitedu~winCanopy20ClimbRope20Interface20Export2avihttpwebmediamitedu~winCanopy20ClimbTreemovieavi


Pointing Devices with 2DOF

Pointing devices such asbull Mousebull Track ballbull Touch screenbull (See last week)

Off the desktop other technologies and methods are requiredbull Virtual touch screenbull Converting surfaces into input devicesbull Human view


Virtual Touch Screen

Surfaces are converted into touch screensImagevideo is projected onto the surfaceUsing a camera (or other tracking technology) gestures are recognizedInterpretation by software

bull simple ndash where is someone pointing to

bull complex ndash gestures sign language

applicationbull Kiosk application where vandalism

is an issuebull Research prototypes hellip


Example Window Tap Interfacelocates the position of knocks and taps atop a large sheet of glasspiezoelectric pickups

bull located near the sheets corners bull record the structural-acoustic wavefrontbull relevant characteristics from these

signals - amplitudes - frequency components - differential timings

bull to estimate the location of the hitbull simple hardwarebull no special adaptation of the glass panebull knock position resolution of about s=2

cm across 15 meters of glass

httpwwwmediamiteduresenvTapper


Example Window Tap Interface


3





Example Vision-Based Face Tracking System for Large Displays

stereo-based face tracking system can track the 3D positionand orientation of a user in real-timeapplication for interactionwith a large display

httpnaka1hakoisuecacjppaperseWallUbicomp2002pdf











Smart-Board

Large touch sensitive surfaceFront or back projectionInteractive screen

4


Smart-BoardDViT (digital vision touch)

Vision based 4 cameras 100FPSNearly on any surfaceMore than one pointershttpwwwsmarttechcomdvitindexasp


Capture InteractionMimiobull Tracking of flip chart makers bull Capture writing and drawaing on a

large scale

PC Notes Takerbull Capture drawing and handwriting on

small scale


Photo CaptureWrite on traditional surfaces eg blackboard white board napkinCapture with digital camera


3D Input6 DOF Interfaces

3D input is common and required in many different domainsbull Creation and manipulation of 3D models (creating animations)bull Navigation in 3D information (eg medical images)

Can be simulated with standard input devicesbull Keyboard and text input (6 values)bull 2DOF pointing device and modesbull Gestures

Devices that offer 6 degrees of freedombull Criteria

- Speed- Accuracy- Ease of learning- Fatigue- Coordination- Device persistence and acquisition

bull Little common understanding

Translation rotation


6DOFTransfer functionbull Position control

- Free moving (isotonic) devices ndash device displacement is mappedscaled to position

bull Rate control- Force or displacement is mapped onto cursor velocity- Integration of input over time -gt first order control

Controller resistancebull Isotonic

- Displacement of device is mapped to displacement of the cursorbull Elasticbull Isometric

- Force is mapped to rate control


Analysis of Position versus Rate Control

httpveredroseutorontocapeopleshumin_dirpapersPhD_ThesisChapter2Chapter23html

5


Performance depends on transfer function and resistance

httpwwwsiggraphorgpublicationsnewsletterv32n4contributionszhaihtml


Controller resistanceIsotonicbull pressure devices force devices bull Infinite resistancebull device that senses force but does not

perceptibly move Isometricbull displacement devices free moving devices

or unloaded devices bull zero or constant resistance

Elastic Devicersquos resistive force increases with displacement also called spring-loaded Viscous resistance increases with velocity of movementInertial resistance increases with acceleration


Flying Mice (I)a mouse that can be moved and rotated in the air for 3D object manipulationMany different typeshellipflying mouse is a free-moving ie isotonic device displacement of the device is typically mapped to a cursor displacement Such type of mapping (transfer function) is also called position control

httpwwwalmadenibmcomuzhaipaperssiggraphfinalhtml


Flying Mice (II)The advantages of these flying mice devices are bull Easy to learn because of the natural direct

mapping bull Relatively fast speed

disadvantages to this class of devices bull Limited movement range Since it is position

control hand movement can be mapped to only a limited range of the display space

bull Lack of coordination In position control object movement is directly proportional to handfinger movement and hence constrained to anatomical limitations joints can only rotate to certain angle

bull Fatigue This is a significant problem with free moving 6 DOF devices because the users arm has to be suspended in the air without support

bull Difficulty of device acquisition The flying mice lack persistence in position when released


The form factor of devices has a significant impact on the pointing performance Eg Fingerball vs glove


Stationary devices (I)devices that are mounted on stationary surface Have a self-centering mechanismThey are either isometric devices that do not move by a significantly perceptible magnitude or elasticdevices that are spring-loaded Typically these devices work in rate control mode ie the input variable either force or displacement is mapped onto the velocity of the cursor The cursor position is the integration of input variable over time


Stationary devices (II)isometric device (used with rate control) offers the following advantages bull Reduced fatigue since the users arm can be rested on the desktop bull Increased coordination The integral transformation in rate control

makes the actual cursor movement a step removed from the hand anatomy

bull Smoother and more steady cursor movement The rate control mechanism (integration) is a low pass filter reducing high frequency noises

bull Device persistence and faster acquisition Since these devices stay stationary on the desktop they can be acquired more easily

isometric rate control devices may have the following disadvantages bull Rate control is an acquired skill A user typically takes tens of minutes

to gain controllability of isometric rate control devicesbull Lack of control feel Since an isometric device feels completely rigid

6


Multi DOF Armaturesmulti DOF input devices are mechanical armatures the armature is actually a hybrid between a flying-mouse type of device and a stationary device Can be seen as a are near isotonic - with exceptional singularity positions -position control device (like a flying mouse)has the following particular advantages

bull Not susceptible to interference bull Less delay response is usually better than most flying mouse technologybull Can be configured to stay put when friction on joints is adjusted and therefore

better for device acquisition

drawbacks bull Fatigue as with flying mouse bull Constrained operation The user has to carry the mechanical arm to operate At

certain singular points positionorientation is awkward

This class of devices can also be equipped with force feedback see later Phantom Device


Technology ExamplesData Glove

Data glove to input information about

bull Orientation (roll pitch)bull Angle of jointsbull Sometimes position (external

tracking)

Time resolutionabout 150200 Hz

Precision (price dependent)bull Up to 05 deg for expensive

devices(gt 10000 euro)

bull Cheap devices (euro100) much less


Technology Examples3D-Mouse

Spacemouse und Spaceballbull Object (eg Ball) is elastically mountedbull Pressure pull torsion are measuredbull Dynamic positioning

6DOF

httpwwwalsoscomProductsDevicesSpaceBallhtml111203 LMU Muumlnchen hellip Mensch-Maschine-Interaktion hellip WS0304 hellip SchmidtHuszligmann 34

Technology Examples3D-Graphic Tablet

Graphic tablets with 3 dimensionsTracking to aquire spacialposition (eg using Ultrasound)


Basic Problem with a single 2DOF Pointing Device

With 2DOF most often time multiplexing is impliedOne operation at the time (eg slider can be only be moved sequentially with the mouse)


Interactive Modelling(Merl)

httpwwwmerlcompapersTR2000-13

7


Interactive Modelling (Merl)httpwwwmerlcompapersTR2000-13


Interactive ModellingCont (Merl)



ReferencesComputer Rope Interfacehttpwebmediamitedu~winCanopy20ClimbIndexhtm

Sensor Systems for Interactive Surfaces J Paradiso K Hsiao J Strickon J Lifton and A Adler IBM Systems Journal Volume 39 Nos 3 amp 4 October 2000 pp 892-914 httpwwwresearchibmcomjournalsj393part3paradisohtml

Window Tap InterfacehttpwwwmediamiteduresenvTapper

Vision-Based Face Tracking System for Large Displayshttpnaka1hakoisuecacjppaperseWallUbicomp2002pdf




Logitech iFeel Mousehttpwwwdansdatacomifeelhtm

Exertion Interfaces httpwwwexertioninterfacescomtechnical_detailsindexhtm

2



Low tech implementationMouse scrolling


Rope Interface Video

httpwebmediamitedu~winCanopy20ClimbRope20Interface20Export2avihttpwebmediamitedu~winCanopy20ClimbTreemovieavi


Pointing Devices with 2DOF

Pointing devices such asbull Mousebull Track ballbull Touch screenbull (See last week)

Off the desktop other technologies and methods are requiredbull Virtual touch screenbull Converting surfaces into input devicesbull Human view


Virtual Touch Screen

Surfaces are converted into touch screensImagevideo is projected onto the surfaceUsing a camera (or other tracking technology) gestures are recognizedInterpretation by software

bull simple ndash where is someone pointing to

bull complex ndash gestures sign language

applicationbull Kiosk application where vandalism

is an issuebull Research prototypes hellip


Example Window Tap Interfacelocates the position of knocks and taps atop a large sheet of glasspiezoelectric pickups

bull located near the sheets corners bull record the structural-acoustic wavefrontbull relevant characteristics from these

signals - amplitudes - frequency components - differential timings

bull to estimate the location of the hitbull simple hardwarebull no special adaptation of the glass panebull knock position resolution of about s=2

cm across 15 meters of glass





3


















Smart-Board


4






large scale


small scale





















5































6












tracking)








6DOF










7
















3


















Smart-Board


4






large scale


small scale





















5































6












tracking)








6DOF










7
















4






large scale


small scale





















5































6












tracking)








6DOF










7
















5































6












tracking)








6DOF










7
















6












tracking)








6DOF










7
















7
















basic input operations complex input operations€¦ · the advantages of these "flying...

Documents