Mobile and Physical Interaction 1WS 2010/2011
A brief history of HCI
Mobile and Physical Interaction 2WS 2010/2011
A brief history of HCI• 50s - Interface at the hardware level for engineers - switch
panels• 60-70s - interface at the programming level - COBOL,
FORTRAN• 70-90s - Interface at the terminal level - command
languages • 80s - Interface at the interaction dialogue level - GUIs,
multimedia• 90s - Interface at the work setting - networked systems,
groupware • 00s - Interface becomes pervasive
– Interactive screens, mobile devices, physical interfaces
Mobile and Physical Interaction 3WS 2010/2011
Overview of Input/Output
Human Computer• Past
– by design / electronics– wires and switches– punch cards, teletype
• Today– keyboard– mouse/touch pad
• Future– speech– gestures– touch– eye-gaze– EEG, EMG– implicit observation/ubicomp– emotions
Computer Human• Past
– lamps, led– printer, paper– Screens (tubes)
• Today– TFT Screens– speaker
• Future – haptic output– changing physical
environments/ubicomp – smell output– Direct muscle and nerve
connection– emotions
Mobile and Physical Interaction 4WS 2010/2011
Early Computer Operators and Engineers
From http://www.computerhistory.org
Mobile and Physical Interaction 5WS 2010/2011
Foundations for Interactive Information Processing
Vannevar Bush• As we may think (1945)
article in Atlantic Monthly• Sees the Problem of
storing, accessing, distributing, and annotating information
• Understands the wealth of large amounts of information and easy access to it
• Identifies organization of information as key issue
• MEMEX– Extending human memory– Concept of links and
annotations– Focus on search and
indexing– Many ideas for the WWW
• “microfilm-age” solutions not really feasible
Read the shortened and translated version:http://homepages.uni-paderborn.de/winkler/bush_d.html
Full article:http://www.theatlantic.com/doc/194507/bush
Mobile and Physical Interaction 6WS 2010/2011
Inventing Interaction Technologies
Ivan Sutherland• SketchPad (1963)
– Drawing package– User interface included:
• icons, • copying, • light-pen input
– Development based on “OO”-principles
– Many ideas are still in use
• 3D Head-mounted Display (1965-1970)
– 3D “visualization” (very basic)– Large apparatus
Mobile and Physical Interaction 7WS 2010/2011
Inventing Interaction Technologies
Douglas Engelbart• A Conceptual Framework
for Augmenting Human Intellect (SRI Report, 1962)
• Understand need for collaborative (several potentially distributed people together) and immediate problem solving
• A key issue is to improve peoples abilities to make use of information
• Invention of the mouse (1964) as pointing device
• Hi-res video conferencing, shared applications, window-concept (1968)
Mobile and Physical Interaction 8WS 2010/2011
People shaped HCI
• Vannevar Bush • Douglas Engelbart• Ivan Sutherland • …• J.C.R. Licklider
– man-computer symbiosis (1960)– Interactive computing
• Alan Kay– Vision of a notebook computer Dynabook (1969)– Mockup to convey the idea – Computing for everyone
• Many others…• …
htt
p://
ww
w.ib
iblio
.org
/pio
nee
rs/li
cklid
er.
htm
l
http://www.ida.liu.se/~ETE257/timetable/oop_introduktion.html
Mobile and Physical Interaction 9WS 2010/2011
Brief History of HCI: Lessons learned
• It is about the vision• Technology (and understanding of technology) plays an
important role• Interactive prototypes and demos have great value
Mobile and Physical Interaction 10WS 2010/2011
Mobile: How Times Have Changed
• “In 1954, the Marquis of Donegal heard that the Duke of Edinburgh possessed a mobile radio set with which he phoned through to Buckingham Palace – and anyone else on the network – while driving in London. The Marquis was more than a little jealous, and enquired of the postmaster general whether he, too, could have such a telephone. The polite but firm reply was “no”. In the mid-1950s, if you were the husband of the Queen you could have a mobile telephone connection to the public network. But if you were a mere marquis, you could go whistle.”
Agar, J.: Learning from the mobile phone. Journal of the Royal Society of Arts, pp. 26-27, January 2004.
Mobile and Physical Interaction 11WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 1876 telephone invented by Alexander Graham Bell
– February 14, 1876: “Improvement in Telegraphy” was filed at the USPTO
– A few hours later Elisha Gray filed “Transmitting Vocal Sounds Telegraphically”
– Bell was the 5th entry of that day, Gray was 39th
Mobile and Physical Interaction 12WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 1894 Guglielmo Marconi invents the radiotelegraph
– 1909 Nobel Prize in Physics “in recognition of contributions to the development of wireless telegraphy”
• 1921 combination of telephone and radio
– Officers at Detroit Michigan Police Department communicate from petrol car to petrol car
Mobile and Physical Interaction 13WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 1938 Canadian Alfred J. Gross invents the walkie-talkie (also invented telephone pager and cordless telephone)
– “I was born thirty-five years too soon. If I still had the patents on my inventions, Bill Gates would have to stand aside for me.”
• 1946 AT&T first commercial mobile telephone service for private customers
Mobile and Physical Interaction 14WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices• 1962 Telstar first active communications
satellite– Designed to transmit telephone and high-
speed data communications
• 1968 Alan Kay’s Dynabook– Vision of a portable computer
– “The Dynabook will have considerable local storage and will do most computing locally, it will spend a large percentage of its time hooked to various large, global information utilities which will permit communication with others of ideas, data, working models, as well as the daily chit-chat that organizations need in order to function. The communications link will be by private and public wires and by packet radio.”
http://www.artmuseum.net/w2vr/archives/Kay/01_Dynabook.html
Mobile and Physical Interaction 15WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 1969 (D)ARPA begins the Internet programme
• 1971 Ray Tomlinson invents electronic mail (including “@”)
• 1971 James Fergason invents Liquid Crystal Displays, first LCD watches,
– electro-optical effect discovered in 1962– 1970 “twisted nematic field effect” patented
in Switzerland
• 1973 Sharp LCD calculator
Mobile and Physical Interaction 16WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 1972 Motorola prototype for Portable Radio Telephone “DynaTAC” (Dynamic Adaptive Total Area Coverage)
– First mobile phone call April 3, 1973– DynaTAC 8000X first mobile telephone
• could connect to the telephone network• could be carried about by the user
• 1978 Commercial mobile phone service in Japan by NTT
– First city-wide cellular network
• 1979 Sony Walkman TPS-L2
Martin Cooper (consi-dered as the inventor of the mobile phone)
Mobile and Physical Interaction 17WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 1980 Nintendo “Ball”– First commercially successful mobile
LCD screen game
• 1982 Digital phone exchange in Europe
• 1984 Psion 1– First PDA (personal digital assistant)– Clock, calendar, address book,
calculator
Mobile and Physical Interaction 18WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 1987 text message service is launched in Japan
• 1989 first of 24 GPS satellites of current constellation is put into orbit (Block II)
• 1992 first mobile phone for digital networks
– Motorola International 3200 (500g)
• 1993 Apple Newton MessagePad 100– 5.5" screen, 240x320 pixels, touch screen
Mobile and Physical Interaction 19WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 1996 Palm Pilot– 4" screen, 160x160 pixels
• 1996 Nokia Communicator smartphone
• 1999 DoCoMo lauches i-mode– First mobile Internet service
• 2000 first Bluetooth phone – Ericsson T36
• 2000 first camera phone– Sharp J-SH04– 110k pixel CMOS sensor
Mobile and Physical Interaction 20WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 2001 debut of the iPod– 2" screen, 160x128 pixels, 10000 songs
• 2002 number of mobile phone subscribers exceeds number of landline subscribers
• 2004 PDA with OLED screen– Sony Clie VZ-90– 3.8" screen, 460x320 pixels
• 2004 first device using e-paper– Sony LIBRIé ebook reader– 6" screen, 800x600 pixels, 170 dpi
Mobile and Physical Interaction 21WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 2004 Playstation Portable– 4.3" 16:9 wide screen, 480x272 pixels
• 2005 first mobile phone with integrated motion control sensor
– Sharp V603SH– 2.4" screen, 320x240 pixels
Mobile and Physical Interaction 22WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 2007 iPhone– GSM EDGE, WiFi, Bluetooth– 3.5" screen, 320x480 pixels– Multi-touch display, no keypad– Accelerometer to sense orientation– Slide and multi-touch interactions
cover flow
multi-touch (“pinch out”)sliding
Mobile and Physical Interaction 23WS 2010/2011
Brief History of Mobile Devices and Telecommunication Devices
• 2008 Android– http://code.google.com/android/ project part of this lecture
Copy & pasteBrowser links
Mobile and Physical Interaction 24WS 2010/2011
Today
Mobile and Physical Interaction 25WS 2010/2011
Mobile: Today More Mobile Phones than PCs
http://www.itu.int/newsroom/press_releases/2008/29.html
• Mobile subscribers– 4 billion in late 2008– World population 6.8 bn
• BRIC countries one third and fastest growing
– Brazil, Russia, India, China
– 1.3 bn mobile subscribers by end of 2008
• Europe– More than 1 mobile phone per inhabitant in some countries
Mobile and Physical Interaction 26WS 2010/2011
Few PC’s, many Mobiles, tons of Microcontrollers
• 1 billion PC’s installed (2008)• 4 billion mobile phone subscribers (2008)• 4 billion 8-bit microcontrollers sold per year (2006).
Mobile and Physical Interaction 27WS 2010/2011
Characteristics of Mobile and Physical Interaction• Interruptions
– From environment or device itself– Short attention periods
• Changing environments– Noise, lighting conditions
• Full concentration on device impossible– Cognitive capacity shared with other tasks
• Presence of others, social situation– Incoming call changes social situation
• Importance of events in environment– Environment provides relevant information– Acting in the environment based on combination