leonardo's laptop: human needs and the new computing ben shneiderman founding director...

Leonardo's Laptop: Leonardo's Laptop: Human Needs and the New ComputingHuman Needs and the New Computing

Ben ShneidermanBen ShneidermanFounding Director (1983-2000), Human-Computer Interaction Laboratory Founding Director (1983-2000), Human-Computer Interaction Laboratory

Professor, Department of Computer ScienceProfessor, Department of Computer ScienceMember, Institutes for Advanced Computer Studies &Member, Institutes for Advanced Computer Studies &

Systems ResearchSystems Research

University of MarylandUniversity of Marylandben@cs.umd.eduben@cs.umd.edu

Human-Computer Interaction Laboratory

Interdisciplinary research community - Computer Science & Psychology - Information Studies & Education (www.cs.umd.edu/hcil)

Scientific ApproachScientific Approach (beyond user friendly)(beyond user friendly)

Specify users and tasksSpecify users and tasks Predict and measurePredict and measure

time to learntime to learn speed of performancespeed of performance rate of human errorsrate of human errors human retention over timehuman retention over time

Assess subjective satisfactionAssess subjective satisfaction (Questionnaire for User Interface Satisfaction)(Questionnaire for User Interface Satisfaction)

Accommodate individual differencesAccommodate individual differences Consider social, organizational & cultural contextConsider social, organizational & cultural context

Design IssuesDesign Issues

Input devices & strategies Keyboards, pointing devices, voice Direct manipulation Menus, forms, commands

Output devices & formats Screens, windows, color, sound Text, tables, graphics Instructions, messages, help

Collaboration & communities Manuals, tutorials, training

www.awl.com/DTUI usableweb.com hcibib.org useit.com

Library of CongressLibrary of Congress

Scholars, Journalists, CitizensScholars, Journalists, Citizens

Teachers, StudentsTeachers, Students

Visible Human Explorer (NLM)Visible Human Explorer (NLM)

DoctorsDoctors

SurgeonsSurgeons

ResearchersResearchers

StudentsStudents

NASA Environmental DataNASA Environmental Data

ScientistsScientists

FarmersFarmers

Land plannersLand planners

StudentsStudents

Bureau of CensusBureau of Census

Economists, Policy Economists, Policy makers, Journalistsmakers, Journalists

Teachers, StudentsTeachers, Students

Leonardo da Vinci (1452-1519)Leonardo da Vinci (1452-1519)

Renaissance ManRenaissance Man PainterPainter InventorInventor VisionaryVisionary MathematicianMathematician PhilosopherPhilosopher EngineerEngineer

Mona LisaMona Lisa

Lady with Ermine & Leda with SwanLady with Ermine & Leda with Swan

Last Supper FrescoLast Supper Fresco

Remarkable Drawing SkillRemarkable Drawing Skill

Faces of Old MenFaces of Old Men

Anatomical DrawingsAnatomical Drawings

Machine Gun and Giant CrossbowMachine Gun and Giant Crossbow

Why Leonardo Inspires UsWhy Leonardo Inspires Us

He integrated - Scientific outlook - Practical technology - Artistic skill

Leonardo: An Inspirational MuseLeonardo: An Inspirational Muse

Three lessons:

1) Human needs drive innovation

2) Universal usability

3) Creativity support tools

Jefferson: Life, Liberty & the Pursuit of Happiness

Roosevelt: Freedom of speech & expression, religion, from want, from fear

Maslow: Hierarchy of human needs Physiological Safety Love Esteem Self-Actualization

Covey: Living, Loving, Learning & Leaving a legacy

1) Human needs drive innovation1) Human needs drive innovation

Spectrum of relationshipsSpectrum of relationships

Family & Friends (2-20 close intimates)

  Colleagues & Neighbors (10-1000 regular encounters)

  Members & Residents (1000-1,000,000 professionals or city residents )

  Citizenry & Markets (larger communities)

Range of ActivitiesRange of Activities

Collect: Information

Relate: Communication

Create: Innovation

Donate: Dissemination

Periodic tablePeriodic table

Relationships:

Family & Friends

Colleagues & Neighbors

Members & Residents

Citizenry & Markets

Activities:

Collect Relate Create Donate

Periodic tablePeriodic table

Relationships:

Family & Friends

Colleagues & Neighbors

Members & Residents

Citizenry & Markets

Activities:

Collect Relate Create Donate

Skeptics corner - Aren’t relationships more complex

- Are these useful activities?

Examples: Collecting informationExamples: Collecting information

Relationships:

Family & Friends

Colleagues & Neighbors

Members & Residents

Citizenry & Markets

Activities:

Collect Relate Create Donate

LifeLines

InfoDoor

InfoWallInfoWall

WebBushWebBush

Examples: Relating to othersExamples: Relating to others

Relationships:

Family & Friends

Colleagues & Neighbors

Members & Residents

Citizenry & Markets

Activities:

Collect Relate Create Donate

Empathic support

Neighbor .com

Negotiatedexpectations

Million person community

Examples: Creating a futureExamples: Creating a future

Relationships:

Family & Friends

Colleagues & Neighbors

Members & Residents

Citizenry & Markets

Activities:

Collect Relate Create Donate

Vacation plan

Business strategy

Urban renewal

Policy manifesto

Examples: Disseminating & LeadingExamples: Disseminating & Leading

Relationships:

Family & Friends

Colleagues & Neighbors

Members & Residents

Citizenry & Markets

Activities:

Collect Relate Create Donate

Tell stories

Teach kids

Record events

Train novices

Report decisions

Mentorship

Preserve history

Leadership

Human needs drive innovationHuman needs drive innovation

Relationships:

Family & Friends

Colleagues & Neighbors

Members & Residents

Citizenry & Markets

Activities:

Collect Relate Create Donate

Photo Finder

ICQ Gather- round.com

XXX.LANL

Photo Quilt

GlassEye Ebay

Nasdaq

Napster

2) Universal Usability 2) Universal Usability

Problem: Confusion, frustration, and remorse dominate user experiences Survey of 6000 users finds 5.1 hours/week wasted Incompatible files, interfaces, networks, hardware Poorly designed websites lacking accessibility policy

Solutions: Raise user expectations Conduct research Provide practical tools & methods

2) Universal Usability 2) Universal Usability

Problem: Confusion, frustration, and remorse dominate user experiences Survey of 6000 users finds 5.1 hours/week wasted Incompatible files, interfaces, networks, hardware Poorly designed websites lacking accessibility policy

Solutions: Raise user expectations Conduct research Provide practical tools & methods

Skeptics corner - Dumbing down

- Lowest common denominator

2) Universal Usability Problem: Confusion, frustration, and remorse

dominate user experiences Survey of 6000 users finds 5.1 hours/week wasted Incompatible files, interfaces, networks, hardware Poorly designed websites lacking accessibility policy

Solutions: Raise user expectations Conduct research Provide practical tools & methods

ACM Code of Ethics

In a fair society, all individuals would have equal opportunity to participate in, or benefit from, the use of computer resources regardless of race,

sex, religion, age, disability, national origin or other such similar factors.

Internet Use by Education - 1998 Percent of U.S. Households Using the InternetPercent of U.S. Households Using the Internet

Total U.S., Rural, Urban, and Central City Areas Total U.S., Rural, Urban, and Central City Areas

Falling Through the Net: Defining the Digital Divide www.ntia.doc.gov

Internet Use by Income - 1998 Percent of U.S. Households Using the InternetPercent of U.S. Households Using the Internet

Total U.S., Rural, Urban, and Central City Areas Total U.S., Rural, Urban, and Central City Areas

Falling Through the Net: Defining the Digital Divide

www.ntia.doc.gov

Research Agenda Technology variety:

Support broad range of hardware, software, and network access

User diversity: Accommodate users with different skills, knowledge, age, gender, disabilities, disabling conditions (mobility, injury, noise, sunlight), literacy, culture, income, etc.

Gaps in user knowledge: Bridge the gap between what users know and what they need to know

Communications of the ACM, May 2000

Technology variety: Support broad range of hardware, software, and network access

1 to 100 range in processor speeds

286 486 Pentium

1 to 100 range in screen sizes

Palm devices Laptops Large Desktop or Wall Display 30,000 480,000 3,840,000 pixels

Software Versions Compatibility File conversion Multiple platforms

Device Independence Input: keyboard, speech,... Output: visual, auditory,... Conversion: Text-speech Speech-text,...

1 to 100 range in network bandwidth

9.6K 56K 10,000Kbps

Language & Culture Western, Eastern, developing...

Personality Introvert vs extravert Thinking vs feeling Risk aversion Locus of control Planful vs playful

User diversity: Accommodate different users

Skills Computer newbie to hacker Knowledge Domain novice to expert

Age Young to oldGender Male or FemaleIncome Impoverished to wealthy

Disabilities Visual, auditory, motoric, cognitive

Disabling conditions Mobility, injury, noise, sunlight

Online help Context sensitive, tables of contents, Indexes, Keyword search, FAQs, Newsgroups, Chat rooms Online communities

Gaps in User Knowledge - StrategiesBridge the gap between what users know and

what they need to know

Design Layered Level-structured Task-oriented Training

Fade-able scaffolding Training wheels Minimalist

Online Learning (evolutionary, phased) Introductory tutorials Getting started manuals, Cue cards Walkthroughs/Demos Minimalist/Active

Customer service Email Phone Help desks

3) Creativity Support Tools3) Creativity Support Tools

More people, more creative, more of the timeMore people, more creative, more of the time Revolutionary breakthroughs, paradigm shifts, H-Revolutionary breakthroughs, paradigm shifts, H-

creativitycreativity

Evolutionary, normal science, music & art, Evolutionary, normal science, music & art, creative knowledge workcreative knowledge work

Impromptu everyday creativityImpromptu everyday creativity

Eight Activities Eight Activities

1) Searching & browsing digital libraries 2) Consulting with peers & mentors 3) Visualizing data & processes 4) Thinking by free associations 5) Exploring solutions - What if tools 6) Composing artifacts & performances 7) Reviewing & replaying session histories 8) Disseminating results

Eight Activities Eight Activities

1) Searching & browsing digital libraries 2) Consulting with peers & mentors 3) Visualizing data & processes 4) Thinking by free associations 5) Exploring solutions - What if tools 6) Composing artifacts & performances 7) Reviewing & replaying session histories 8) Disseminating results

Skeptics corner - Tools can limit imagination - Not everyone wants to be creative - Creativity can be malicious

3) Visualizing data & processes3) Visualizing data & processes

The eye…

the window of the soul,

is the principal means

by which the central sense

can most completely and

abundantly appreciate

the infinite works of nature.

Leonardo da Vinci (1452 - 1519)

Information Visualization: Using Vision to Think Information Visualization: Using Vision to Think

Visual bandwidth is enormous Human perceptual skills are remarkable

Trend, cluster, gap, outlier... Color, size, shape, proximity...

Human image storage is fast and vast

Opportunities Spatial layouts & coordination Information visualization Scientific visualization & simulation Telepresence & augmented reality Virtual environments

Information Visualization: MantraInformation Visualization: Mantra

Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand Overview, zoom & filter, details-on-demand

Information Visualization: Data TypesInformation Visualization: Data Types

1-D Linear Document Lens, SeeSoft, Info Mural, Value Bars

2-D Map GIS, ArcView, PageMaker, Medical imagery

3-D World CAD, Medical, Molecules, Architecture

Multi-Dim Parallel Coordinates, Spotfire, XGobi, Visage, Influence Explorer, TableLens, DEVise

Temporal Perspective Wall, LifeLines, Lifestreams, Project Managers, DataSpiral

Tree Cone/Cam/Hyperbolic, TreeBrowser, Treemap

Network Netmap, netViz, SeeNet, Butterfly, Multi-trees(Online Library of Information Visualization Environments) otal.umd.edu/Olive

Customer HistoriesCustomer Histories

LifeLines

Treemap - view large trees Treemap - view large trees

Space fillingSpace filling Space limitedSpace limited Color codingColor coding Size codingSize coding Requires learningRequires learning

(Shneiderman, ACM Trans. on Graphics, 1992)

TreeViz (Mac, Johnson, 1992)NBA-Tree(Sun, Turo, 1993)Winsurfer (Teittinen, 1996)Diskmapper (Windows, Micrologic)Treemap97 (Windows, UMd)

Treemap - Stock market, clustered by industryTreemap - Stock market, clustered by industry

Leonardo da Vinci (1452-1519)Leonardo da Vinci (1452-1519)

Three lessons:

1) Human needs drive innovation

2) Universal usability

3) Creativity support tools

ACM Conference on Universal Usability

Washington, DC November 16-17, 2000

www.acm.org/sigchi/cuu

Human-Computer Interaction Laboratory

www.cs.umd.edu/hcil

For More InformationFor More Information

Visit the HCIL website for 200 papers & info on videosVisit the HCIL website for 200 papers & info on videos (www.cs.umd.edu/hcil)(www.cs.umd.edu/hcil)

See Chapter 15 on Info VisualizationSee Chapter 15 on Info Visualization Shneiderman, B., Shneiderman, B., Designing the User Interface:Designing the User Interface: Strategies for Effective Human-Computer Interaction: Strategies for Effective Human-Computer Interaction: Third Edition Third Edition (1998) (1998) (www.aw.com/DTUI)(www.aw.com/DTUI)

January 1999 book of readings:January 1999 book of readings: Card, S., Mackinlay, J., and Shneiderman, B. Card, S., Mackinlay, J., and Shneiderman, B. Information Visualization: Using Vision to ThinkInformation Visualization: Using Vision to Think