October 19, 2015 Sam Siewert

CS415 Human Computer Interaction

Lecture 11 – Advanced HCI Intro to Cognitive Models

Assignments Assignment #5 – Propose Group Project (Groups of 3) Assignment #6 – Project Final Oral Exam – Presentation of Project Myself, Jim Weber, Dr. Davis, Dr. Bruder Emily and Adam Molson – Controls Lab Monitors – 9-5 on Sat, 12 noon – 9pm Sun

Sam Siewert 2

This Week …

Chapter 12 – Cognitive Models – GOMS – Goal, Operators, Methods and Selection – Goal - describing what the user wants to achieve – Operators - basic actions that the user must perform in order to

use the system – Methods - several ways in which a goal can be split into sub-

goals – Selection – choice of method and prediction of which will be

used

Sam Siewert 3

Poor Software-Engineering Practices HCI is an Aspect of Software Engineering HMI is and Aspect of Systems Engineering Software and Hardware Must be Co-Designed Software CMVC and SQA Should be Rigorous No Software Guru Should be the Only One Who Knows How the Code “Works”

Sam Siewert 4

Assignment #5 - Objectives Explore Root-causes of Therac-25 Accidents

Propose a Final Team Exercise 1. provide a design and prototype that suggests how to improve a

well-known past HCI 2. provide a design and prototype to address a current

(contemporary) HCI for an application such as intelligent-transportation, UAV/UAS operations, wearable computing (e.g. smart-watch), etc.

3. design and experiment to evaluate whether a contemporary or proposed HCI design and implementation does in fact provide advantage over previous alternatives (ERAU IRB guidelines)

Sam Siewert 5

Cognitive Models - Introduction Hierarchical Models – Task and Goal Structure Linguistic Models – System Grammar Physical and Device Models – Human Motor Skills Cognitive Models – Combine All 3 of the Above

Sam Siewert 6

1) GOMS = Goals, Operators, Methods, Selection

Sam Siewert 7

GOMS - Selection

Sam Siewert 8

GOMS - Evaluation New HCI Design Efficiency

Sam Siewert 9

2) Linguistic Models BNF (Backus Naur Form) – Syntax E.g. – 0123456789 – 0123456789.0123456789 – 0123456789.0123456789E+0123456789

Sam Siewert 10

Linguistic Models - HCI Interactive Specification of a US Postal Address Form Text Entry, Pull-downs, etc.

Sam Siewert 11

https://en.wikipedia.org/wiki/Backus%E2%80%93Naur_Form

Change of Address Example

Sam Siewert 12

https://www.usps.com/manage/forward.htm

Linguistic Systems Syntax – Rules for Writing Expressions Semantics – Expression Meaning Chomsky’s Hierarchy

Sam Siewert 13

In Practice, Limited to Regular Expressions and CFG

Natural Languages Use both CFG and CSG – Noam Chomsky [Linguistics, Strong Influence on Computer Science and Programming Languages, Activist] Alonzo Church – Lambda Calculus Kurt Gödel – Mathematics Related to Languages and Formal Systems - Completeness Alan Turing – Turing Machine and Computability

Sam Siewert 14

http://en.wikipedia.org/wiki/Chomsky_hierarchy

Formal Grammars

3) Physical and Device Models Keystroke Level Model 1. Finding and Striking Keys (Combinations Ctrl+Alt+Del) 2. Mouse Button 3. Moving Cursor to a Target (Fitts’ Law) 4. Mouse to Keyboard Hand Transition 5. Tracing with Mouse 6. Thought Prior to Action 7. System Response Latency

Sam Siewert 15

Physical Efficiency GOMS Task – Time to Complete

Sam Siewert 16

Example Analysis Keystroke Short-cut vs. Point and Click

Sam Siewert 17

Interactive Cognitive Systems

Sam Siewert 18

Philip Barnard – ICS provides a model of perception, cognition and action – not intended to describe the user in terms of action sequences – ICS provides a more holistic view of the user as an information-

processing machine – emphasis on how easy particular procedures of action

sequences become – as they are made more automatic within the user

Interdisciplinary Study and Research – Computer Science – Automation, Programming Languages, AI,

HCI, Systems, Machine Learning – Cognitive Psychology – Human Perception, Thought, Reason – Brain Physiology – fMRI, functional Magnetic Resonance

Imaging – Interesting Recent Projects – EPFL Blue Brain, IBM Watson

Reality – Hybrid of 3 Models and … HCI – GOMS + Linguistic + Physical + Intelligence Newell and Simon [CMU, AI] Power of Recursion, 1958 NSS Chess – E.g. Minimax Search

Sam Siewert 19

Herbert Alexander Simon, (June 15, 1916 – February 9, 2001) was an American scientist and artificial intelligence pioneer, economist and psychologist. Professor, most notably, at the Carnegie Mellon University, Pittsburgh, Pennsylvania, which became an important center of AI and computer chess, ...Herbert Simon received many top-level honors, most notably the Turing Award (with Allen Newell) (1975) for his AI-contributions [1] and the Nobel Memorial Prize in Economics for his pioneering research into the decision-making process within economic organizations (1978) [2

Allen Newell, (March 19, 1927 - July 19, 1992) was a American researcher in computer science and pioneer in the field of artificial intelligence and chess software [1] at the Carnegie Mellon University, Pittsburgh, Pennsylvania. In 1958, Allen Newell, Cliff Shaw, and Herbert Simon developed the chess program NSS [2]. It was written in a high-level language. Allen Newell and Herbert Simon were co-inventors of the alpha-beta algorithm, which was independently approximated or invented by John McCarthy, Arthur Samuel and Alexander Brudno [3].

https://chessprogramming.wikispaces.com/Herbert+Simon

About 40 Years Later …

From Algorithm to Computer Oponnent – YouTube Documentary – Randy Moulic’s Team IBM / CMU

– Kasparov Requested a Re-match, No Response from IBM – IBM’s Page - https://www.research.ibm.com/deepblue/ – Controversy – Game 2, Wired on “bug”, Conditions – Chess today – http://en.playchess.com/ (GNU Chess – 1989-92)

Sam Siewert 20

Summary Models for How Humans Perceive, Think and Act Models for Computing (State Machines, PLs, Computability) Models for Interaction (CLI, WIMP, PL, NLP, 3D, Neural) Goals for HCI and Thoughts? – To Extend Human Capabilities with Computers [Efficiently] – To Emulate How Humans Perceive and Think [for Interaction] – To Create an Artificial Intelligence [to Share Cognitive Load] – Is Human Helping Computer with Task Completion or Computer

Helping Human? – Is HCI Inherently Linked to AI and Cognitive Psychology?

Sam Siewert 21