1. plan : 1. models of interaction 2. types of interaction 3. existing technologies 4. advances in...

1

Chapter 3

The interaction

2

Plan: 1. Models of interaction

2. Types of interaction

3. Existing technologies

4. Advances in HCI

5. Architecture

3

1 .MODELS OF INTERACTION

terms of interactionNorman model

interaction framework

4

1 .MODELS OF INTERACTION

Some terms of interaction:

domain – the area of work under study. e.g.

graphic design

goal – what you want to achieve. e.g. create a

solid red triangle

task – how you go about doing it

– ultimately in terms of operations or

actions

e.g. … select fill tool, click over triangle

5

1. MODELS OF INTERACTION: Donald Norman’s model

• Seven stages– user establishes the goal الهدف يحدد : المستخدم– formulates intention : نية يصوغ– specifies actions at interface : في اإلجراءات يحدد

واجهة– executes action : العمل ينفذ– perceives system state : النظام حالة يدرك– interprets system state : النظام حالة يفسر– evaluates system state with respect to goal : الهدف يتعلق فيما النظام حالة تقييم

• Norman’s model concentrates on user’s view of the interface

6

execution/evaluation loop

• user establishes the goal• formulates intention• specifies actions at interface• executes action• perceives system state• interprets system state• evaluates system state with respect to goal

system

evaluationexecution

goal


7


system

evaluationexecution

goal



8


system

evaluationexecution

goal



9

Human error - slips and mistakes


Slip:

understand system and goal.

correct formulation of action.

incorrect action.

Mistake:

may not even have right goal!

10

Abowd and Beale framework

1. MODELS OF INTERACTION: Interaction framework

The interaction framework has 4 parts– user– input– system– Output

Each has its own unique language

interaction translation between languages

problems in interaction = problems in translation

Score

Utask

Ooutput

Iinput

11

Abowd and Beale framework

1. MODELS OF INTERACTION: Interaction framework

user intentions:

translated into actions at the interface : في أفعال إلى تترجم

الواجهة

translated into alterations of system state : تغيرات إلى تترجم

النظام حالة في

reflected in the output display: اإلخراج عرض في تنعكس

interpreted by the user : المستخدم قبل من تفسر

12

2 .TYPES OF INTERFACES

Command Line Interface (CLI)

Menu Driven Interface (MDI)

Graphical User Interface (GUI)

Natural Language Interface (NLI)

13


A. Command Line Interface :A CLI displays a prompt, the user types a command on the

keyboard, the computer executes the command and provides

textual output.

Advantages:

Very flexible with the use of “switches” (options)

Good for expert users, can quickly access commands

Uses the fewest system resources

Disadvantages:

Require the user to learn complex commands or languages

Not very good for novice users

14


B.Menu Driven Interface :The user has a list of items to choose from, and can make

selections by highlighting one.

Advantages:

No need to learn complex commands/languages

Easier for a novice to learn/use

Ideal when there are a limited number of options (efficient)

Disadvantages:

Can be frustrating for experienced users

User interface may be limited by screen space and number

of options available

15


C. Graphical User Interface :The GUI uses windows, icons, menus and pointers (WIMP)

which can be manipulated by a mouse (and often to an extent

by a keyboard as well)

Advantages:

Most suitable interface for inexperienced or novice users

Many genetic packages for a GUI will share common

features

Disadvantages:

GUI’s use more system resources than other types of

interface

16


D.Natural Language Interface :Can range from simple command systems to voice activated

text processing. Commands are spoken in “normal ” language.

Advantages:

No training required

Can be quicker than keyboard entry

Hands-free / can be used by the disabled

Disadvantages:

Emerging technology- still contain “bugs”

Difficulty in dealing with homonyms

Artificial languages are often more precise

17

3 .EXISTING TECHNOLOGY

The existing interfaces differ in the degree of

complexity both because of degree of functionality

or usability.

The user activity has three different levels:

Physical

Cognitive

Affective

The existing physical technologies for HCI basically

can be categorized by human senses.

18

4 .ADVANCES IN HCI

•The new advances in HCI can be categorized in 3

sections:

Wearable devices, wireless devices and virtual

devices.

•Recent advances of research in HCI are in these

areas:

Intelligent and adaptive interfaces

Ubiquitous computing (ubicomp)

These interfaces involve different levels of user

activity.

19

4 .ADVANCES IN HCI

Intelligent and adaptive interface:

•Its are interfaces that incorporate at least some kind of

intelligence in perception from and/or response to users.

Ex: speech enabled interfaces that use natural language

to interact with users and devices.

•Adaptive HCI design, on the other hand, may not use

intelligence in the creation of interface but use it to

interact with users.

Ex: a web site using regular GUI for selling various

products

20

4 .ADVANCES IN HCI

•Intelligent and adaptive interfaces are active

interfaces.

•Non-intelligent interfaces are passive in nature.

•Tablet PC is an example that uses both intelligent

and adaptive interfaces and it has handwriting

recognition ability.

21

4 .ADVANCES IN HCI

Ubiquitous Computing:

•The idea of ubiquitous computing was to embed

computers every where in the environment and

every day objects so that people could interact with

many computers.

22

5 .ARCHITECTURE

•Architecture of any HCI systems is identified by:

Number of inputs and outputs in the system

Diversity of inputs and outputs in term of modality

Working of these diverse input and output for

interaction purpose

•Based on different configuration and design of

interface, HCI systems can be divided into:

Unimodal HCI system

Multimodal HCI system

23

5 .ARCHITECTURE

Unimodal HCI system:

A system that is based on only one modality is called

unimodal.

Based on the nature of different modalities, they can

be divided into three categories:

Audio-based

Sensor-based

Visual-based

24

5 .ARCHITECTURE

Unimodal HCI system: Audio-based HCI:

•It deals with information acquired by different audio

signals.

•The information gathered from audio signals can be

more trustable and helpful.

•Key components:

Microphone.

ASR (automated speech recognition) and NLU

(natural language understanding) software.

25

5 .ARCHITECTURE

The main research areas of audio based HCI are

divided into:

Speech recognition

Speaker recognition

Auditory emotion analysis

Human-made noise/sign detections

Musical interaction

26

5 .ARCHITECTURE

Unimodal HCI system: Sensor-based HCI:It has the wide range of applications in our day-to-day life.

The common feature in every application is that at least

one physical sensor is used between machine and human to

provide interaction.

Some of the sensors range from being very sophisticated

primtive:

Pen-based interaction

Motion tracking sensors

Haptic sensors

Pressure sensors

27

5 .ARCHITECTURE

Unimodal HCI system: Visual-based HCI:It is also called as machine vision which is the

observation of an environment using cameras.

In this, different aspects of human responses can be

recognized visual signals.

The main research areas of visual based HCI are:

Facial Expression Analysis

Body movement tracking and gesture recognition

Gaze detection

28

5 .ARCHITECTURE

Limitations of Unimodal HCI:Not a natural way of human interaction

Usually designed for the average user

Failes to cater to the needs of a diverse category of

people .

Difficult to use by disabled, illiterate and untrained

people

Cannot provide universal interface

29

5 .ARCHITECTURE

Multimodal HCI system:Combination of multiple modalities, or usage of more

than one independent channel signals for the

interaction between a user and a machine is termed as

multimodal human computer interaction system.

A multimodal interface acts as a facilitator of human

computer interaction via two or more modes of input.

It is easy to use by disabled, illiterate people.

30

5 .ARCHITECTURE

Applications:Intelligent homes/offices

Driver monitoring

Intelligent games

E-commerce

Helping people with disabilities

31

5 .ARCHITECTURE

Applications: Helping people with disabilities :A good application of multimodal systems is to address and assist

disabled people.

In this system users can interact with machine using voice and head

movements.

Two modalities are used and both are active continuously : speech

and head movements.

Speech provides the needed information about the meaning of the

action that must be performed with an object selected by the cursor.

The head position indicates the coordinates of the cursor on the

screen at the current moment.

1. plan : 1. models of interaction 2. types of interaction 3. existing technologies 4. advances in...

Documents