powerpoint presentation€¦ · scott mccloud, understanding comics: the invisible art, 1994 what...

56
CMSC434 Representation and Metaphors Thursday, March 28th, 2013 Instructor: Jon Froehlich TA: Matt Mauriello Intro to Human-Computer Interaction

Upload: others

Post on 23-Jul-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

CMSC434

Representation and Metaphors

Thursday, March 28th, 2013

Instructor: Jon Froehlich

TA: Matt Mauriello

Intro to Human-Computer Interaction

Page 2: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Don Norman

Reading response due Tuesday

Page 3: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 4: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 5: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 6: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 7: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Hall of Fame Hall of Shame

Page 8: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

[http://youtu.be/p92QfWOw88I]

Building Windows 8, http://youtu.be/p92QfWOw88I

Page 9: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Shame/Fame

[http://youtu.be/v4boTbv9_nU]

How Real People Will Use Windows 8, http://youtu.be/v4boTbv9_nU

Page 10: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

One of Nielsen/Norman’s first principles of design:

Effective interfaces do not concern the user with the inner workings of the system… with

full option for the user to undo any activity at any time.

Page 11: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Representation Matters

Page 12: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Experiential cognition is aided when

the properties of the representation

match the properties of the thing

being represented.

Don Norman

Cognitive Scientist / Author [From: Things that Make Us Smart, 1994 ]

Page 13: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 14: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Semiotics noun \-ˈä-tiks\ The study of signs and symbols and their use or interpretation

[Oxford Dictionary]

Page 15: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

What are the symbols in this image?

Page 16: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 17: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 18: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 19: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 20: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 21: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Scott McCloud, Understanding Comics: The Invisible Art, 1994

What can we say about these faces?

Page 22: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Scott McCloud, Understanding Comics: The Invisible Art, 1994

What can we say about these faces?

Page 23: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

How are signs and symbols used in interfaces?

• To indicate functionality

• Icon

• Bjuttons

• Text

• Shapes

• Color

• Mouse cursor

Page 24: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Can symbols be useful to thought/cognition?

Page 25: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

RomanNumerals

Page 26: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

I

V

X

L

C

D

M

RomanNumerals

= 1

= 5

= 10

= 50

= 100

= 500

= 1000

Page 27: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

RomanNumerals

I

V

X

L

C

D

M

Symbols have numerical meaning

Symbol positions have (some) numerical meaning

Page 28: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

What about arithmetic operations?

Page 29: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

XIX + LIV

(19 + 54)

Page 30: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

XIX + LIV 1. Substitute for subtractives to obtain: XVIIII + LIIII

2. Concatenate to obtain: XVIIIILIIII

3. Sort to obtain: LXVIIIIIIII

4. Combine groups: LXVIIIIIIII

LXVVIII

LXXIII

5. Compact results by substituting subtractives

Final answer =

XIX + LIV = LXXIII

19 + 54 = 73

[Algorithm from: http://turner.faculty.swau.edu/mathematics/materialslibrary/roman/]

Page 31: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

How would we do this with Arabic numerals?

Page 32: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

19 + 54

19

+54 3

+1

7

Page 33: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

What about multiplication and division?

Page 34: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

19 x 54

19

x 54

Page 35: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

19 x 54

19

x 54

6

+3

7

Page 36: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

19 x 54

19

x 54

6

+3

7 0 5

+4

9

Page 37: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

19 x 54

19

x 54

6

+3

7 0 5

+1

9 + 6 2 10

+4

Page 38: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

19 x 54

19

x 54

6

+3

7 0 5

+1

9 + 6 2 10

+4 I can offload some cognition (i.e.,

cognitive load) to the page itself.

Essentially, the effort is shared between

the individual and the external

representation.

This is enabled by the positioning effects

in the Arabic numbering system

Page 39: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

XIX x LIV In the Roman numbering system, multiplication &

division are much harder because of representation.

Page 40: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Using the external world as a cue for your memory…

Page 41: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 42: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Recall vs. Recognition

Page 43: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible
Page 44: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Metaphor noun /ˈmɛtəfə, -fɔː/ A word, phrase, or image applied to an object or action to

represent a less tangible object or some intangible quality or idea

Page 45: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

TimMott At Xerox PARC, Designed Desktop Metaphor

Co-founded Electronic Arts

[Moggridge, Designing Interactions]

Moggridge, Designing Interactions, 2007

Page 46: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

The Desktop Metaphor

Advantages

Disadvantages

Page 47: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

[Microsoft BOB]

Microsoft Bob, Designing Interactions, 2007

Page 48: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

[BumpTop, CHI2006]

Agarawala & Balakrishnan, BumpTop: Pushing the Desktop Metaphor with Physics, Piles, & the Pen, CHI2006

Page 49: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

1+5 * 7

1 + 5*7

Visual grouping influenced ability to ascertain correct result

[Landy & Goldstone, How Abstract is Symbolic Thought? J. of Experimental Psychology]

Page 50: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

“The authors conclude

that formally symbolic

reasoning is more

visual than is usually

proposed.”

[Landy & Goldstone, How Abstract is Symbolic Thought? J. of Experimental Psychology]

Page 51: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Good or Bad?

Page 52: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Success!

Your file was successfully uploaded to

msn.com/videos.

The visual language conflicts with the intent of the message

[Example based on p.19 in Seductive Interaction Design by Stephen P. Anderson, 2011]

Page 53: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Which window is closer to you?

[Example based on p.20 in Seductive Interaction Design by Stephen P. Anderson, 2011]

When designing, we must consider how the brain

interprets the meaning of color, shadow, shading—

these are not just aesthetic choices.

Page 54: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Looks good, right?

[Example based on p.20 in Seductive Interaction Design by Stephen P. Anderson, 2011]

Where does this “drawer”

menu come from?

Page 55: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

Looks good, right?

[Example based on p.20 in Seductive Interaction Design by Stephen P. Anderson, 2011]

Where does this “drawer”

menu come from?

Page 56: PowerPoint Presentation€¦ · Scott McCloud, Understanding Comics: The Invisible Art, 1994 What can we say about these faces? Scott McCloud, Understanding Comics: The Invisible

[Example based on p.20 in Seductive Interaction Design by Stephen P. Anderson, 2011]

By flipping the direction

of the shadow, the

design “feels” better