tuesday week 5: ambient media theory and...
TRANSCRIPT
Tuesday Week 5: Ambient Media
1
Theory and Practice of Tangible User Interfaces
Ambient MediaAt the periphery of our awareness
week 05
Tuesday Week 5: Ambient Media
2
Theory and Practice of Tangible User Interfaces
Announcements•
Midterm project proposal due today Tue Sept 25
•
Crash course on programming by Dave and Ryan
Tuesday Week 5: Ambient Media
3
Theory and Practice of Tangible User Interfaces
Lecture Outline•
Peripheral Awareness
•
Ambient Media
•
Signs and Representational Fidelity
Tuesday Week 5: Ambient Media
4
Theory and Practice of Tangible User Interfaces
Peripheral AwarenessWhat we are attuned to without attending to explicitly
[Weiser, 1995]
Tuesday Week 5: Ambient Media
5
Theory and Practice of Tangible User Interfaces
Tuesday Week 5: Ambient Media
6
Theory and Practice of Tangible User Interfaces
www.chromasia.com
Tuesday Week 5: Ambient Media
7
Theory and Practice of Tangible User Interfaces
Tuesday Week 5: Ambient Media
8
Theory and Practice of Tangible User Interfaces
www.brainsinchains.com
Tuesday Week 5: Ambient Media
9
Theory and Practice of Tangible User Interfaces
Tuesday Week 5: Ambient Media
10
Theory and Practice of Tangible User Interfaces
PeripheryWhat we are attuned to without attending to explicitly.
[Weiser, 1995]
Tuesday Week 5: Ambient Media
11
Theory and Practice of Tangible User Interfaces
Calm TechnologyEngages both the center and the periphery of our attention, and moves back and forth between the two.
[Weiser, 1995]
Tuesday Week 5: Ambient Media
12
Theory and Practice of Tangible User Interfaces
[Jeremijenko
, 1995]
Live Wire
Tuesday Week 5: Ambient Media
13
Theory and Practice of Tangible User Interfaces
Locatedness: Calm Technology
We are connected effortlessly to a myriad of familiar details
of the world around us.
[Weiser, 1995]
Tuesday Week 5: Ambient Media
14
Theory and Practice of Tangible User Interfaces
Tasks in Foreground and Background[Buxton, 1995]
Tuesday Week 5: Ambient Media
15
Theory and Practice of Tangible User Interfaces
[Buxton, 1995]
HUMAN-
HUMAN
BACKGROUNDFOREGROUND
HUMAN-
COMPUTER
persistentbursty
conversation, telephone,
video conf.
GUIs
Tuesday Week 5: Ambient Media
16
Theory and Practice of Tangible User Interfaces
[Buxton, 1995]
HUMAN-
HUMAN
BACKGROUNDFOREGROUND
HUMAN-
COMPUTER
persistentbursty
conversation, telephone,
video conf.
GUIs
Tuesday Week 5: Ambient Media
17
Theory and Practice of Tangible User Interfaces
[Buxton, 1995]
HUMAN-
HUMAN
BACKGROUNDFOREGROUND
HUMAN-
COMPUTER
persistentbursty
“Portholes”conversation,
telephone,
video conf.
GUIs
Tuesday Week 5: Ambient Media
18
Theory and Practice of Tangible User Interfaces
[Dourish
& Bly, 1992]
Tuesday Week 5: Ambient Media
19
Theory and Practice of Tangible User Interfaces
[Buxton, 1995]
HUMAN-
HUMAN
BACKGROUNDFOREGROUND
HUMAN-
COMPUTER
persistentbursty
“Portholes”conversation,
telephone,
video conf.
smart house technologyGUIs
Tuesday Week 5: Ambient Media
20
Theory and Practice of Tangible User Interfaces
Foreground and backgroundCalm technology engages both the center and the periphery of our
attention, and moves back and forth between the two. [Weiser, 1995]
Tuesday Week 5: Ambient Media
21
Theory and Practice of Tangible User Interfaces
Operations
Actions
Activity
automatic,
unconscious
conscious
goal-oriented
Hierarchical StructureActivity Theory
Tuesday Week 5: Ambient Media
22
Theory and Practice of Tangible User Interfaces
Operations
Activity
Hammering, changing gears when driving
Putting the roof up, transporting bricks by truck
Building a house
Hierarchical StructureActivity Theory
Example
Actions
Tuesday Week 5: Ambient Media
23
Theory and Practice of Tangible User Interfaces
Operations
Actions
Activity
automatic,
unconscious
conscious
goal-oriented
Hierarchical StructureActivity Theory
FOREGROUND
BACKGROUND
Foreground and background in calm computing
Tuesday Week 5: Ambient Media
24
Theory and Practice of Tangible User Interfaces
Ambient Media
Tuesday Week 5: Ambient Media
25
Theory and Practice of Tangible User Interfaces
Ambient MediaInformation conveyed via calm changes in the environment so that
users are more able to focus on their primary tasks while staying aware of non-critical but important information that affects them.
[Pousman
& Stasko, 2006]
Tuesday Week 5: Ambient Media
26
Theory and Practice of Tangible User Interfaces
Pinwheels: wind of bits[Ishii et al., 1997]
Tuesday Week 5: Ambient Media
27
Theory and Practice of Tangible User Interfaces
ambientROOM[Ishii et al., 1997]
Tuesday Week 5: Ambient Media
29
Theory and Practice of Tangible User Interfaces
Orb[Ambient Devices]
Tuesday Week 5: Ambient Media
30
Theory and Practice of Tangible User Interfaces
Orb[Ambient Devices]
Tuesday Week 5: Ambient Media
31
Theory and Practice of Tangible User Interfaces
Orb[Ambient Devices]
Tuesday Week 5: Ambient Media
32
Theory and Practice of Tangible User Interfaces
LumiTouch[Chang, Resner
et al., 2001]
Tuesday Week 5: Ambient Media
33
Theory and Practice of Tangible User Interfaces
iCom[Agamanolis
, 2003]
Tuesday Week 5: Ambient Media
34
Theory and Practice of Tangible User Interfaces
Ambient Media: Design Principles
1.
Display important but not critical information
2.
Can move from the periphery to the focus of attention and back again
3.
Focus on physical representation in the environment
4.
Provide subtle changes to reflect updates in information (should not be distracting)
5.
Are aesthetically pleasing and environmentally appropriate
[Pousman
& Stasko, 2006]
Tuesday Week 5: Ambient Media
35
Theory and Practice of Tangible User Interfaces
Representational Fidelity and Signs
Tuesday Week 5: Ambient Media
36
Theory and Practice of Tangible User Interfaces
Representational FidelityHow the data from the world is encoded into patterns, pictures, words, or sounds.
[Pousman
& Stasko, 2006]
Tuesday Week 5: Ambient Media
37
Theory and Practice of Tangible User Interfaces
Sign
Tuesday Week 5: Ambient Media
38
Theory and Practice of Tangible User Interfaces
Sign [Peirce 1931-58]
Signifier
The representation of the object, which could be a word, a picture, or a sound.
Sense
The understanding that an observer gets from seeing or experiencing either the signified or its signifier.
Signified
The physical thing or idea that the sign stands for.
Tuesday Week 5: Ambient Media
39
Theory and Practice of Tangible User Interfaces
Sign [Peirce 1931-58]
Signifier
The representation of the object, which could be a word, a picture, or a sound.
Sense
The understanding that an observer gets from seeing or experiencing either the signified or its signifier.
Signified
The physical thing or idea that the sign stands for.
Warm, hot, burn, bright, dangerous, etc.
Tuesday Week 5: Ambient Media
40
Theory and Practice of Tangible User Interfaces
Types of Signs•
Iconic
•
Symbolic
•
Indexical
[Peirce 1931-58]
Tuesday Week 5: Ambient Media
41
Theory and Practice of Tangible User Interfaces
Iconic SignsSigns that “resemble”
or “look like”
that to which they refer
to. A preference for “visual resemblance”
over all other possible sorts resemblance.
Tuesday Week 5: Ambient Media
42
Theory and Practice of Tangible User Interfaces
Iconic signsDrawings and caricatures
Tuesday Week 5: Ambient Media
43
Theory and Practice of Tangible User Interfaces
Iconic signsImitative gestures and metaphors
Tuesday Week 5: Ambient Media
44
Theory and Practice of Tangible User Interfaces
Symbolic SignsBased on code or rule-following conventions. Fundamentally arbitrary, so the relationship must be learned.
Tuesday Week 5: Ambient Media
45
Theory and Practice of Tangible User Interfaces
Symbolic SignsLanguage characters, numbers
Tuesday Week 5: Ambient Media
46
Theory and Practice of Tangible User Interfaces
Abstract visual representations
Symbolic Signs
Tuesday Week 5: Ambient Media
47
Theory and Practice of Tangible User Interfaces
Indexical SignsDirectly connected to the signified (physically or causally). The link can be observed or inferred.
Tuesday Week 5: Ambient Media
48
Theory and Practice of Tangible User Interfaces
Indexical SignsNatural signs
Jason Courtney http://www.perdador.com/f6update/Oc3.html
Tuesday Week 5: Ambient Media
49
Theory and Practice of Tangible User Interfaces
Indexical SignsMeasuring instruments (weathercock, thermometer, clock)
Tuesday Week 5: Ambient Media
50
Theory and Practice of Tangible User Interfaces
Indexical SignsMeasuring instruments (weathercock, thermometer, clock)
Tuesday Week 5: Ambient Media
51
Theory and Practice of Tangible User Interfaces
Indexical SignsSignals
Tuesday Week 5: Ambient Media
52
Theory and Practice of Tangible User Interfaces
Indexical SignsRecordings (a photograph, a film, video or television shot, an audio-recorded voice), maps, photos.
Tuesday Week 5: Ambient Media
53
Theory and Practice of Tangible User Interfaces
Signs
in Context of Use
to represent “cold weather”
== Indexical
to represent “snow flake”
== Iconic
to represent “GO for ski”
== Symbolic
Tuesday Week 5: Ambient Media
54
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
55
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
56
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
57
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
58
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
59
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
60
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
61
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
62
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
63
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
64
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
65
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
66
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
67
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media
68
Theory and Practice of Tangible User Interfaces
ICONIC
Resembling or imitating the signified
SYMBOLIC
Arbitrary, rule-following, must be learned
INDEXICAL
Not arbitrary and
is directly connected to the signified
VISUAL
AUDITORY
TACTILE
OLFACTORY
TASTE
???
Tuesday Week 5: Ambient Media
69
Theory and Practice of Tangible User Interfaces
Beyond ambient displays
Tuesday Week 5: Ambient Media
70
Theory and Practice of Tangible User Interfaces
Ambient “input methods”Presence and activity sensors Gestural
input
Tangible interfaces
[Vogel & Balakrishnan, 2004]
Tuesday Week 5: Ambient Media
71
Theory and Practice of Tangible User Interfaces
None Noun VerbNoun
and VerbFull
Full
Nearby
Environ-
ment
Distant
Metaphor
Embodiment
Ambient Media?
Tuesday Week 5: Ambient Media
72
Theory and Practice of Tangible User Interfaces
None Noun VerbNoun
and VerbFull
Full
Nearby
Environ-
ment
Distant
Metaphor
Embodiment
Ambient Media?
Tuesday Week 5: Ambient Media
73
Theory and Practice of Tangible User Interfaces
Beyond fore vs. background“Load balancing”
of senses to reduce cognitive load
Tuesday Week 5: Ambient Media
74
Theory and Practice of Tangible User Interfaces
Thanks!