thursday week 10: synthesis theory and practice of...
TRANSCRIPT
Thursday Week 10: Synthesis
1
Theory and Practice of Tangible User Interfaces
SynthesisMapping between the input and output space
week 10
Thursday Week 10: Synthesis
2
Theory and Practice of Tangible User Interfaces
Physical Computing
Illustration adapted and modified from O’Sullivan and Igoe
Thursday Week 10: Synthesis
3
Theory and Practice of Tangible User Interfaces
Physical Computing
Illustration adapted and modified from O’Sullivan and Igoe
Thursday Week 10: Synthesis
4
Theory and Practice of Tangible User Interfaces
Transducers
Output TransducersActuators (e.g., motors, piezo, etc.)
Input TransducersSensors (e.g., pot, FSR, photo sensor, etc.)
Illustration adapted and modified from O’Sullivan and Igoe
Thursday Week 10: Synthesis
5
Theory and Practice of Tangible User Interfaces
Designing Tangible UI
Illustration adapted and modified from O’Sullivan and Igoe
Designing meaningful interaction loop that takes advantage of your hands and body to manipulate digital information.
Thursday Week 10: Synthesis
6
Theory and Practice of Tangible User Interfaces
Thursday Week 10: Synthesis
7
Theory and Practice of Tangible User Interfaces
Responding?
Thoughtless Acts
Thursday Week 10: Synthesis
8
Theory and Practice of Tangible User Interfaces
Thursday Week 10: Synthesis
9
Theory and Practice of Tangible User Interfaces
Come a Little Bit Closer Bench [droog, 2001]
Thursday Week 10: Synthesis
10
Theory and Practice of Tangible User Interfaces
Do Hit [van der
Poll, 2001]
Thursday Week 10: Synthesis
11
Theory and Practice of Tangible User Interfaces
Output
What We Feel Output Transducers
Light LEDs
Sound Piezo
speakers
Motion DC motors
Vibration Servo motors
Pager motors
LCDs
Heat
Smell
. . . . .
Input
Input Transducers What We Do
FSR Press
Potentiometer Twist
Switch Turn
Photo sensor Shake
Accelerometer Kick
Tilt sensor Stretch
IR sensor Squeeze
Pound
Stroke
. . . . .
Thursday Week 10: Synthesis
12
Theory and Practice of Tangible User Interfaces
Output
What We Feel Output Transducers
Light LED
Sound Piezo
speaker
Motion DC motor
Vibration Servo motor
Balance Pager motor
Heat LCD display
Cold Projector
Smell . . . . .
. . . . .
Input
Input Transducers What We Do
FSR Press
Potentiometer Twist
Switch Turn
Photo sensor Shake
Accelerometer Kick
Tilt sensor Stretch
IR sensor Squeeze
. . . . . Pound
Scratch
. . . . .
Thursday Week 10: Synthesis
13
Theory and Practice of Tangible User Interfaces
Output
What We Feel Output Transducers
Light LED
Sound Piezo
speaker
Motion DC motor
Vibration Servo motor
Balance Pager motor
Heat LCD display
Cold Projector
Smell . . . . .
. . . . .
Input
Input Transducers What We Do
FSR Press
Potentiometer Twist
Switch Turn
Photo sensor Shake
Accelerometer Kick
Tilt sensor Stretch
IR sensor Squeeze
. . . . . Pound
Scratch
. . . . .
Thursday Week 10: Synthesis
14
Theory and Practice of Tangible User Interfaces
Output
What We Feel Output Transducers
Light LED
Sound Piezo
speaker
Motion DC motor
Vibration Servo motor
Balance Pager motor
Heat LCD display
Cold Projector
Smell . . . . .
. . . . .
Input
Input Transducers What We Do
FSR Press
Potentiometer Twist
Switch Turn
Photo sensor Shake
Accelerometer Kick
Tilt sensor Stretch
IR sensor Squeeze
. . . . . Pound
Scratch
. . . . .
Thursday Week 10: Synthesis
15
Theory and Practice of Tangible User Interfaces
Output
What We Feel Output Transducers
Light LED
Sound Piezo
speaker
Motion DC motor
Vibration Servo motor
Balance Pager motor
Heat LCD display
Cold Projector
Smell . . . . .
. . . . .
Input
Input Transducers What We Do
FSR Press
Potentiometer Twist
Switch Turn
Photo sensor Shake
Accelerometer Kick
Tilt sensor Stretch
IR sensor Squeeze
. . . . . Pound
Scratch
. . . . .
Thursday Week 10: Synthesis
16
Theory and Practice of Tangible User Interfaces
Output
What We Feel Output Transducers
Light LED
Sound Piezo
speaker
Motion DC motor
Vibration Servo motor
Balance Pager motor
Heat LCD display
Cold Projector
Smell . . . . .
. . . . .
Input
Input Transducers What We Do
FSR Press
Potentiometer Twist
Switch Turn
Photo sensor Shake
Accelerometer Kick
Tilt sensor Stretch
IR sensor Squeeze
. . . . . Pound
Scratch
. . . . .
Thursday Week 10: Synthesis
17
Theory and Practice of Tangible User Interfaces
In Class Exercise
Thursday Week 10: Synthesis
18
Theory and Practice of Tangible User Interfaces
Build an instrument that produces sound in response to physical manipulation.
In Class Exercise
Blue Man Group
Thursday Week 10: Synthesis
19
Theory and Practice of Tangible User Interfaces
1.
Work in teams of four.
2.
The instrument should use at least 4 input devices.
The devices can be
all the same, all different, or any combination in between.
3.
Consider your instrument to be collaborative
(or even competitive).
4.
Think critically about the mapping between the input and output space.
Guideline
Thursday Week 10: Synthesis
20
Theory and Practice of Tangible User Interfaces
Input Transducers
Thursday Week 10: Synthesis
21
Theory and Practice of Tangible User Interfaces
Output Transducers
Thursday Week 10: Synthesis
22
Theory and Practice of Tangible User Interfaces
Piezo
SpeakerOutput 1
c d e f g a b C
period
PW
PW
period
Thursday Week 10: Synthesis
23
Theory and Practice of Tangible User Interfaces
Sound LibraryOutput 2
Thursday Week 10: Synthesis
24
Theory and Practice of Tangible User Interfaces
Thursday Week 10: Synthesis
25
Theory and Practice of Tangible User Interfaces
Actuated SoundOutput 3
Thursday Week 10: Synthesis
26
Theory and Practice of Tangible User Interfaces
Animusic
Thursday Week 10: Synthesis
27
Theory and Practice of Tangible User Interfaces
STOMP
Thursday Week 10: Synthesis
28
Theory and Practice of Tangible User Interfaces
MappingThink critically about the mapping between the input and output space.
Thursday Week 10: Synthesis
29
Theory and Practice of Tangible User Interfaces
HomeworkPost descriptions and photos (and/or video) of your instrument on the course website.
Thursday Week 10: Synthesis
30
Theory and Practice of Tangible User Interfaces
Let’s get started!