sensorial and musical interaction
DESCRIPTION
Module in master course. Tangible Interaction. Interaction DesignTRANSCRIPT
![Page 1: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/1.jpg)
sensorial and
musical interaction
Birgitta Cappelen, AHO, 2. November 2012
![Page 2: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/2.jpg)
Overview Sensorial and musical interaction
the context – the RHYME-project
the design challenge
the assignments
Group presentations
Exhibition 16.30 – 19.00
![Page 3: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/3.jpg)
the context
![Page 4: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/4.jpg)
module in master course
Tangible Interaction
Interaction Design
![Page 5: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/5.jpg)
3 RHYME courses 2010 e-textile (with KhiO-textile)
2011 Musical interaction and e-textile (KhiO)
2012 Sensorial and musical interaction
![Page 6: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/6.jpg)
the
RHYME project
(2010-2015)
![Page 7: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/7.jpg)
VERDIKT – The future of Internet
![Page 8: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/8.jpg)
![Page 9: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/9.jpg)
![Page 10: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/10.jpg)
![Page 11: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/11.jpg)
RHYME co-creation through
tangible interaction
and music
![Page 12: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/12.jpg)
co-creation with tangible,
spatial, cross-media
by communicative, musical and
narrative principles
to improve health and well-being
for people with severe disabilities
![Page 13: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/13.jpg)
RHYME
project background
![Page 14: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/14.jpg)
![Page 15: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/15.jpg)
music effects
health and wellbeing
![Page 16: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/16.jpg)
16 family musiking in Vinings
![Page 17: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/17.jpg)
multisensory room- Snoezelen
![Page 18: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/18.jpg)
a white Snoezelen Room
![Page 19: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/19.jpg)
the Internet of Things
Ubiquitous Computing
![Page 20: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/20.jpg)
![Page 21: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/21.jpg)
multidisiplinary:
tangible interaction
universal design
music therapy
interactive Art
![Page 22: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/22.jpg)
RHYME
project goal
![Page 23: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/23.jpg)
improve health through
![Page 24: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/24.jpg)
24 playing in ORFI
![Page 25: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/25.jpg)
reduction of
isolation and passivity
![Page 26: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/26.jpg)
family playing in Wave Carpet
![Page 27: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/27.jpg)
evoke positive feelings
increase ability to master
develop and strengthen
social relations
![Page 28: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/28.jpg)
RHYME
development so far
![Page 29: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/29.jpg)
2 new generations of
interactive musicking “things”
(tangibles)
5 new hardware platforms
to sketch up new concepts
![Page 30: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/30.jpg)
iDevice, jDevice, kDevice (bluetooth)
(iPhone/iPod,
RHYME mobile breakout card, sensors,LEDs)
RHYME wireless (Android, Google I/O ADK)
RHYME wired
(Arduino Mega, Shield, MiniMac)
![Page 31: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/31.jpg)
iPod Touch inside Wave Orange
![Page 32: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/32.jpg)
tactile textile touch sensors
![Page 33: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/33.jpg)
33 Current music technology
![Page 34: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/34.jpg)
Wave Carpet’s bubble field
![Page 35: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/35.jpg)
Reflect’s ligt field
![Page 36: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/36.jpg)
people with dementia remember with music playing in Wave Carpet
![Page 37: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/37.jpg)
details of light and sound fiels in Wave Orange
![Page 38: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/38.jpg)
the design challenge
![Page 39: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/39.jpg)
the design challenge
motivate musicking for diverse users
sensorial embodied interaction
cross-media possibilities
e-textile and soft interaction
mobile technology
resource orientation
empowering
design for diversity
![Page 40: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/40.jpg)
Musicking
40
![Page 41: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/41.jpg)
musicking
from Music as a work of art (object)
to Music as a meaning making and relation building
equal activity (verb)
play, listen, sing, dance, hum, move, rug, shake,
stroke, sleep, clapping, running, step...
It is about expressing ones identity in and with music
and music related activities in everyday situations
41
![Page 42: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/42.jpg)
42 friends playing in ORFI
![Page 43: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/43.jpg)
cross-media explorations
![Page 44: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/44.jpg)
build cross-media consistent expectations over time
![Page 45: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/45.jpg)
offer many ways of self-expression and cross-media interaction
![Page 46: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/46.jpg)
Cross-media possibilities in Wave Carpet
![Page 47: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/47.jpg)
so far...
limited smart textile
available possibilities
![Page 48: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/48.jpg)
Current smart textile possibilities
(X-labs, Worbin, Diffus)
![Page 49: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/49.jpg)
too slow
too fragile and
unsatisfactory surface qualities
![Page 50: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/50.jpg)
current smart textile possibilities, Philips, Diffus
![Page 51: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/51.jpg)
transparency and tactility
![Page 52: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/52.jpg)
Girl interacting with Wave Carpets bubble field
![Page 53: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/53.jpg)
Anima ligt bubbles
![Page 54: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/54.jpg)
Resource and Empowerment
orientation
Focus on the persons strengths and abilities, not their
special needs, weaknesses and diagnosis
offer:
positive experiences, no wrongs or failing
ways to vitality and self-expression
ability to act and build competence (mastering)
ways to strengthen mutual social relations
diverse ways to share and participate
54
![Page 55: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/55.jpg)
55 Boy musicking in ORFI
![Page 56: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/56.jpg)
Accessibility
Design for Diversity
![Page 57: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/57.jpg)
the assignments
![Page 58: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/58.jpg)
4 Weeks 1. Sensorial Interaction . Create 4 input sensors each.
Focus on Shape, Structure, Material, Surface, Interaction, Accessibility.
2. Create 3 Concepts for Sensorial and Musicking Tangibles.
Focus on motivation, musicking and co-creation over long time.
Use iPod Touch, kDevice, mobile battery, Speaker,
3. 4. Designing and build one concept .
Focus on making it work, interaction, sensorial stimulation and
musicking.
![Page 59: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/59.jpg)
Group presentation
Stump Drum - Valeria, Martin, Sven-Håkon
Rolling Rock - Amra, Anders
Cove - Berit, Lucien
Chilli Net - Ron, Mariko
Ebbe - Sara, Bai Daniel
Whispering willow - Hans Jakob, Rosita
![Page 60: Sensorial and musical interaction](https://reader033.vdocuments.site/reader033/viewer/2022052618/548e3478b4795956138b491f/html5/thumbnails/60.jpg)
www.RHYME.no