94

SU, Yu-Huei / SOO, Von-Wun / HUANG, Chih-Fang / CHEN, Mei-Chih / LI, Hsi-Chang / CHEN, Heng-Shuen

Implementation of Interactive Ecological Sound Devices in a Long Term Care Facility

Abstract Previous soundscapes researches in Taiwan mainly focused on device design and environmental survey of urban or rural area with sound sample recording into digital archives. Some of the soundscapes research involving healing concept can be found from some other countries, such as Evert De Ruiter’s "Healing soundscape” for hospital acoustics 2.0 (Netherlands), “healing soundscpaes” project by Georg Hajdu, Clemens Wöllner, Eckhard Weymann, etc. with the technical realization of interactive electronic sound compositions and their installation. Dong Zhou’s “Interactive Environmental Sound Installation for Music Therapy Purpose” (Germany, China) designs the interactive music and sound to relax the atmosphere of waiting in a hospital. In this study, the concept of sound field system would be further applied to space and environment design of long term care facilities in Puli Christian Hospital and Quixotic Implement Foundation. Through interactive ecological sound devices, the auditory atmosphere could provide an environment of mood changing and stress reduction for the residents, doctors, nurses, caregivers and visiting families in the facility. The installed interactive sound device could be also a guide to visitors and attract their motivation to participate the interactive activities by enhancing the perception and sensory link. With combination of Arduino electronic circuit boards and various sensors, Max / MSP software were used to control and produce a variety of ecological sound in real time. Although the concept of soundscape is based on Murray Schafer since 1977, it is not popular yet in Taiwan to design/compose the electroacoustic music applying the concept. In our proposed system, the Taiwanese soundscape composition includes the sound samples of ocean, wind, bird singing, hybrid with Taiwanese popular song and Western classic music. Infrared sensors detect if any person is inside the range of the proposed soundscape system. After the system is triggered, than the ultrasound sensor will be interactive with the real time electroacoustic music composition based on the soundscape samples. There are five levels for the real time soundscape composition morphing, according to different range between the system and the listener to represent the correspondent relieving conditions of the mood. Indoor and outdoor device designs were applied respectively and user satisfaction survey would be done to provide further information for improvement. Keywords: sound field, sound device, sensor, Acoustic Eco1ogy, long term care 1. Introduction The concept of the Soundscape was proposed by the Canadian composer Murray Schafer in the early 1970s. His WORLD SOUNDSCAPE PROJECT had launched a series of studies from traditional individual sound researches to holistic environment sound field surveys [1,2]. In contrast to ecomusicology as the study of music, culture, and nature, Acoustic Eco1ogy is the study of Soundscape including any elements in the sonic environment also inspired by the Schafer. Previous soundscape researches in Taiwan mainly focused on device design [3,4,5] and environmental survey of urban or rural area [6,7]. Some of the soundscapes research involving healing concept can be found from some other countries, such as Evert De Ruiter’s "Healing soundscape: hospital acoustics 2.0" (Netherlands), using soundscape regarding to the complex sound environment including noise contorl for hospitals [8]. Georg Hajdu, Clemens Wöllner, Eckhard Weymann, Se-bastian Debus, Jan Sonntag, Frank Böhme, and John Groves’ “healing soundscpaes” (Germany) also uses soundscape for the medical environment, to integrate the music-psycho-artistic art research project with the technical realization of interactive electronic sound compositions and their installation [9, 10]. Dong Zhou’s “Interactive Environmental Sound Installation for Music Therapy Purpose” (Germany, China) adapts Max/MSP to compose the interactive music and sound to relax the atmosphere of waiting in a hospital [11]. In this study we applied the concept of soundscape, integration of music creativity and technology, interactive ecological sound device in a healthcare environment. The devices were designed to install in

95

the long-term care facility of Puli Christian Hospital. Puli Christian Hospital is the only regional teaching hospital in Nantou County, Taiwan. Quixotic Implement Foundation was established to promote complex elderly welfare services in greater Puli area under the concept of community-oriented, unit care, group home and small-scale multi-function for social welfare and long-term care services. In this study, the environmental requirement assessment and installation design have been completed. After completion of installation, the natural ecological sound will be introduced into the space and change the auditory atmosphere to provide the residents, doctors, nurses, care workers and visiting families an environment for changing mood and relieving stress. This interactive sound setting can be a medium to attract visitors and enhance participation in interactive activities and sensory links. Interactive sound device with sensors based on different types of sound scenes to play respectively. In addition to the ecological sound playing, some specific music will be played synchronously. The devices combining auditory, visual, and spatial characteristics could also adjust between the different senses and trigger and link the different sense perceptions of the visitors. 2. Methods 2.1 Environmental Assessment 2.1.1 Mushrooms Farm in the Nursing Home There is a mushroom farm which offered residents to plant and watch the growth of mushrooms in the Nursing Home of Puli Christian Hospital. The installed interactive sound devices in the mushroom farm area could increase incentives of residents to walk, watch and plant mushrooms. It could also increase residents’ auditory and visual stimulation with interactive devices introducing natural soundscape and music to establish an ecological environment in an indoor space. 2.1.2 The garden pool in the outdoor space The garden pool in the outdoor space of Quixotic Implement Foundation is a public area that provides residents to take a walk and to have conversation. The pool is surrounded by trees, flowers and seats for recreation. To increase the incentive of the residents to use, the interactive devices with sensors could be triggered to play different soundscape related to specific scene or activities. The introduced natural sound mixes with original sound of public space could be integrated even better. 2.2 Concept of Interactive Soundscape and Technique 2.2.1 Mushrooms Farm in the Nursing Home The concept is that natural soundscape-- water flow sound is played and warm light is turned on when someone enters the space area. Participants can immediately feel the auditory and visual changes in the natural atmosphere and transform the original cold scene space. As approaching the mushroom farm, another music element which is nature music is turned on. It can present relax and smooth atmosphere in the space through melodious music, water flow sound of natural soundscape and warm light. Two infrared sensors were placed in the space that can instantly turn on the audio playback and light by Arduino dashboard or Raspberry Pi dashboard in the mushroom farm. First infrared sensor can turn on water flow sound and orange LED light at top space as sensing someone enters into the space, and another one can turn on smooth music playback such as nature music repertoire as sensing someone close to the mushroom farm (Figure 1). We can analyze the usage frequency of the space and emotional change of residents before and after installing the interactive devices through questionnaire survey. 2.2.2 The garden pool in the outdoor space The concept of the set of people near the pool will appear around the natural sound, such as water, The concept is that natural sound plays when people approach, such as water flow, birds sound, cicadas sound, cricket cries, by four independent channel speakers playing in different positions. People walk through the pool will hear different natural sound from different pool orientation, and thus enhance auditory richness of the place. So that people who pass through the pool, or people sitting in the pool can continue to hear the natural soundscape to play, and then enhance the use of the space and appreciation of natural sound, to cultivate temperament, and promote interpersonal relationship. Four human infrared sensors were placed in the four fixed points of the wood bracket above the pool to sense four directions respectively. When someone walks to pass or sits beside the pool, the human infrared sensor will trigger the specific natural sound playback. Through the link to Arduino or

96

Raspberry Pi control panel the software will immediately start audio playback from the speaker (Figure 2).

Figure 2. The garden pool in the outdoor space 3. Discussions and Conclusion Through the installation of the interactive soundscape devices, it is expected to enhance the residents’ incentives in participating the activities in public space. By increasing physical and psychological stimulation of the auditory, visual and spatial dimensions in indoor or outdoor space, improved interpersonal relationship with positive emotional effects could be achieved. Evaluation of psychophysiological and behavior changes could be done with Bio-signal measurements and questionnaires survey after the soundscape intervention. The environmental limitation is also important impact factor. For example in the garden pool in the outdoor space of Quixotic Implement Foundation, we need to take into account the electronic equipment placed outdoors, under sunshine and rainwater that could be easily damaged. In this study the concept of sound scenes was extended to the design of the public space environment of the long term care facilities. Through the interactive devices and sensors with triggered ecological sound playback, the original long-term care facility atmosphere was modified and transformed to positive emotional effect and stress reduction for residents, doctors, nurses, care workers and visiting families. In this study device designs were applied respectively and user satisfaction survey would be done to provide further information for improvement. Acknowledgments This study was supported by the Grants for Ministry of Science and Technology (MOST 105-2218-E-007-031 ) in Taiwan. Warm thanks are due to technical assistants, Chi-Shen Wu and Feng-Chen Hsieh. 4. References [1] Yang, C.C. and Lu, T.H.C. “The Study of Sound and Space: Global Trends and Local

Responses”. Guandu Music Journal ,13 ,77-96,2010. [2] Chen, M.Z. “The Practice of the Ecology Sound Interactive Installation in Campus-In

the example of Shanghai Conservatory of Music”. Entertainment Technology,48,15-21,2010.

[3] Wei-Ting Su. “Reconstruction of Cultural Soundscape toward a Sound Experience in West Central District”, Tainan City, Taiwan. (Unpublished master’ s thesis). National Cheng Kung University,Tainan,2014.

[4] Chi, T.S. “Eco-Conductor – Interactive Soundscape with virtual ecosystem”. (Unpublished master’ s thesis). National Chiao Tung University, Hsinchu,2010.

Figure1. Mushrooms Farm in the Nursing Home

97

[5] Huang, H.J.. Soundscapes of five cities in Taiwan - A Digital Audio/Video Composition Implementation”. (Unpublished master’s thesis). National Chiao Tung University, Hsinchu, 2014.

[6] Wang, J. C. S. “Soundscape's Expression in the Two-city Case: Imagination of Environmental Sociology”. Journal of Building and Planning, National Taiwan University, 10, 89-98, 2001.

[7] Lee, C.L. “A Research on Soundscape along MRT Lines in Two Cities: Field Investigation and Sound Stage Listening Reconstruction” (Unpublished master’s thesis). National Chiao Tung University, Hsinchu.2014.

[8] De Ruiter, Evert. “Healing soundscape: hospital acoustics 2.0.” (2015). Accessed April 29th 2017: http://www.conforg.fr/euronoise2015/proceedings/data/articles/000233.pdf

[9] Georg Hajdu, Clemens Wöllner, and Eckhard Weymann. “Healing Soundscape” https://www.unserenhochschulen.de/projekte/unseren-hochschulen-2016/gewinner-2016-healing-soundscape.html?tx_hkschuelerlogin_pi2%5Bantrag%5D=50&tx_hkschuelerlogin_pi2%5Baction%5D=publicDetail&tx_hkschuelerlogin_pi2%5Bcontroller%5D=Hschulantrag&cHash=9fe8a2aa88f2d24301c813a329c2309f

[10] Georg Hajdu, Clemens Wöllner, Eckhard Weymann, Sebastian Debus, Jan Sonntag, Frank Böhme, and John Groves. “Healing Soundscape: a study of the effect of sound and music in a medical environment”, GROVES Sound Communications, accessed April 29th 2017: http://groves.de/de/en/wp-content/uploads/sites/4/2017/01/Healing-Soundscape-study-on-the-effect-of-sound-and-music-in-a-medical-environment.pdf

[11] Dong Zhou. “Interactive Environmental Sound Installation for Music Therapy Purpose”, 2016 IRCAM Forum - WOCMAT Joint Conference, Kainan University, Taoyuan, Taiwan, December 14-16, 2016, pp. 34-37.

- Yu-Huei Su Yu-Huei Su, the full Professor at the Music Department of College at National Tsing Hua University. She acquired a Ed.D. degree in education, a M.Mus. degree in orchestra conducting and a B.Mus. degree in piano performance. She is also the director of “Center for Music, Technology and Health” in National Tsing Hua University. Prof. Su’s specialties include music and health technology integration, health promotion for music performers, social and applied psychology of music, measurement of music behaviors. She was the Co-Chair in 2010 and the Chair in 2014 of the International Symposium of Music and Health Promotion-The New Trend in Music Medicine, Music Therapy and e-Health Technology. She is an editorial board member of Journal of Aesthetic Education now. She is also a committee member of Higher Education Evaluation Committee in Fields of Arts, Taiwan Higher Education Evaluation and Accreditation Center yhsu@mail.nd.nthu.edu.tw - Von-Wun Soo Prof. Von-Wun Soo had his academic training in electrical engineering at National Taiwan University. He obtained biomedical engineering master degree at EE and then computer science ph. D degree at Rutgers. He has been studying artificial intelligence for 30 years since his Ph D. He has served two years as president of Taiwanese Association in artificial intelligence. He has also participated in organizing international conferences. In 2011, he hosted International Conference on AAMAS at Taipei. His research interests are on machine learning, natural language, and intelligent agents. He has worked on various applications such as prediction drug adverse effects in bioinformatics, story generation using common sense causality and energy management based on multi-agent coordination techniques. Currently he is leading research projects of Ministry of Science and Technology in Taiwan on 1) Deep Learning in Personalized Music Recommendation for Healthcare, 2) Automated Story Generation based on Commonsense and Monte Carlo Tree Search. soo@cs.nthu.edu.tw

98

- Chih-Fang Huang Chih-Fang Huang, the Associate Professor at the Department of Information Communications at Kainan University, was born in Taipei city, Taiwan. He acquired both a PhD in mechanical engineering and a master’s degree in music composition respectively from National Chiao Tung University. He studied composition under Prof. Wu, Tin-Lien, and computer music under Prof. Phil Winsor. His electroacoustic pieces have been performed in Asia, Cuba, Europe, and the USA, such as the electroacoustic piece “Microcosmos” were selected and performed in International Computer Music Conference (ICMC) in 2006, and the composition presented in CEMI (Center for Experiment Music and Intermedia), University of North Texas in 2010, and works performed in Berlin, Cologne, Sweden, Italy in 2011-12, etc. He is also the fellow of 2012 Art Music Residency, New York. In 2013 he was selected into the International Conducting Master Class of Martinu Philharmonic Orchestra under Mr. Kirk Trevor and Prof. Donald Schleicher, performing the works of Debussy, Brahms, etc. In 2014 he was invited to conduct the Greater Miami Youth Symphony (GMYS) orchstra. His research papers include many fields, such as automated music composition and the sound synthesis, which have been published in ICMC and international SCI/SSCI/AHCI Journals. Now he is also the conductor of the Taoyuan New Philharmonic Orchestra. jeffh.me83g@gmail.com - Heng-Shuen Chen Assistant Professor Dr. Heng-Shuen Chen received his medical education in 1978-1985, and family medicine residency training in 1987-1992. Since then he served as an attending physician of Family Medicine and a faculty in the Departments of Medical Informatics and Family Medicine, College of Medicine, National Taiwan University. He also earned a Ph. D. in Electrical Engineering in 2000 from the same university. His research interests in health information system, mobile computing, e-learning, telemedicine and e-health, led him to several large projects funded by government. He was leading NII telemedicine project, NII distance education projects, national health e-learning project for primary and secondary schools, a multidisciplinary project u-HOSP (Ubiquitous Hospital) with universities, research institutes and industry alliances of telehealth. From 2016, Dr. Chen moved to Puli Christian Hospital and serves as director of Community Medicine department and International Medical Affairs office. He still continues the tie with NTU College of Medicine and NTU Hospital as an adjunct faculty. chenhs@ntu.edu.tw