songs of data: an introduction to sonification
TRANSCRIPT
Songs of Data
An introduction to sonification
Iain EmsleyOxford e-Research Centre, University of Oxford
[email protected]@iainemsley@minnelieder
1
Overview
• Introduction to Sonification• Sonifying Hamlet• Auditory Beacons• Identifying Signal to Noise in Twitter• Hemlines and Big Macs• Some Principles• Conclusions
2
CRISP-SKA
Cluster of Research Infrastructures for Synergies in Physics - Square Kilometre Array
Introduction to Sonification
• What is sonification?– Sonification is an alternative to visualization
“the use of non-speech audio to convey information. More specifically, sonification is the transformation of data relations into perceived relations in an acoustic signal for the purposes of facilitating communication or interpretation.” (Kramer, 1997)
• Using it for analysis
3
Introduction to Sonification
• Listening to Wikipedia - Hatnote
• We Need You – Julie Freeman using Zooniverse
4
Sonifying Hamlet
5
• Sonifying the Variants• Auditory Beacons
Sonifying the Variants
• From Play to Sonification• Using First Folio and Quartos data• Parsing the TEI XML, converting it with rule set into numbers,
sonifying the data to produce sounds
6
Sonification
Auditory Beacons
• Acts and Scenes– Different Instruments and Pitches
• Stage Directions– Different instruments– Period versus Modern sounds?
• Speakers– Increasing volume– Stereoscopic illusion using two streams
Identifying Signal to Noise in Twitter
• Data taken from mining Drupalcon• What is the amount of information?
Hemlines and Big Macs
• What do the above have in common?
Hemlines and Big Macs
• Light hearted views of economic data
• https://www.foreignaffairs.com/audios/2015-07-22/sound-economy
Some Principles
• Consider the aspect of data that will be useful• Research the data and context• Group sounds together
Conclusions
• Perceptions altered – Choices of sound– Use of multiple parameters
• Use of spatial and temporal events• An alternative method to explain and explore
data
12
References
De Roure, David C., Cruickshank, Don G., Michaelides, Danius T., Page, Kevin R. and Weal, Mark J. (2002) On Hyperstructure and Musical Structure. The Thirteenth ACM Conference on Hypertext and Hypermedia (Hypertext 2002), Maryland, USA, 11 - 15 Jun 2002. ACM, 95-104.
Iain Emsley and David De Roure, 2015. It will discourse most eloquent music: Sonifying variants of Hamlet., http://ora.ox.ac.uk/objects/uuid:1785e0ac-5cbb-4d35-8546-4495aa8baec8
William W. Gaver. 1986. Auditory icons: using sound in computer interfaces. Hum.-Comput. Interact. 2, 2 (June 1986), 167-177. http://dx.doi.org/10.1207/s15327051hci0202_3
The Big Mac index, The Economist, http://www.economist.com/content/big-mac-index
Thomas Hermann, Andy Hunt, John G. Neuhoff (Eds.), The Sonification Handbook, Edited by Logos Publishing House, Berlin 2011, 586 pages, 1. edition (11/2011)
Gregory Kramer. 1993. Auditory Display: Sonification, Audification, and Auditory Interfaces. Perseus Publishing.
G. Kramer, B. Walker, T. Bonebright, et al., Sonification report: Status of the field and research agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display (1997) http://sonify.psych.gatech.edu/publications/pdfs/1999-NSF-Report.pdf
Chandrasekhar Ramakrishnan and Steven Greenwood, Entropy Sonification, Proceedings of the 15th International Conference on Auditory Display, Copenhagen, Denmark May 18 - 22, 2009
Digital facsimile of the Bodleian First Folio of Shakespeare's plays, Arch. G c.7, First Folio home page, http://firstfolio.bodleian.ox.ac.uk/
The tragedy of Hamlet Prince of Denmarke: an electronic edition, Hamlet, First Quarto, 1603. British Library Shelfmark: C.34.k.1, http://www.quartos.org/XML_Orig/ham-1603-22275x-bli-c01_orig.xml
The tragedy of Hamlet Prince of Denmarke: an electronic edition, Hamlet, Second Quarto Variant, 1605. British Library Shelfmark: C.34.k.2, http://www.quartos.org/XML_Orig/ham-1605-22276a-bli-c01_orig.xml