information visualization:
DESCRIPTION
Information Visualization:. Application to Musical Alphabets. By Jonathan Wesel. Information Visualization. “Unnatural” graphical representations of abstract data Musical staff example vs non-visual alternative?. Musical Representation. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/1.jpg)
Information Visualization:
Application to Musical Alphabets
By Jonathan Wesel
![Page 2: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/2.jpg)
Information Visualization
• “Unnatural” graphical representations of abstract data– Musical staff example
– vs non-visual alternative?
![Page 3: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/3.jpg)
Musical Representation
• Standard modern musical notation is credited to Pythagoras (Hall, 1928)
• Representation by human processing (Deutsch/Feroe, 1981)
![Page 4: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/4.jpg)
Enhanced Visualization
• Gestalt Laws of Visual Perception– Similarity– Proiximity– Continuation
• Color– Color coding– Color and sound
• Visual cues– Music and motion.
![Page 5: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/5.jpg)
Gestalt Laws
• Similarity : group similar elements
![Page 6: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/6.jpg)
Gestalt Laws
• Similarity : group similar elements
![Page 7: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/7.jpg)
Gestalt Laws
• Similarity : group similar elements
problem…
![Page 8: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/8.jpg)
Gestalt Laws
• Similarity : group similar elements
problem…
…solution
![Page 9: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/9.jpg)
Gestalt Laws
• Proximity: group close elements
![Page 10: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/10.jpg)
Gestalt Laws
• Proximity: group close elements
Two groups…
![Page 11: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/11.jpg)
Gestalt Laws
• Proximity and Similarity
– comparison to similarity solution:• Same result• Proximity was used to solve similarity problem
![Page 12: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/12.jpg)
Gestalt Laws
• Continuity: group elements to form smooth curves or lines
– Meaningful color:• Pitch ascent = rising colors• Pitch descent = falling colors
![Page 13: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/13.jpg)
Gestalt Laws
• Similarity, Proximity, & Continuity
– Use/Effect requires experimentation
![Page 14: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/14.jpg)
Color
• Pythagoras:– “Through vibration comes motion; through motion comes color; through color comes tone.
• Newton: – Split spectrum of light into 5 colors, then
added 2 to “complete the octave”
![Page 15: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/15.jpg)
Color
• The color of music (Schloss, 2008)– Participants chose colors that were most
and least consistent with classical music they were presented with
– A strong agreement was found between the colors chosen to be most consistent with the same musical selections.
![Page 16: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/16.jpg)
Color
• Color in Music-Reading (Rogers, 1996)– Elementary students were taught rhythm
by using notations in both color and black and white.
– Hand clapping was used to demonstrate the students interpretation.
– Students who used the colored notation scored higher in accuracy as well as noting greater enjoyment from the lessons.
![Page 17: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/17.jpg)
Music and Motion
• Study, Barnes-Burroughs, 2004– Students of music would follow the contour
of a melody with their head and neck producing a negative result in the sound.
– Can this be fixed by an alternative representation?
![Page 18: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/18.jpg)
Music and Motion
•Suggestion–Mapped notes to colors
–New representation
![Page 19: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/19.jpg)
Music and Motion
• This visualization seems to solve the problem, but creates many more problems. (octaves ect…)
• This visualization is unlikely to be effective because it is too far from what is well known.
![Page 20: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/20.jpg)
Conclusion
• Further research and experimentation must be done to determine effectiveness of…– Using Gestalt Laws– Using Color– Removing Contour
![Page 21: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/21.jpg)
SourcesAllchin, Douglas. "Newton's Colors." SHiPS Resource Center. 10 Oct. 2008
<http://www1.umn.edu/ships/updates/newton1.htm>.Barnes-Burroughs, Kathryn, Christopher Watts, Oren L. Brown, and Jeannette LoVetri.
"The Visual/Kinesthetic Effects of Melodic Contour in Musical Notation as it Affects Vocal Timbre in Singers of Classical and Music Theater Repertoire." Journal of Voice 19 (2004): 441-19.
"Color Music--Found Images and the Second Perfect Number." Weblog post. Ptak Science Books. 18 May 2008. 10 Nov. 2008 <color music--found images and the second perfect number.>.
Deutch, Diana, John Feroe, "The Internal Representation of Pitch Sequences in Tonal Music.” Psychological Review 88 (1981): 504-522.
Doleisch, Helmut. Visual Interactive Analysis Research Group. n.d. 21 Sept. 2008 http://www.vrvis.at/via/.
Ellis, Willis D. A Source Book of Gestalt Psychology. New York: Harcourt, Brace & Co, 1938.
Hall, Manly P. "The Pythagorean Theory of Music and Color." The Secret Teachings of All Ages. 1928. 81-84.
![Page 22: Information Visualization:](https://reader036.vdocuments.site/reader036/viewer/2022062321/56814168550346895dad4c81/html5/thumbnails/22.jpg)
Sources
Havre, Susan L, Anuj Shah, Christian Posse, et al. Diverse Information Integration and
Visualization. n.d. 21 Sept. 2008 http://infoviz.pnl.gov/pdf/SPIE_proceedings_6060_22.pdf.
Keller, Tanja, Peter Gerjets, Katharina Scheiter, and Barbel Garsoffky, “Information visualizations for knowledge acquisition: The impact of dimensionality and color coding.” Computers in Human Behavior 22 (2006): 43-65
Lengler, Ralph and Martin J. Eppler. A Periodic Table of Visualization Methods. n.d. 21 Sept. 2008 http://www.visual-literacy.org/periodic_table/periodic_table.html.
Li, Xuelong Li, Dacheng Tao, Stephen J. Maybank, and Yuan Yuan, “Visual music and musical vision” Neurocomputing 71 (2008): 2023-2028
Rogers, George L. "Effect of Colored Rhythmic Notation on Music-Reading Skills of Elementary Students." Journal of Research in Music Education 44 (1996): 15-25
Sahling, Gerald Nikolaus. Interactive 3D Scatterplots - From High Dimensional Data to Insight. n.d. 21 Sept. 2008
Schloss, Karen B., Partrick Lawler, and Stephen E. Palmer. "The color of music." Journal of Vision 8 (2008): 580.