Understanding the structure of musical compositions: Is visualization an effective approach?

Experienced musicians have the ability to understand the structural elements of music compositions. Such an ability is built over time through the study of music theory, the understanding of rules that guide the composition of music, and countless hours of practice. The learning process is hard, especially for classical music, where the rigidity of the music structures and styles requires great effort to understand, assimilate, and then master the learned notions. In particular, we focused our attention on a specific type of music compositions, namely, music in chorale style (four-voice music). Composing such type of music is often perceived as a difficult task because of the rules the composer has to adhere to. In this article, we propose a visualization technique that can help people lacking a strong knowledge of music theory. The technique exploits graphic elements to draw the attention on the possible errors in the composition. We then developed an interactive system, named VisualMelody, that employs the proposed visualization technique to facilitate the understanding of the structure of music compositions. The aim is to allow people to make four-voice music composition in a quick and effective way, that is, avoiding errors, as dictated by classical music theory rules. We have involved 40 people in testing VisualMelody in order to analyze its effectiveness, its usability, and the overall user satisfaction. We partitioned the people involved in the evaluation study into two groups evenly splitting the musical expertise. Then, we had one group use VisualMelody without the visualization facilities and the other using the tool enhanced with our visualization. On average, people in the group that used our visualization were 60% faster and produced music with less errors.

[1]  Cristina Conati,et al.  Evaluating the Impact of User Characteristics and Different Layouts on an Interactive Visualization for Decision Making , 2014, Comput. Graph. Forum.

[2]  Ilkka Korhonen,et al.  Implementation and user testing of a system for visualizing continuous health data and events , 2016, 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[3]  John T. Stasko,et al.  An evaluation of space-filling information visualizations for depicting hierarchical structures , 2000, Int. J. Hum. Comput. Stud..

[4]  José Manuel Iñesta Quereda,et al.  Harmonic, Melodic, and Functional Automatic Analysis , 2007, ICMC.

[5]  Vittorio Scarano,et al.  A Tailorable Infrastructure to Enhance Mobile Seamless Learning , 2015, IEEE Transactions on Learning Technologies.

[6]  Andrew Vande Moere,et al.  The Effect of Aesthetic on the Usability of Data Visualization , 2007, 2007 11th International Conference Information Visualization (IV '07).

[7]  Gem Stapleton,et al.  How Should We Use Colour in Euler Diagrams? , 2014, VINCI '14.

[8]  Maria Andréia F. Rodrigues,et al.  Creating and evaluating a particle system for music visualization , 2013, J. Vis. Lang. Comput..

[9]  Delfina Malandrino,et al.  A Color-Based Visualization Approach to Understand Harmonic Structures of Musical Compositions , 2015, 2015 19th International Conference on Information Visualisation.

[10]  Craig Stuart Sapp Visual hierarchical key analysis , 2005, CIE.

[11]  Andrew Fish,et al.  Visual Exploration System in an Industrial Context , 2016, IEEE Transactions on Industrial Informatics.

[12]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[13]  Franc Solina,et al.  Visualization of concurrent tones in music with colours , 2010, ACM Multimedia.

[14]  Remco C. Veltkamp,et al.  Automatic Functional Harmonic Analysis , 2013, Computer Music Journal.

[15]  Sean M. Smith,et al.  A visualization of music , 1997, IEEE Visualization.

[16]  Elaine Chew,et al.  Visualizing Music: Tonal Progressions and Distributions , 2007, ISMIR.

[17]  Tim Dwyer,et al.  Untangling Euler Diagrams , 2010, IEEE Transactions on Visualization and Computer Graphics.

[18]  Harry Hochheiser,et al.  Research Methods for Human-Computer Interaction , 2008 .

[19]  Yang Wang,et al.  Why Johnny can't opt out: a usability evaluation of tools to limit online behavioral advertising , 2012, CHI.

[20]  Issei Fujishiro,et al.  Exploring MIDI datasets , 2003, SIGGRAPH '03.

[21]  Martin Wattenberg,et al.  Arc diagrams: visualizing structure in strings , 2002, IEEE Symposium on Information Visualization, 2002. INFOVIS 2002..

[22]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[23]  Huamin Qu,et al.  Visualizing the Semantic Structure in Classical Music Works , 2010, IEEE Transactions on Visualization and Computer Graphics.

[24]  Karrie Karahalios,et al.  Isochords: visualizing structure in music , 2007, GI '07.

[25]  Vittorio Scarano,et al.  How Increased Awareness Can Impact Attitudes and Behaviors toward Online Privacy Protection , 2013, 2013 International Conference on Social Computing.

[26]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[27]  Tamara Munzner,et al.  Design Study Methodology: Reflections from the Trenches and the Stacks , 2012, IEEE Transactions on Visualization and Computer Graphics.

[28]  Heinrich Taube,et al.  Automatic Tonal Analysis: Toward the Implementation of a Music Theory Workbench , 1999, Computer Music Journal.