BRASS: Visualizing Scores for Assisting Music Learning

We propose a system, called BRASS (BRowsing and Administration of Sound Sources), which provides an interactive digital score environment for assisting the users browse and explore the global structure of music in a flexible manner. When making cooperative performances, it is important to learn the global structure to deepen understanding of the piece. The score visualization of our system can show the entire piece in a computer window, however long the piece and no matter how many parts it includes. The users can insert comments or links on this score to note down their understanding. A particular focus is placed on the conceptual design of spatial substrate and properties of the environment and related level-of-detail (LoD) operations with some functions. A user evaluation of the prototype is also included.

[1]  Peter R. Keller,et al.  Visual cues - practical data visualization , 1993 .

[2]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[3]  Issei Fujishiro,et al.  Performance visualization: a new challenge to music through visualization , 2002, MULTIMEDIA '02.

[4]  Daniel V. Oppenheim.  Compositional Tools for Adding Expression to Music in DMIX , 1992, ICMC.

[5]  Issei Fujishiro,et al.  Exploring MIDI datasets , 2003, SIGGRAPH '03.

[6]  Ramana Rao,et al.  The table lens: merging graphical and symbolic representations in an interactive focus + context visualization for tabular information , 1994, CHI '94.

[7]  Issei Fujishiro,et al.  Music learning through visualization , 2002, Second International Conference on Web Delivering of Music, 2002. WEDELMUSIC 2002. Proceedings..

[8]  Toshiyuki Masui.  LensBar-visualization for browsing and filtering large lists of data , 1998, Proceedings IEEE Symposium on Information Visualization (Cat. No.98TB100258).

[9]  Rumi Hiraga.  Case study: A look of performance expression , 2002, IEEE Visualization, 2002. VIS 2002..

[10]  Florian Sobieczky.  Visualization of Roughness in Musical Consonance , 1996, IEEE Visualization.

[11]  Sean M. Smith,et al.  A visualization of music , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[12]  Manojit Sarkar,et al.  Graphical fisheye views of graphs , 1992, CHI.

[13]  Jonathan Foote,et al.  Visualizing music and audio using self-similarity , 1999, MULTIMEDIA '99.

[14]  Heinrich Taube,et al.  SEE - A Structured Event Editor: Visualizing Compositional Data in Common Music , 1996, ICMC.

[15]  Glen Williams,et al.  A visualization of music , 1997 .

[16]  Gerhard Widmer,et al.  The Performance Worm: Real Time Visualisation of Expression based on Langner's Tempo-Loudness Animation , 2002, ICMC.

[17]  Issei Fujishiro,et al.  comp - I : 3D Visualization of MIDI Datasets , 2002 .

[18]  C A Pickover,et al.  Examining Usability, Acceptability, and Adoption of a Self-Directed, Technology-Based Intervention for Upper Limb Rehabilitation After Stroke: Cohort Study , 1986, The Journal of the Acoustical Society of America.

[19]  Jock D. Mackinlay,et al.  The perspective wall: detail and context smoothly integrated , 1991, CHI.

[20]  Rumi Hiraga,et al.  Visualized music expression in an object-oriented environment , 1996 .