Music learning through visualization

We have developed a prototype music visualization system that shows the whole piece in a computer window, however long the piece and no matter how many parts it includes, as well as the selected part. The selected part is presented using either performed data or staff notation. Users can better understand performance expression by visualizing the performance with expressive cues of qualitative music terms. Based on this understanding, users can exchange comments with other users, recorded on visualized figures, through the Internet. Though still a prototype, we expect to make our system one that will enable users to better understand a musical piece and its performance, especially for a cooperative performance.

[1]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[2]  Jock D. Mackinlay,et al.  The perspective wall: detail and context smoothly integrated , 1991, CHI.

[3]  Anders Friberg,et al.  Emotional Coloring of Computer-Controlled Music Performances , 2000, Computer Music Journal.

[4]  Daniel V. Oppenheim.  Compositional Tools for Adding Expression to Music in DMIX , 1992, ICMC.

[5]  Rumi Hiraga,et al.  Visualized music expression in an object-oriented environment , 1996 .

[6]  Manojit Sarkar,et al.  Graphical fisheye views of graphs , 1992, CHI.

[7]  Peter R. Keller,et al.  Visual cues - practical data visualization , 1993 .

[8]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[9]  C A Pickover,et al.  Examining Usability, Acceptability, and Adoption of a Self-Directed, Technology-Based Intervention for Upper Limb Rehabilitation After Stroke: Cohort Study , 1986, The Journal of the Acoustical Society of America.

[10]  Issei Fujishiro,et al.  comp - I : 3D Visualization of MIDI Datasets , 2002 .

[11]  Sean M. Smith,et al.  A visualization of music , 1997, IEEE Visualization.

[12]  Jonathan Foote,et al.  Visualizing music and audio using self-similarity , 1999, MULTIMEDIA '99.

[13]  Ramana Rao,et al.  Exploring large tables with the table lens , 1995, CHI '95.

[14]  Florian Sobieczky.  Visualization of Roughness in Musical Consonance , 1996, IEEE Visualization.

[15]  Heinrich Taube,et al.  SEE - A Structured Event Editor: Visualizing Compositional Data in Common Music , 1996, ICMC.

[16]  Erhard Karkoschka,et al.  Das Schriftbild der Neuen Musik , 1967 .

[17]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[18]  P. Juslin,et al.  Emotional Expression in Music Performance: Between the Performer's Intention and the Listener's Experience , 1996 .

[19]  Herman Chernoff,et al.  The Use of Faces to Represent Points in k- Dimensional Space Graphically , 1973 .

[20]  Florian H. Sobieczky.  Visualization of roughness in musical consonance — Both the PDF and printed version of this article are missing the last page. , 1996 .

[21]  Toshiyuki Masui.  LensBar-visualization for browsing and filtering large lists of data , 1998, Proceedings IEEE Symposium on Information Visualization (Cat. No.98TB100258).

[22]  F. Sobieczky.  Results in mathematics and music: visualization of roughness in musical consonance , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[23]  Rumi Hiraga.  Case study: A look of performance expression , 2002, IEEE Visualization, 2002. VIS 2002..

[24]  Masataka Goto,et al.  RWC Music Database: Classical Music Database and Jazz Music Database , 2002 .