Large-scale music exploration in hierarchically organized landscapes using prototypicality information

We present a novel user interface that offers a fun way to explore music collections in virtual landscapes in a game-like manner. Extending previous work, special attention is paid to scalability and user interaction. In this vein, the ever growing size of today's music collections is addressed in two ways that allow for visualizing and browsing nearly arbitrarily sized music repositories. First, the proposed user interface deepTune employs a hierarchical version of the Self-Organizing Map (SOM) to cluster similar pieces of music using multiple, hierarchically aligned layers. Second, to facilitate orientation in the landscape by presenting well-known anchor points to the user, a combination of Web-based and audio signal-based information extraction techniques to determine cluster prototypes (songs) is proposed. Selecting representative and well-known prototypes -- the former is ensured by using signal-based features, the latter by using Web-based data -- is crucial for browsing large music collections. We further report on results of an evaluation carried out to assess the quality of the proposed cluster prototype ranking.

[1]  Peter Knees,et al.  The CoMIRVA Toolkit for Visualizing Music-Related Data , 2007, EuroVis.

[2]  Gerhard Widmer,et al.  Exploring Music Collections by Browsing Different Views , 2004, Computer Music Journal.

[3]  S. S. Stevens A scale for the measurement of a psychological magnitude: loudness. , 1936 .

[4]  Hugo Fastl,et al.  Psychoacoustics: Facts and Models , 1990 .

[5]  Matthias Jarke,et al.  Adaptive Multimodal Exploration of Music Collections , 2009, ISMIR.

[6]  Oliver Hummel,et al.  Using cultural metadata for artist recommendations , 2003, Proceedings Third International Conference on WEB Delivering of Music.

[7]  Thierry Bertin-Mahieux,et al.  Automatic Generation of Social Tags for Music Recommendation , 2007, NIPS.

[8]  E. Pampalk Islands of Music Analysis, Organization, and Visualization of Music Archives , 2002 .

[9]  Peter Knees,et al.  One-touch access to music on mobile devices , 2007, MUM.

[10]  David Heckerman,et al.  Empirical Analysis of Predictive Algorithms for Collaborative Filtering , 1998, UAI.

[11]  B. Atal,et al.  Optimizing digital speech coders by exploiting masking properties of the human ear , 1978 .

[12]  Peter Knees,et al.  Artist Classification with Web-Based Data , 2004, ISMIR.

[13]  Masataka Goto,et al.  MusicRainbow: A New User Interface to Discover Artists Using Audio-based Similarity and Web-based Labeling , 2006, ISMIR.

[14]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[15]  Elias Pampalk,et al.  Using Smoothed Data Histograms for Cluster Visualization in Self-Organizing Maps , 2002, ICANN.

[16]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[17]  Peter Knees,et al.  Accessing Music Collections Via Representative Cluster Prototypes in a Hierarchical Organization Scheme , 2008, ISMIR.

[18]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[19]  T. Metin Sezgin,et al.  Intelligent user interfaces , 2012, 2012 20th Signal Processing and Communications Applications Conference (SIU).

[20]  Peter Knees,et al.  “Reinventing the Wheel”: A Novel Approach to Music Player Interfaces , 2007, IEEE Transactions on Multimedia.

[21]  B. Atal,et al.  Optimizing digital speech coders by exploiting masking properties of the human ear , 1978 .

[22]  Remco C. Veltkamp Multimedia Retrieval Algorithmics , 2007, SOFSEM.

[23]  Andreas Rauber,et al.  The growing hierarchical self-organizing map , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[24]  Masataka Goto,et al.  MusicSun: A New Approach to Artist Recommendation , 2007, ISMIR.

[25]  Elias Pampalk,et al.  Content-based organization and visualization of music archives , 2002, MULTIMEDIA '02.

[26]  David Edge,et al.  Reinventing the Wheel , 1995 .

[27]  Òscar Celma,et al.  Foafing the Music: A Music Recommendation System based on RSS Feeds and User Preferences , 2005, ISMIR.

[28]  Òscar Celma,et al.  Music recommendation and discovery in the long tail , 2008 .

[29]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[30]  RauberA.,et al.  The growing hierarchical self-organizing map , 2002 .

[31]  Gert R. G. Lanckriet,et al.  A Game-Based Approach for Collecting Semantic Annotations of Music , 2007, ISMIR.

[32]  Juha Vesanto,et al.  SOM-based data visualization methods , 1999, Intell. Data Anal..

[33]  Maliha S. Nash,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 2001, Technometrics.

[34]  Ernst Terhardt,et al.  Calculating virtual pitch , 1979, Hearing Research.

[35]  Masataka Goto,et al.  Musicream: New Music Playback Interface for Streaming, Sticking, Sorting, and Recalling Musical Pieces , 2005, ISMIR.

[36]  Peter Knees,et al.  An innovative three-dimensional user interface for exploring music collections enriched , 2006, MM '06.