MixMash: A Visualisation System for Musical Mashup Creation

We present MixMash, an interactive tool to assist users in the creation of music mashups based on cross-modal associations between musical content analysis and information visualisation. Our point of departure is a harmonic mixing method for musical mashups by Bernardes et al. [1]. To surpass design limitations identified in the previous method, we propose a new interactive visualisation of multidimensional musical attributes—hierarchical harmonic compatibility, onset density, spectral region, and timbral similarity—extracted from a large collection of audio tracks. All tracks are represented as nodes whose distances and edge connections indicate their harmonic compatibility as a result of a force-directed graph. In addition, we provide a visual language that aims to enhance the tool usability and foster creative endeavour in the search for meaningful music mixes.

[1]  Diemo Schwarz,et al.  SOUND SEARCH BY CONTENT-BASED NAVIGATION IN LARGE DATABASES , 2009 .

[2]  Faraz Zaidi,et al.  Communities and hierarchical structures in dynamic social networks: analysis and visualization , 2011, Social Network Analysis and Mining.

[3]  John Shiga.  Copy-and-Persist: The Logic of Mash-Up Culture , 2007 .

[4]  Danah Boyd,et al.  Vizster: visualizing online social networks , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[5]  Karrie Karahalios,et al.  Isochords: visualizing structure in music , 2007, GI '07.

[6]  M. Jacomy,et al.  ForceAtlas2, a Continuous Graph Layout Algorithm for Handy Network Visualization Designed for the Gephi Software , 2014, PloS one.

[7]  Anton J. Enright,et al.  BioLayout-an automatic graph layout algorithm for similarity visualization , 2001, Bioinform..

[8]  Masataka Goto,et al.  Songrium: a music browsing assistance service based on visualization of massive open collaboration within music content creation community , 2013, OpenSym.

[9]  Marti A. Hearst,et al.  ImproViz: visual explorations of jazz improvisations , 2005, CHI EA '05.

[10]  Elias Pampalk,et al.  Please Scroll down for Article Journal of New Music Research the Som-enhanced Jukebox: Organization and Visualization of Music Collections Based on Perceptual Models , 2022 .

[11]  Arthur Flexer,et al.  Visualization of perceptual qualities in Textural sounds , 2012, ICMC.

[12]  Terry Trickett.  Visual Music , 2014, EVA.

[13]  Fabio Vignoli,et al.  Mapping Music In The Palm Of Your Hand, Explore And Discover Your Collection , 2004, ISMIR.

[14]  Chaomei Chen,et al.  CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature , 2006, J. Assoc. Inf. Sci. Technol..

[15]  Kwan-Liu Ma,et al.  Content Based Graph Visualization of Audio Data for Music Library Navigation , 2010, 2010 IEEE International Symposium on Multimedia.

[16]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[17]  Youngmoo E. Kim,et al.  Beat-Sync-Mash-Coder: A web application for real-time creation of beat-synchronous music mashups , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Gilberto Bernardes,et al.  A multi-level tonal interval space for modelling pitch relatedness and musical consonance , 2016 .

[19]  E. L. Mudge.  The Common Synaesthesia of Music. , 1920 .

[20]  Seok-Hee Hong,et al.  Visualization and analysis of email networks , 2007, 2007 6th International Asia-Pacific Symposium on Visualization.

[21]  Isabel Meirelles,et al.  Design for Information: An Introduction to the Histories, Theories, and Best Practices Behind Effective Information Visualizations , 2013 .

[22]  W. Mauch,et al.  Contents , 2007, European Neuropsychopharmacology.

[23]  Doug Kimelman,et al.  Reduction of Visual Complexity in Dynamic Graphs , 1994, Graph Drawing.

[24]  Jean-Daniel Fekete,et al.  NodeTrix: a Hybrid Visualization of Social Networks , 2007, IEEE Transactions on Visualization and Computer Graphics.

[25]  Martin Wattenberg,et al.  Arc diagrams: visualizing structure in strings , 2002, IEEE Symposium on Information Visualization, 2002. INFOVIS 2002..

[26]  Matthew E. P. Davies,et al.  Psychoacoustic Approaches for Harmonic Music Mixing , 2016 .

[27]  Jamie Ward,et al.  Sound-Colour Synaesthesia: to What Extent Does it Use Cross-Modal Mechanisms Common to us All? , 2006, Cortex.

[28]  C. Spence.  Crossmodal correspondences: A tutorial review , 2011, Attention, perception & psychophysics.

[29]  P. Machado,et al.  Harmonic Constellation : An Audiovisual Environment of Living Organisms , 2016 .

[30]  Gerrit C. van der Veer,et al.  CHI '05 Extended Abstracts on Human Factors in Computing Systems , 2005, CHI 2005.

[31]  Craig Stuart Sapp.  Harmonic Visualizations of Tonal Music , 2001, ICMC.

[32]  A. Barabasi,et al.  The human disease network , 2007, Proceedings of the National Academy of Sciences.

[33]  Matthew E. P. Davies,et al.  AutoMashUpper: Automatic Creation of Multi-Song Music Mashups , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[34]  Gilberto Bernardes,et al.  A Hierarchical Harmonic Mixing Method , 2017, CMMR.