MixMash: An Assistive Tool for Music Mashup Creation from Large Music Collections

ThisarticlepresentsMixMash,aninteractivetoolwhichstreamlinestheprocessofmusicmashup creationbyassistingusersintheprocessoffindingcompatiblemusicfromalargecollectionofaudio tracks.ItextendstheharmonicmixingmethodbyBernardes,DaviesandGuedeswithnoveldegrees ofharmonic,rhythmic,spectral,andtimbralsimilaritymetrics.Furthermore,itrevisesandimproves someinterfacedesignlimitationsidentifiedintheformermodelsoftwareimplementation.Anewuser interfacedesignbasedoncross-modalassociationsbetweenmusicalcontentanalysisandinformation visualisationispresented.Inthisgraphicmodel,alltracksarerepresentedasnodeswheredistances andedgeconnectionsdisplay theirharmonic compatibility as a result of a force-directedgraph. Besides,avisuallanguageisdefinedtoenhancethetool’susabilityandfostercreativeendeavourin thesearchofmeaningfulmusicmashups.

[1]  Masataka Goto,et al.  Songrium: a music browsing assistance service based on visualization of massive open collaboration within music content creation community , 2013, OpenSym.

[2]  W. Mauch,et al.  Contents , 2007, European Neuropsychopharmacology.

[3]  Elias Pampalk,et al.  Please Scroll down for Article Journal of New Music Research the Som-enhanced Jukebox: Organization and Visualization of Music Collections Based on Perceptual Models , 2022 .

[4]  Youngmoo E. Kim,et al.  Beat-Sync-Mash-Coder: A web application for real-time creation of beat-synchronous music mashups , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  C. Spence.  Crossmodal correspondences: A tutorial review , 2011, Attention, perception & psychophysics.

[6]  Amy Ione,et al.  The Aesthetic Brain: How We Evolved to Desire Beauty and Enjoy Art , 2015, Leonardo.

[7]  Karrie Karahalios,et al.  Isochords: visualizing structure in music , 2007, GI '07.

[8]  Gilberto Bernardes,et al.  A Hierarchical Harmonic Mixing Method , 2017, CMMR.

[9]  A. Barabasi,et al.  The human disease network , 2007, Proceedings of the National Academy of Sciences.

[10]  Eduardo Navas.  Remix Theory: The Aesthetics of Sampling , 2012 .

[11]  Ja-Ling Wu,et al.  Automatic Mashup Creation by Considering both Vertical and Horizontal Mashabilities , 2015, ISMIR.

[12]  Barry Wilkins,et al.  Meld : a pattern supported methodology for visualisation design , 2003 .

[13]  V. Vesna.  Database Aesthetics: Art in the Age of Information Overflow , 2007 .

[14]  Kwan-Liu Ma,et al.  Content Based Graph Visualization of Audio Data for Music Library Navigation , 2010, 2010 IEEE International Symposium on Multimedia.

[15]  Matthew E. P. Davies,et al.  AutoMashUpper: Automatic Creation of Multi-Song Music Mashups , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[16]  Gilberto Bernardes,et al.  Automatic musical key estimation with adaptive mode bias , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Gilberto Bernardes,et al.  MixMash: A Visualisation System for Musical Mashup Creation , 2018, 2018 22nd International Conference Information Visualisation (IV).

[18]  Fabio Vignoli,et al.  Mapping Music In The Palm Of Your Hand, Explore And Discover Your Collection , 2004, ISMIR.

[19]  Arthur Flexer,et al.  Visualization of perceptual qualities in Textural sounds , 2012, ICMC.

[20]  Anton J. Enright,et al.  BioLayout-an automatic graph layout algorithm for similarity visualization , 2001, Bioinform..

[21]  William Brent.  A Timbre Analysis And Classification Toolkit For Pure Data , 2010, ICMC.

[22]  Roger T. Dean,et al.  Timbre Preferences in the Context of Mixing Music , 2019, Applied Sciences.

[23]  John Maeda,et al.  Computational information design , 2004 .

[24]  Diemo Schwarz,et al.  SOUND SEARCH BY CONTENT-BASED NAVIGATION IN LARGE DATABASES , 2009 .

[25]  Faraz Zaidi,et al.  Communities and hierarchical structures in dynamic social networks: analysis and visualization , 2011, Social Network Analysis and Mining.

[26]  John Shiga.  Copy-and-Persist: The Logic of Mash-Up Culture , 2007 .

[27]  Jean-Daniel Fekete,et al.  NodeTrix: a Hybrid Visualization of Social Networks , 2007, IEEE Transactions on Visualization and Computer Graphics.

[28]  Catherine Plaisant,et al.  Seven Guiding Scenarios for Information Visualization Evaluation , 2011 .

[29]  E. L. Mudge.  The Common Synaesthesia of Music. , 1920 .

[30]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[31]  V. Ramachandran,et al.  Hearing Colors, Tasting Shapes , 2003 .

[32]  Markus Schedl,et al.  Music Information Retrieval: Recent Developments and Applications , 2014, Found. Trends Inf. Retr..

[33]  Craig Stuart Sapp.  Harmonic Visualizations of Tonal Music , 2001, ICMC.

[34]  Matthew E. P. Davies,et al.  Improvasher: A Real-Time Mashup System for Live Musical Input , 2014, NIME.

[35]  Chaomei Chen,et al.  Web site design with the patron in mind: A step-by-step guide for libraries , 2006 .

[36]  Marti A. Hearst,et al.  ImproViz: visual explorations of jazz improvisations , 2005, CHI EA '05.

[37]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[38]  M. Jacomy,et al.  ForceAtlas2, a Continuous Graph Layout Algorithm for Handy Network Visualization Designed for the Gephi Software , 2014, PloS one.

[39]  Matthew E. P. Davies,et al.  Psychoacoustic Approaches for Harmonic Music Mixing , 2016 .

[40]  Jamie Ward,et al.  Sound-Colour Synaesthesia: to What Extent Does it Use Cross-Modal Mechanisms Common to us All? , 2006, Cortex.

[41]  Gilberto Bernardes,et al.  A multi-level tonal interval space for modelling pitch relatedness and musical consonance , 2016 .