Conceptual blending of high-level features and data-driven salience computation in melodic generation

Abstract Conceptual Blending (CB) theory describes the cognitive mechanisms underlying the way humans process the emergence of new conceptual spaces by blending two input spaces. CB theory has been primarily used as a method for interpreting creative artefacts, while recently it has been utilised in the context of computational creativity for algorithmic invention of new concepts. Examples in the domain of music include the employment of CB interpretatively as a tool to explain musical semantic structures based on lyrics of songs or on the relations between body gestures and music structures. Recent work on generative applications of CB has shown that proper low-level representation of the input spaces allows the generation of consistent and sometimes surprising blends. However, blending high-level features (as discussed in the interpretative studies) of music explicitly, is hardly feasible with mere low-level representation of objects. Additionally, selecting features that are more salient in the context of two input spaces and relevant background knowledge and should, thus, be preserved and integrated in new interesting blends has not yet been tackled in a cognitively pertinent manner. The paper at hand proposes a novel approach to generating new material that allows blending high-level features by combining low-level structures, based on statistically computed salience values for each high-level feature extracted from data. The proposed framework is applied to a basic but, at the same time, complicated field of music, namely melodic generation. The examples presented herein allow an insightful examination of what the proposed approach does, revealing new possibilities and prospects.

[1]  R. Shepard,et al.  Tonal Schemata in the Perception of Music in Bali and in the West , 1984 .

[2]  Kai-Uwe Kühnberger,et al.  Computational Invention of Cadences and Chord Progressions by Conceptual Chord-Blending , 2015, IJCAI.

[3]  Maximos A. Kaliakatsos-Papakostas,et al.  Musical blending and creativity: An empirical evaluation of the CHAMELEON melodic harmonisation assistant , 2018 .

[4]  Justyna Humięcka-Jakubowska,et al.  Sweet Anticipation : Music and , 2006 .

[5]  C. Krumhansl Cognitive Foundations of Musical Pitch , 1990 .

[6]  Arne Eigenfeldt,et al.  Evolving structures for electronic dance music , 2013, GECCO '13.

[7]  Satoshi Tojo,et al.  Melodic Morphing Algorithm in Formalism , 2011, MCM.

[8]  John F. Sherry,et al.  Conceptual blending in advertising , 2009 .

[9]  Vinod Goel,et al.  Creative brains: designing in the real world† , 2014, Front. Hum. Neurosci..

[10]  Andreas Podelski,et al.  Towards a Meaning of LIFE , 1991, J. Log. Program..

[11]  Marcelo Queiroz,et al.  Conceptual Blending of Harmonic Spaces for Creative Melodic Harmonisation , 2017 .

[12]  Maximos A. Kaliakatsos-Papakostas Generating Drum Rhythms Through Data-Driven Conceptual Blending of Features and Genetic Algorithms , 2018, EvoMUSART.

[13]  Gerhard Widmer,et al.  Getting Closer to the Essence of Music , 2016, ACM Trans. Intell. Syst. Technol..

[14]  M. Pearce Statistical learning and probabilistic prediction in music cognition: mechanisms of stylistic enculturation , 2018, Annals of the New York Academy of Sciences.

[15]  Lawrence M. Zbikowski Conceptualizing Music: Cognitive Structure, Theory, and Analysis , 2002 .

[16]  M. Boden The creative mind : myths & mechanisms , 1991 .

[17]  Fabien Gouyon,et al.  Syncopation creates the sensation of groove in synthesized music examples , 2014, Front. Psychol..

[18]  George Tzanetakis,et al.  Musical genre classification of audio signals , 2002, IEEE Trans. Speech Audio Process..

[19]  Margaret A. Boden,et al.  Computer Models of Creativity , 2009, AI Mag..

[20]  M. Spitzer Metaphor and Musical Thought , 2003 .

[21]  A Study on News Headline Translation from the Cognitive Perspective-Based on Conceptual Blending Theory , 2015 .

[22]  Mark Turner,et al.  A Mechanism of Creativity , 1999, Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship.

[23]  Joseph A. Goguen,et al.  Style: A Computational and Conceptual Blending-Based Approach , 2010, The Structure of Style.

[24]  Claude E. Shannon,et al.  Prediction and Entropy of Printed English , 1951 .

[25]  Michael N. Vrahatis,et al.  10 Intelligent Music Composition , 2013 .

[26]  M. Pearce,et al.  A Probabilistic Model of Meter Perception: Simulating Enculturation , 2017, Front. Psychol..

[27]  Michael N. Vrahatis,et al.  evoDrummer: Deriving Rhythmic Patterns through Interactive Genetic Algorithms , 2013, EvoMUSART.

[28]  A. Smaill,et al.  The role of blending in mathematical invention , 2015 .

[29]  Lawrence M. Zbikowski Conceptual Models and Cross-Domain Mapping: New Perspectives on Theories of Music and Hierarchy , 1997 .

[30]  Cristóbal Pagán Cánovas,et al.  Interactions with the Beloved in Greek Literature: Conceptual Blending and Levels of Representation , 2017 .

[31]  Fabian Neuhaus,et al.  Image schemas in computational conceptual blending , 2016, Cognitive Systems Research.

[32]  Roberto Confalonieri,et al.  An Argument-based Creative Assistant for Harmonic Blending , 2016, ICCC.

[33]  G. Fauconnier,et al.  The Way We Think: Conceptual Blending and the Mind''s Hidden Complexities. Basic Books , 2002 .

[34]  Roger T. Dean,et al.  Computational Creation and Morphing of Multilevel Rhythms by Control of Evenness , 2016, Computer Music Journal.

[35]  I. Shmulevich,et al.  Measures of Temporal Pattern Complexity , 2000 .

[36]  Maximos A. Kaliakatsos-Papakostas,et al.  Learning and Blending Harmonies in the Context of a Melodic Harmonisation Assistant , 2016, AIAI.

[37]  Michael L. Mack,et al.  Decoding the Brain’s Algorithm for Categorization from Its Neural Implementation , 2013, Current Biology.

[38]  H. C. Longuet-Higgins,et al.  The Rhythmic Interpretation of Monophonic Music , 1984 .

[39]  Peter Knees,et al.  An Intelligent Interface for Drum Pattern Variation and Comparative Evaluation of Algorithms , 2016 .

[40]  Emilios Cambouropoulos,et al.  Melodic Cue Abstraction, Similarity, and Category Formation: A Formal Model , 2001 .

[41]  David L. Faigman,et al.  Human category learning. , 2005, Annual review of psychology.

[42]  Susan Wright,et al.  Towards Melodic Extension Using Genetic Algorithms , 2001, J. Educ. Technol. Soc..

[43]  C. Krumhansl Tonality Induction: A Statistical Approach Applied Cross-Culturally , 2000 .

[44]  Kai-Uwe Kühnberger,et al.  COINVENT: Towards a Computational Concept Invention Theory , 2014, ICCC.

[45]  D. Temperley The Cognition of Basic Musical Structures , 2001 .

[46]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[47]  Maximos A. Kaliakatsos-Papakostas,et al.  Creating Musical Cadences via Conceptual Blending: Empirical Evaluation and Enhancement of a Formal Model , 2017 .

[48]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.