An Intelligent System to Generate Chord Progressions from Colors with an Artificial Immune System

Synesthesia is a neurological phenomenon in which stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. Many synesthetes used their capabilities as inspiration for their works. Drawing on this phenomenon, this paper presents a model able to create chord progressions using colors as the synesthetic input. In particular, the model extracts sound from colors to create chord progressions by applying an artificial immune system (AIS). The quality of each chord is mapped in the Tonal Interval Space, a geometrical space in which mathematical measures are related to musical properties. The result is an assistive tool that has been evaluated in terms of musical standards and usefulness for the users.

[1]  Jonathan Timmis,et al.  Artificial Immune Systems: A New Computational Intelligence Approach , 2003 .

[2]  Kemal Ebcioglu,et al.  An Expert System for Harmonizing Chorales in the Style of J. S. Bach , 1990, J. Log. Program..

[3]  Georg Groh,et al.  A Genetic Algorithm Approach to Collaborative Music Creation on a Multi-Touch Table , 2014, ICMC.

[4]  Jonathan Berger,et al.  SONART : THE SONIFICATION APPLICATION RESEARCH TOOLBOX , 2002 .

[5]  Artemis Moroni,et al.  Vox Populi: An Interactive Evolutionary System for Algorithmic Music Composition , 2000, Leonardo Music Journal.

[6]  François Pachet,et al.  Non-Conformant Harmonization: the Real Book in the Style of Take 6 , 2014, ICCC.

[7]  Matthew Rizzo,et al.  Synesthesia , 1989, Neurology.

[8]  D. Eagleman,et al.  Wednesday Is Indigo Blue: Discovering the Brain of Synesthesia , 2009 .

[9]  Hamido Fujita,et al.  Multi-Imbalance: An open-source software for multi-class imbalance learning , 2019, Knowl. Based Syst..

[10]  Gilberto Bernardes,et al.  Conchord: An Application for Generating Musical Harmony by Navigating in a Perceptually Motivated Tonal Interval Space , 2015 .

[11]  Angelo Gaeta,et al.  Resilience Analysis of Critical Infrastructures: A Cognitive Approach Based on Granular Computing , 2019, IEEE Transactions on Cybernetics.

[12]  Kazuhiro Jo,et al.  Monalisa: "See the Sound , Hear the Image" , 2008, NIME.

[13]  Eduardo Miranda,et al.  Cellular Automata Music: From Sound Synthesis to Musical Forms , 2007 .

[14]  Greta Berman,et al.  Synesthesia and the Arts , 1999, Leonardo.

[15]  Patrick C. K. Hung,et al.  Collaborative service system design for music content creation , 2014, Inf. Syst. Frontiers.

[16]  N. Maxwell.  Visualizing Sound: Effects of Pitch Height and Tonality on Luminance Matching , 2013 .

[17]  Tsutomu Nakada,et al.  Musical pitch classes have rainbow hues in pitch class-color synesthesia , 2017, Scientific Reports.

[18]  Hamido Fujita,et al.  Multi-view manifold regularized learning-based method for prioritizing candidate disease miRNAs , 2019, Knowl. Based Syst..

[19]  Gilberto Bernardes,et al.  A multi-level tonal interval space for modelling pitch relatedness and musical consonance , 2016 .

[20]  Guanyun Wang,et al.  VisibleSound: Perceiving Environmental Sound with 4D Form , 2013 .

[21]  Nithin V. George,et al.  Swarm and evolutionary computing algorithms for system identification and filter design: A comprehensive review , 2017, Swarm Evol. Comput..

[22]  Miguel Molina-Solana,et al.  Inmamusys: Intelligent multiagent music system , 2009, Expert Syst. Appl..

[23]  Gilberto Bernardes,et al.  ChordAIS: An assistive system for the generation of chord progressions with an artificial immune system , 2019, Swarm Evol. Comput..

[24]  C. Krumhansl,et al.  A Theory of Tonal Hierarchies in Music , 2010 .

[25]  Hanry Yu,et al.  Corrigendum: Patient-specific hepatocyte-like cells derived from induced pluripotent stem cells model pazopanib-mediated hepatotoxicity , 2017, Scientific reports.

[26]  Makoto Fukumoto,et al.  Creation of Music Chord Progression Suited for User's Feelings Based on Interactive Genetic Algorithm , 2014, 2014 IIAI 3rd International Conference on Advanced Applied Informatics.

[27]  Hamido Fujita,et al.  Computer Aided detection for fibrillations and flutters using deep convolutional neural network , 2019, Inf. Sci..