A cognition-analogous approach to early-stage creative ideation support in music composition software

Examination of the underlying principles of creativity reveal theoretical aspects that have not been well explored in creativity facilitation software. Most significantly of these, there has been little investigation into exploiting the distinctions between early- and late-stage creative processes and the attendant differences in cognitive processing active at those times, nor into employing the structural scaffolding embedded within creative works and the manner in which these can be extracted and harnessed to define levels of abstraction through which the material can be viewed and manipulated. The Wheelsong project was conceived to exploit these principles, in the service of devising more creatively facilitative music composition tools, by focusing on these earlier, exploratory stages of the creative process, and by privileging structure over minutiae, in alignment with the mode of cognition (and corresponding user needs) that dominate the exploratory phase. Explorations conducted with Wheelsong demonstrate that the platform embraces broad stylistic and cultural ranges of output. Experiments comparing the creative merits of early-stage, fragmentary outputs produced by Wheelsong against those produced by traditional representation schemes show a substantial improvement in both subjective quality and diversity indicators adhering to the structurally produced candidates, as measured by human judges.

[1]  Karl Sims,et al.  Artificial evolution for computer graphics , 1991, SIGGRAPH.

[2]  Christian Wagner,et al.  Stimulating ideas through creativity software , 1994 .

[3]  Shulamith Kreitler,et al.  Self-Perceived Creativity , 2009 .

[4]  Curtis Roads,et al.  The Computer Music Tutorial , 1996 .

[5]  L. Mamykina,et al.  Collaborative creativity , 2002, CACM.

[6]  Guy J. Brown,et al.  Composition systems requirements for creativity: what research methodology? , 2001 .

[7]  D. Cope Virtual Music: Computer Synthesis of Musical Style , 2001 .

[8]  Tatsuya Aoyagi,et al.  Computational Music Representation Based on the Generative Theory of Tonal Music and the Deductive Object-Oriented Database , 2003, Computer Music Journal.

[9]  Vinod Menon,et al.  Musical structure is processed in “language” areas of the brain: a possible role for Brodmann Area 47 in temporal coherence , 2003, NeuroImage.

[10]  Theresa Rohlck,et al.  Komposisi Baru: On Contemporary Composition in Indonesia , 2016 .

[11]  Kenneth O. Stanley,et al.  Exploiting functional relationships in musical composition , 2009, Connect. Sci..

[12]  Ernest A. Edmonds,et al.  Modeling co-creativity in art and technology , 2002, Creativity & Cognition.

[13]  Rhc Warren Composition, Performance, Reception - Studies in the Creative Process in Music , 1998 .

[14]  A. D. Manning,et al.  Understanding Comics: The Invisible Art , 1993 .

[15]  Belinda Thom,et al.  BoB: an interactive improvisational music companion , 2000, AGENTS '00.

[16]  Geraint A. Wiggins Towards a more precise characterisation of creativity in AI , 2001 .

[17]  Brent MacGregor Cybernetic serendipity revisited , 2002, Creativity & Cognition.

[18]  Ben Shneiderman,et al.  Design Principles for Tools to Support Creative Thinking , 2005 .

[19]  Aileen Koh,et al.  Linking Learning, Knowledge Creation, and Business Creativity , 2000 .

[20]  Gérard Assayag,et al.  An Object Oriented Visual Environment For Musical Composition , 1997, ICMC.

[21]  László Somfai Bela Bartok: Composition, Concepts, and Autograph Sources , 1996 .

[22]  Kevin Jennings,et al.  Hyperscore: a graphical sketchpad for novice composers , 2004, IEEE Computer Graphics and Applications.

[23]  M. Csíkszentmihályi Creativity: Flow and the Psychology of Discovery and Invention , 1996 .

[24]  B. Hennessey The Social Psychology of Creativity , 2003, Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship.

[25]  Ernest A. Edmonds,et al.  Creativity enhancement with emerging technologies , 2000, CACM.

[26]  D. Harwood Universals in Music: A Perspective from Cognitive Psychology , 1976 .

[27]  R. Hamel,et al.  Sketching and creative discovery , 1998 .

[28]  Samuel C. Karpen,et al.  Lessons from a Faraway land: The effect of spatial distance on creative cognition , 2009 .

[29]  Richard A. Harriman,et al.  Creativity Inc.: Building an Inventive Organization , 2003 .

[30]  Heinrich Taube,et al.  Common music. A music composition language in common lisp and CLOS , 1991 .

[31]  Youshouzhai Gu Echo , 1980, The Craft of Poetry.

[32]  Bruce Jacob,et al.  Algorithmic composition as a model of creativity , 1996, Organised Sound.

[33]  R J Lederman,et al.  Robert Schumann. , 2018, Seminars in neurology.

[34]  J. Kao,et al.  The art & discipline of business creativity , 1997 .

[35]  Terri Gullickson The Creative Mind: Myths and Mechanisms. , 1995 .

[36]  J. Stevens,et al.  The Origin of Consciousness in the Breakdown of the Bicameral Mind by , 1978, Neurology.

[37]  Perry R. Cook,et al.  "On-the-fly Programming: Using Code as an Expressive Musical Instrument" , 2004, NIME.

[38]  Mayumi Adachi,et al.  Inspiring Creativity Through Music , 2004 .

[39]  Saul Greenberg,et al.  Toolkits and interface creativity , 2007, Multimedia Tools and Applications.

[40]  Roger Watt,et al.  Analysis of local and global timing and pitch change in ordinary melodies , 2006 .

[41]  William Buxton,et al.  Usability evaluation considered harmful (some of the time) , 2008, CHI.

[42]  Kenneth D. Forbus,et al.  Towards a computational model of sketching , 2001, IUI '01.

[43]  Masanori Sugimoto,et al.  Beyond binary choices: Integrating individual and social creativity , 2005, Int. J. Hum. Comput. Stud..

[44]  John A. Biles,et al.  GenJam: A Genetic Algorithm for Generating Jazz Solos , 1994, ICMC.

[45]  Ubiquity staff Building an inventive organization , 2003 .

[46]  Ben Shneiderman,et al.  Supporting Creativity with Advanced Information-Abundant User Interfaces , 1999 .

[47]  Yin Yin Wong Rough and ready prototypes: lessons from graphic design , 1992, CHI '92.

[48]  Ben Shneiderman,et al.  Creating creativity: user interfaces for supporting innovation , 2000, TCHI.

[49]  David Cope,et al.  Experiments In Musical Intelligence , 1996 .

[50]  Edmund Morris Beethoven : The Universal Composer , 2005 .

[51]  J. D. Couger,et al.  Creativity/Innovation in Information Systems Organizations , 1995, Proceedings of the Thirtieth Hawaii International Conference on System Sciences.

[52]  Ken Perlin,et al.  An image synthesizer , 1988 .

[53]  Charlotte B. Winsor The Creative Process: A Symposium , 1976 .

[54]  M L Nass,et al.  On hearing and inspiration in the composition of music. , 1975, The Psychoanalytic quarterly.

[55]  Eunice M. L. Soriano de Alencar,et al.  Obstacles to Personal Creativity among University Students. , 2001 .

[56]  David Baker Understanding Musical Understanding: The Philosophy, Psychology and Sociology of the Musical Experience (review) , 2010 .

[57]  Barry Eaglestone,et al.  Computer support for creativity: help or hindrance , 2002 .

[58]  Ben Shneiderman,et al.  Creativity Support Tools: A Grand Challenge for HCI Researchers , 2009 .

[59]  Rajmil Fischman,et al.  Clouds, Pyramids, and Diamonds: Applying Schrdinger's Equation to Granular Synthesis and Compositional Structure , 2003, Computer Music Journal.

[60]  Paul Hudak,et al.  Haskore music notation – An algebra of music – , 1996, Journal of Functional Programming.

[61]  SpeeceFred H.Jr. Assessing the Quality of Earnings and Management , 2009 .

[62]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[63]  António Dias de Figueiredo,et al.  Programming for Serendipity , 2002 .

[64]  Heinrich Schenker,et al.  Five Graphic Music Analyses , 1969 .

[65]  James A. Landay,et al.  Interactive sketching for the early stages of user interface design , 1995, CHI '95.

[66]  Frederick Dorian,et al.  The Musical Workshop. , 1971 .

[67]  M. Boden The creative mind : myths & mechanisms , 1991 .

[68]  Donald Meichenbaum,et al.  Enhancing Creativity by Modifying What Subjects Say to Themselves1 , 1975 .

[69]  P W Jackson,et al.  The person, the product, and the response: conceptual problems in the assessment of creativity. , 1965, Journal of personality.

[70]  Celine Latulipe,et al.  Creativity factor evaluation: towards a standardized survey metric for creativity support , 2009, C&C '09.

[71]  J. Powis,et al.  [The quiet revolution]. , 1982, Josanpu zasshi = The Japanese journal for midwife.

[72]  W. Dowling Scale and contour: Two components of a theory of memory for melodies. , 1978 .

[73]  Carla A. Scaletti Computer Music Languages, Kyma, and the Future , 2002, Computer Music Journal.

[74]  Liane Gabora,et al.  Cognitive mechanisms underlying the creative process , 2002, Creativity & Cognition.

[75]  Bruno Nettl An ethnomusicologist contemplates universals in musical sound and musical culture , 2000 .

[76]  Guy J. Brown,et al.  Information systems and creativity: an empirical study , 2007, J. Documentation.

[77]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[78]  Yin Liu,et al.  A Relational Database Model for Text Encoding , 2008 .

[79]  Sam Reese,et al.  Tools for Thinking in Sound , 2001 .

[80]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[81]  Allen Cadwallader Schenker's Unpublished Graphic Analysis of Brahms's Intermezzo Op. 117, No. 2: Tonal Structure and Concealed Motivic Repetition , 1984 .

[82]  Neil Sorrell,et al.  A Guide To The Gamelan , 1990 .

[83]  C. Shalley,et al.  Matching Creativity Requirements and the Work Environment: Effects on Satisfaction and Intentions to Leave , 2000 .

[84]  H. Simon,et al.  The Processes of Creative Thinking , 1959 .

[85]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[86]  Catherine Golden Composition: Writing and the Visual Arts. , 1986 .

[87]  Dragan Gasevic,et al.  Stimulating Creativity through Opportunistic Software Development , 2008, IEEE Software.

[88]  Guy J. Brown,et al.  A Qualitative Analysis of Composers at Work , 2002, ICMC.

[89]  Curtis Roads Sound Composition with Pulsars , 2001 .

[90]  John W. Buchanan,et al.  Game sketching , 2007, DIMEA.

[91]  R. Sternberg,et al.  Innate talents: Reality or myth? , 1998, Behavioral and Brain Sciences.

[92]  Johan Joseph Fux The Study of Counterpoint from Johann Joseph Fux''s Gradus ad Parnassum, translated and edited by A , 1965 .

[93]  Ann McCutchan,et al.  The Muse That Sings: Composers Speak about the Creative Process , 1999 .

[94]  J. Plucker,et al.  Handbook of Creativity: Psychometric Approaches to the Study of Human Creativity , 1998 .

[95]  C. Nemeth,et al.  Creative idea generation: harmony versus stimulation , 2007 .

[96]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[97]  Daniel C. Dennett,et al.  Brainstorms: Philosophical Essays on Mind and Psychology , 1981 .

[98]  C. Stevens,et al.  Sweet Anticipation: Music and the Psychology of Expectation, by David Huron . Cambridge, Massachusetts: MIT Press, 2006 , 2007 .

[99]  David Cope,et al.  Computer Modeling of Musical Intelligence in EMI , 1992 .

[100]  Yaacov Trope,et al.  Temporal construal. , 2003, Psychological review.