From learning to creativity: Identifying the behavioural and neural correlates of learning to predict human judgements of musical creativity

Human creativity is intricately linked to acquired knowledge. However, to date learning a new musical style and subsequent musical creativity have largely been studied in isolation. We introduced a novel experimental paradigm combining behavioural, electrophysiological, and computational methods, to examine the neural correlates of unfamiliar music learning, and to investigate how neural and computational measures can predict human creativity. We investigated music learning by training non-musicians (N = 40) on an artificial music grammar. Participants' knowledge of the grammar was tested before and after three training sessions on separate days by assessing explicit recognition of the notes of the grammar, while additionally recording EEG. After each training session, participants created their own musical compositions, which were later evaluated by human experts. A computational model of auditory expectation was used to quantify the statistical properties of both the grammar and the compositions. Results showed that participants successfully learned the grammar. This was also reflected in the N100, P200, and P3a components, which were higher in response to incorrect than correct notes. The delta band (2.5-4.5 Hz) power in response to grammatical notes during first exposure to the grammar positively correlated with learning, suggesting a potential encoding neural mechanism. On the other hand, better learning was associated with lower alpha and higher beta band power after training, potentially reflecting neural mechanisms of retrieval. Importantly, learning was a significant predictor of creativity, as judged by experts. There was also an inverted U-shaped relationship between percentage of correct intervals and creativity, as compositions with an intermediate proportion of correct intervals were associated with the highest creativity. Finally, the P200 in response to incorrect notes was predictive of creativity, suggesting a link between the neural correlates of learning, and creativity. Overall, our findings shed light on the neural mechanisms of learning an unfamiliar music grammar, as well as offering contributions to the associations between learning measures and creative compositions based on learned materials.

[1]  B. Scholl,et al.  The Automaticity of Visual Statistical Learning Statistical Learning , 2005 .

[2]  B. Gaut,et al.  Creativity and Art: Three Roads to Surprise , 2012 .

[3]  I. Cross,et al.  Incidental and online learning of melodic structure , 2011, Consciousness and Cognition.

[4]  A. Filipowicz From Positive Affect to Creativity: The Surprising Role of Surprise , 2006 .

[5]  E. Narmour The Analysis and Cognition of Melodic Complexity: The Implication-Realization Model , 1992 .

[6]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[7]  M. Runco,et al.  The Standard Definition of Creativity , 2012 .

[8]  Richard H. A. H. Jacobs,et al.  Liking versus Complexity: Decomposing the Inverted U-curve , 2016, Front. Hum. Neurosci..

[9]  Carlos M. Gómez,et al.  Temporal evolution of α and β bands during visual spatial attention , 2001 .

[10]  S. Hanslmayr,et al.  Alpha/Beta Oscillations Indicate Inhibition of Interfering Visual Memories , 2012, The Journal of Neuroscience.

[11]  P. Wason,et al.  The Psychology of Chess , 1983 .

[12]  Suzanne Bunton,et al.  Semantically Motivated Improvements for PPM Variants , 1997, Comput. J..

[13]  Marcus T. Pearce,et al.  The construction and evaluation of statistical models of melodic structure in music perception and composition , 2005 .

[14]  J. Hayes Cognitive Processes in Creativity , 1989 .

[15]  Robert J. Crutcher,et al.  The role of deliberate practice in the acquisition of expert performance. , 1993 .

[16]  Manuel Schabus,et al.  A shift of visual spatial attention is selectively associated with human EEG alpha activity , 2005, The European journal of neuroscience.

[17]  Peter Fransson,et al.  Connecting to Create: Expertise in Musical Improvisation Is Associated with Increased Functional Connectivity between Premotor and Prefrontal Areas , 2014, The Journal of Neuroscience.

[18]  Geraint A. Wiggins,et al.  Evaluating Cognitive Models of Musical Composition , 2007 .

[19]  S. Mednick,et al.  The Remote Associates Test , 1968 .

[20]  M. Scheerer,et al.  Problem Solving , 1967, Nature.

[21]  R. Sawyer Explaining Creativity: The Science of Human Innovation , 2006 .

[22]  Kazuo Okanoya,et al.  Visual statistical learning of shape sequences: An ERP study , 2009, Neuroscience Research.

[23]  Dean Keith Simonton,et al.  Genius, creativity, and leadership , 1984 .

[24]  R. Knight,et al.  Contributions of temporal-parietal junction to the human auditory P3 , 1989, Brain Research.

[25]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[26]  S. McAdams,et al.  Implicit learning of musical timbre sequences: statistical regularities confronted with acoustical (dis)similarities. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[27]  Dean Keith Simonton,et al.  Taking the U.S. Patent Office Criteria Seriously: A Quantitative Three-Criterion Creativity Definition and Its Implications , 2012 .

[28]  Michael Rose,et al.  Dissociation of the functional relevance of different pre-stimulus oscillatory activity for memory formation , 2016, NeuroImage.

[29]  A. Starr,et al.  Task-relevant late positive component of the auditory event-related potential in monkeys resembles P300 in humans. , 1984, Science.

[30]  M. Pearce Statistical learning and probabilistic prediction in music cognition: mechanisms of stylistic enculturation , 2018, Annals of the New York Academy of Sciences.

[31]  J. Bhattacharya,et al.  Musical training shapes neural responses to melodic and prosodic expectation , 2016, Brain Research.

[32]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[33]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[34]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[35]  Tim Curran,et al.  Using single-trial EEG to predict and analyze subsequent memory , 2014, NeuroImage.

[36]  M. Joanisse,et al.  Creativity as a distinct trainable mental state: An EEG study of musical improvisation , 2017, Neuropsychologia.

[37]  F ChenStanley,et al.  An Empirical Study of Smoothing Techniques for Language Modeling , 1996, ACL.

[38]  Masato Yumoto,et al.  Statistical learning of music- and language-like sequences and tolerance for spectral shifts , 2015, Neurobiology of Learning and Memory.

[39]  Roger E. Beaty,et al.  The neuroscience of musical improvisation , 2015, Neuroscience & Biobehavioral Reviews.

[40]  Geraint A. Wiggins,et al.  Probabilistic models of expectation violation predict psychophysiological emotional responses to live concert music , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[41]  Arne D. Ekstrom,et al.  A comparative study of human and rat hippocampal low‐frequency oscillations during spatial navigation , 2013, Hippocampus.

[42]  Geraint A. Wiggins,et al.  The Role of Expectation and Probabilistic Learning in Auditory Boundary Perception: A Model Comparison , 2010, Perception.

[43]  Joan Y. Chiao,et al.  An Event-related fMRI Study of Artificial Grammar Learning in a Balanced Chunk Strength Design , 2004, Journal of Cognitive Neuroscience.

[44]  Psyche Loui,et al.  Learning and Liking of Melody and Harmony: Further Studies in Artificial Grammar Learning , 2012, Top. Cogn. Sci..

[45]  Victor M. Yakovenko,et al.  Temporal Evolution , 2005, Encyclopedia of Database Systems.

[46]  Ran El-Yaniv,et al.  On Prediction Using Variable Order Markov Models , 2004, J. Artif. Intell. Res..

[47]  H. Simon,et al.  Perception in chess , 1973 .

[48]  O. Jensen,et al.  Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition , 2010, Front. Hum. Neurosci..

[49]  A. Nobre,et al.  Alpha Oscillations Related to Anticipatory Attention Follow Temporal Expectations , 2011, The Journal of Neuroscience.

[50]  Martin Rohrmeier,et al.  Implicit Learning and Acquisition of Music , 2012, Top. Cogn. Sci..

[51]  María Herrojo Ruiz,et al.  Unsupervised statistical learning underpins computational, behavioural, and neural manifestations of musical expectation , 2010, NeuroImage.

[52]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[53]  Benjamin Martin Bly,et al.  The effects of learning on event-related potential correlates of musical expectancy. , 2008, Psychophysiology.

[54]  M. Kahana,et al.  Theta band power increases in the posterior hippocampus predict successful episodic memory encoding in humans , 2017, Hippocampus.

[55]  Morten H. Christiansen,et al.  Sequential Expectations: The Role of Prediction-Based Learning in Language , 2010, Top. Cogn. Sci..

[56]  Stefan Koelsch,et al.  Differences in Electric Brain Responses to Melodies and Chords , 2010, Journal of Cognitive Neuroscience.

[57]  S. Koelsch,et al.  Predictive information processing in music cognition. A critical review. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[58]  M. Behrmann,et al.  Role of attention and perceptual grouping in visual statistical learning. , 2004, Psychological science.

[59]  Matthias M. Müller,et al.  Oscillatory brain activity dissociates between associative stimulus content in a repetition priming task in the human EEG. , 2004, Cerebral cortex.

[60]  Elizabeth K. Johnson,et al.  Statistical learning of tone sequences by human infants and adults , 1999, Cognition.

[61]  J. Saffran,et al.  Changing the tune: the structure of the input affects infants' use of absolute and relative pitch. , 2005, Developmental science.

[62]  Stefan Koelsch,et al.  Under the hood of statistical learning: A statistical MMN reflects the magnitude of transitional probabilities in auditory sequences , 2016, Scientific Reports.

[63]  M. Kahana,et al.  Human hippocampal theta oscillations and the formation of episodic memories , 2012, Hippocampus.

[64]  Lauren A. Sosniak,et al.  Developing Talent in Young People , 1985 .

[65]  A. Braun,et al.  Neural Correlates of Lyrical Improvisation: An fMRI Study of Freestyle Rap , 2012, Scientific Reports.

[66]  Kazuo Okanoya,et al.  On-line Assessment of Statistical Learning by Event-related Potentials , 2008, Journal of Cognitive Neuroscience.

[67]  P. Loui,et al.  Jazz musicians reveal role of expectancy in human creativity , 2017, Brain and Cognition.

[68]  M. Pearce,et al.  Electrophysiological correlates of melodic processing in congenital amusia , 2013, Neuropsychologia.

[69]  Luis Jiménez,et al.  Which Attention Is Needed for Implicit Sequence Learning , 1999 .

[70]  R. Knight,et al.  A Generalized Mechanism for Perception of Pitch Patterns , 2009, The Journal of Neuroscience.

[71]  Justyna Humięcka-Jakubowska,et al.  Sweet Anticipation : Music and , 2006 .

[72]  Carla L. Hudson Kam,et al.  Humans Rapidly Learn Grammatical Structure in a New Musical Scale. , 2010, Music perception.

[73]  K. Bäuml,et al.  Brain oscillations dissociate between semantic and nonsemantic encoding of episodic memories. , 2009, Cerebral cortex.

[74]  F. Pachet,et al.  Surprising Harmonies , 1999 .

[75]  A. Isen,et al.  Positive affect improves creative problem solving and influences reported source of practice satisfaction in physicians , 1994 .

[76]  E. Pothos Theories of artificial grammar learning. , 2007, Psychological bulletin.

[77]  Yang Zhang,et al.  Learning Temporal Statistics for Sensory Predictions in Aging , 2016, Journal of Cognitive Neuroscience.

[78]  D. Wessel,et al.  Learning and Liking an Artificial Musical System: Effects of Set Size and Repeated Exposure , 2008, Musicae scientiae : the journal of the European Society for the Cognitive Sciences of Music.

[79]  R. Knight,et al.  P300 generation by novel somatosensory stimuli. , 1991, Electroencephalography and clinical neurophysiology.

[80]  Emery Schubert,et al.  Back to the inverted-U for music preference: A review of the literature , 2017 .

[81]  Robert J. Sternberg,et al.  Expertise and Intelligent Thinking: When is it Worse to Know Better , 1989 .

[82]  W. Klimesch,et al.  Visual P2 component is related to theta phase-locking , 2007, Neuroscience Letters.

[83]  D. Berlyne,et al.  Aesthetics and Psychobiology , 1975 .

[84]  Arne D. Ekstrom,et al.  Behavioral correlates of human hippocampal delta and theta oscillations during navigation. , 2011, Journal of neurophysiology.

[85]  Stefan Skare,et al.  See Blockindiscussions, Blockinstats, Blockinand Blockinauthor Blockinprofiles Blockinfor Blockinthis Blockinpublication Extensive Blockinpiano Blockinpracticing Blockinhas Blockinregionally Specific Blockineffects Blockinon Blockinwhite Blockinmatter Blockindevelopment , 2022 .

[86]  Daniel Müllensiefen,et al.  The Musicality of Non-Musicians: An Index for Assessing Musical Sophistication in the General Population , 2014, PloS one.

[87]  A. Braun,et al.  Neural Substrates of Spontaneous Musical Performance: An fMRI Study of Jazz Improvisation , 2008, PloS one.

[88]  I. Cross,et al.  Modelling unsupervised online-learning of artificial grammars: Linking implicit and statistical learning , 2014, Consciousness and Cognition.

[89]  Morten H. Christiansen,et al.  Implicit Statistical Learning: A Tale of Two Literatures , 2019, Top. Cogn. Sci..

[90]  Michael Rose,et al.  Differential effects of ongoing EEG beta and theta power on memory formation , 2017, PloS one.

[91]  J. Polich Updating P 300 : An Integrative Theory of P 3 a and P 3 b , 2009 .

[92]  仁 寺井,et al.  日本語版Remote Associates Testの作成と評価 , 2013 .

[93]  M. Hickey,et al.  An Application of Amabile's Consensual Assessment Technique for Rating the Creativity of Children's Musical Compositions , 2001 .

[94]  Joanne Arciuli,et al.  Musicians’ Online Performance during Auditory and Visual Statistical Learning Tasks , 2017, Front. Hum. Neurosci..

[95]  T. M. Amabile Social psychology of creativity: A consensual assessment technique. , 1982 .

[96]  Zoltan Dienes,et al.  Can musical transformations be implicitly learned? , 2004, Cogn. Sci..

[97]  Hans-Christian Pape,et al.  Amygdalar and Hippocampal Theta Rhythm Synchronization During Fear Memory Retrieval , 2003, Science.

[98]  Kush R. Varshney,et al.  Cognition as a part of computational creativity , 2013, 2013 IEEE 12th International Conference on Cognitive Informatics and Cognitive Computing.

[99]  Dean Keith Simonton,et al.  Creative Development as Acquired Expertise: Theoretical Issues and an Empirical Test☆ , 2000 .

[100]  C. Büchel,et al.  Functional Dissociation of Ongoing Oscillatory Brain States , 2012, PloS one.

[101]  Geraint A. Wiggins,et al.  Methods for Combining Statistical Models of Music , 2004, CMMR.

[102]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.