2009 Special Issue: Neural dynamics of idea generation and the effects of priming

Idea generation is a fundamental attribute of the human mind, but the cognitive and neural mechanisms underlying this process remain unclear. In this paper, we present a dynamic connectionist model for the generation of ideas within a brainstorming context. The key hypothesis underlying the model is that ideas emerge naturally from itinerant attractor dynamics in a multi-level, modular semantic space, and the potential surface underlying this dynamics is itself shaped dynamically by task context, ongoing evaluative feedback, inhibitory modulation, and short-term synaptic modification. While abstract, the model attempts to capture the interplay between semantic representations, working memory, attentional selection, reinforcement signals, and modulation. We show that, once trained on a set of contexts and ideas, the system can rapidly recall stored ideas in familiar contexts, and can generate novel ideas by efficient, multi-level dynamical search in both familiar and unfamiliar contexts. We also use a simplified continuous-time instantiation of the model to explore the effect of priming on idea generation. In particular, we consider how priming low-accessible categories in a connectionist semantic network can lead to the generation of novel ideas. The mapping of the model onto various regions and modulatory processes in the brain is also discussed briefly.

[1]  Vincent R. Brown,et al.  Modeling Cognitive Interactions During Group Brainstorming , 1998 .

[2]  P. Goldman-Rakic,et al.  Coding Specificity in Cortical Microcircuits: A Multiple-Electrode Analysis of Primate Prefrontal Cortex , 2001, The Journal of Neuroscience.

[3]  Curt Burgess,et al.  Modelling Parsing Constraints with High-dimensional Context Space , 1997 .

[4]  W. Duch,et al.  Intuition, Insight, Imagination and Creativity , 2007, IEEE Computational Intelligence Magazine.

[5]  K. Heilman,et al.  Creative Innovation: Possible Brain Mechanisms , 2003, Neurocase.

[6]  J. Kelso,et al.  Cortical coordination dynamics and cognition , 2001, Trends in Cognitive Sciences.

[7]  Ali A. Minai,et al.  A dynamical connectionist model of idea generation , 2009, 2009 International Joint Conference on Neural Networks.

[8]  K. Dugosh,et al.  Cognitive stimulation in brainstorming. , 2000, Journal of personality and social psychology.

[9]  Edward M. Bowden,et al.  New approaches to demystifying insight , 2005, Trends in Cognitive Sciences.

[10]  M. Brett,et al.  Large, colorful, or noisy? Attribute- and modality-specific activations during retrieval of perceptual attribute knowledge , 2001 .

[11]  Anthony A. Grace,et al.  Binding across Time: The Selective Gating of Frontal and Hippocampal Systems Modulating Working Memory and Attentional States , 1999, Consciousness and Cognition.

[12]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[13]  R. Shiffrin,et al.  Search of associative memory. , 1981 .

[14]  Si Wu,et al.  Dynamics and Computation of Continuous Attractors , 2008, Neural Computation.

[15]  Joshua B. Tenenbaum,et al.  The Large-Scale Structure of Semantic Networks: Statistical Analyses and a Model of Semantic Growth , 2001, Cogn. Sci..

[16]  Gail A. Carpenter,et al.  Information Fusion and Hierarchical Knowledge Discovery by ARTMAP Neural Networks , 2003 .

[17]  Lorraine K. Tyler,et al.  A Distributed Memory Model of the Associative Boost in Semantic Priming , 1994, Connect. Sci..

[18]  Joaquin M. Fuster,et al.  The prefrontal cortex of the primate: A synopsis , 2000, Psychobiology.

[19]  R. Adolphs,et al.  Neural systems behind word and concept retrieval , 2004, Cognition.

[20]  I. Tsuda Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. , 2001, The Behavioral and brain sciences.

[21]  Mark Steyvers,et al.  Topics in semantic representation. , 2007, Psychological review.

[22]  Richard D. Hichwa,et al.  A neural basis for lexical retrieval , 1996, Nature.

[23]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[24]  Bradford Z. Mahon,et al.  The organization of conceptual knowledge: the evidence from category-specific semantic deficits , 2003, Trends in Cognitive Sciences.

[25]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[26]  K. Dugosh,et al.  Cognitive and social comparison processes in brainstorming , 2005 .

[27]  W. Freeman How Brains Make Up Their Minds , 1999 .

[28]  W. Singer,et al.  Neuronal assemblies: necessity, signature and detectability , 1997, Trends in Cognitive Sciences.

[29]  Ali A. Minai,et al.  Effects of relevant and irrelevant primes on idea generation: A computational model , 2009, 2009 International Joint Conference on Neural Networks.

[30]  Vincent R. Brown,et al.  Effects of Task Instructions and Brief Breaks on Brainstorming , 2006 .

[31]  M. Boden Creativity and unpredictability , 1995 .

[32]  M. Frank,et al.  Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. , 2006, Psychological review.

[33]  D. Durstewitz,et al.  A Neurocomputational Theory of the Dopaminergic Modulation of Working Memory Functions , 1999, The Journal of Neuroscience.

[34]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[35]  Paul Apicella,et al.  Leading tonically active neurons of the striatum from reward detection to context recognition , 2007, Trends in Neurosciences.

[36]  Ali A. Minai,et al.  A conceptual neural model of idea generation , 2009, 2009 International Joint Conference on Neural Networks.

[37]  Wolfgang Stroebe,et al.  How the Group Affects the Mind: A Cognitive Model of Idea Generation in Groups , 2006, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[38]  A. Graybiel Building action repertoires: memory and learning functions of the basal ganglia , 1995, Current Opinion in Neurobiology.

[39]  Ali A. Minai,et al.  Adaptive Dynamic Modularity in a Connectionist Model of Context-Dependent Idea Generation , 2007, 2007 International Joint Conference on Neural Networks.

[40]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[41]  Gail A. Carpenter,et al.  Self-organizing information fusion and hierarchical knowledge discovery: a new framework using ARTMAP neural networks , 2005, Neural Networks.

[42]  Antonio R. Damasio,et al.  The Brain Binds Entities and Events by Multiregional Activation from Convergence Zones , 1989, Neural Computation.

[43]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[44]  Melissa A. Schilling A "Small-World" Network Model of Cognitive Insight , 2005 .

[45]  Gabriella Vigliocco,et al.  Integrating experiential and distributional data to learn semantic representations. , 2009, Psychological review.

[46]  James C. Houk,et al.  Agents of the mind , 2005, Biological Cybernetics.

[47]  James L. McClelland,et al.  The parallel distributed processing approach to semantic cognition , 2003, Nature Reviews Neuroscience.

[48]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[49]  A. Damasio,et al.  Emotion, decision making and the orbitofrontal cortex. , 2000, Cerebral cortex.

[50]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[51]  B. Mesquita,et al.  Adjustment to Chronic Diseases and Terminal Illness Health Psychology : Psychological Adjustment to Chronic Disease , 2006 .

[52]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[53]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[54]  M. Garrett,et al.  Representing the meanings of object and action words: The featural and unitary semantic space hypothesis , 2004, Cognitive Psychology.

[55]  Ichiro Tsuda,et al.  Towards an interpretation of dynamic neural activity in terms of chaotic dynamical systems , 2000 .

[56]  S. Mednick The associative basis of the creative process. , 1962, Psychological review.

[57]  S Dehaene,et al.  A neuronal model of a global workspace in effortful cognitive tasks. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[58]  Mary T. Dzindolet,et al.  Social influence processes in group brainstorming. , 1993 .

[59]  T. Shallice,et al.  Category specific semantic impairments , 1984 .

[60]  Mark S. Seidenberg,et al.  On the nature and scope of featural representations of word meaning. , 1997, Journal of experimental psychology. General.

[61]  Tom Verguts,et al.  Measures of similarity in models of categorization , 2004, Memory & cognition.

[62]  V. Mountcastle The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[63]  T. Rogers,et al.  Where do you know what you know? The representation of semantic knowledge in the human brain , 2007, Nature Reviews Neuroscience.

[64]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[65]  Vincent R. Brown,et al.  Enhancing ideational creativity in groups: Lessons from research on brainstorming. , 2003 .

[66]  Vincent R. Brown,et al.  Cognitive stimulation and problem presentation in idea-generating groups. , 2000 .

[67]  G. Edelman,et al.  Complexity and coherency: integrating information in the brain , 1998, Trends in Cognitive Sciences.

[68]  B. Nijstad,et al.  Cognitive stimulation and interference in groups: Exposure effects in an idea generation task , 2002 .