The Dynamics of Creative Ideation: Introducing a New Assessment Paradigm

Despite six decades of creative cognition research, measures of creative ideation have heavily relied on divergent thinking tasks, which still suffer from conceptual, design, and psychometric shortcomings. These shortcomings have greatly impeded the accurate study of creative ideation, its dynamics, development, and integration as part of a comprehensive psychological assessment. After a brief overview of the historical and current anchoring of creative ideation measurement, overlooked challenges in its most common operationalization (i.e., divergent thinking tasks framework) are discussed. They include (1) the reliance on a single stimulus as a starting point of the creative ideation process (stimulus-dependency), (2) the analysis of response quality based on a varying number of observations across test-takers (fluency-dependency), and (3) the production of “static” cumulative performance indicators. Inspired from an emerging line of work from the field of cognitive neuroscience of creativity, this paper introduces a new assessment framework referred to as “Multi-Trial Creative Ideation” (MTCI). This framework shifts the current measurement paradigm by (1) offering a variety of stimuli presented in a well-defined set of ideation “trials,” (2) reinterprets the concept of ideational fluency using a time-analysis of idea generation, and (3) captures individual dynamics in the ideation process (e.g., modeling the effort-time required to reach a response of maximal uncommonness) while controlling for stimulus-specific sources of variation. Advantages of the MTCI framework over the classic divergent thinking paradigm are discussed in light of current directions in the field of creativity research.

[1]  W. Noortgate,et al.  Methodological Issues in Measuring Creativity: A Systematic Literature Review , 2017 .

[2]  Baptiste Barbot,et al.  New directions for the study of within-individual variability in development: the power of "N = 1". , 2015, New directions for child and adolescent development.

[3]  Matthijs Baas,et al.  The dual pathway to creativity model: Creative ideation as a function of flexibility and persistence , 2010 .

[4]  G. Ritchie Assessing Creativity , 2001 .

[5]  C. Dreu,et al.  Widespread neural oscillations in the delta band dissociate rule convergence from rule divergence during creative idea generation , 2017, Neuropsychologia.

[6]  P. Silvia,et al.  A snapshot of creativity: Evaluating a quick and simple method for assessing divergent thinking , 2009 .

[7]  Frank M. Spinath,et al.  The interrelationship between speeded and unspeeded divergent thinking and reasoning, and the role of mental speed , 2011 .

[8]  Todd Lubart,et al.  Creative potential in educational settings: its nature, measure, and nurture , 2015 .

[9]  William B. Michael,et al.  Components of Original Thinking in Gifted Children , 1988 .

[10]  Todd Lubart,et al.  Children's Original Thinking: An Empirical Examination of Alternative Measures Derived From Divergent Thinking Tasks , 2001, The Journal of genetic psychology.

[11]  J. Guilford,et al.  The nature of human intelligence. , 1968 .

[12]  J. P. Guilford,et al.  Short-term incubation in divergent production. , 1968, The American journal of psychology.

[13]  Mathias Benedek,et al.  Creativity meets neuroscience: experimental tasks for the neuroscientific study of creative thinking. , 2007, Methods.

[14]  M. Runco,et al.  The moderating influence of idea sequence: A re-analysis of the relationship between category switch and latency , 2019, Personality and Individual Differences.

[15]  Roger E. Beaty,et al.  Old or New? Evaluating the Old/New Scoring Method for Divergent Thinking Tasks , 2017 .

[16]  Sing Lau,et al.  Creativity Assessment: Comparability of the Electronic and Paper-and-Pencil Versions of the Wallach-Kogan Creativity Tests. , 2010 .

[17]  Heinz Holling,et al.  Are Speedy Brains Needed when Divergent Thinking is Speeded—or Unspeeded? , 2020 .

[18]  H. Holling,et al.  Understanding the confounding effect of fluency in divergent thinking scores: Revisiting average scores to quantify artifactual correlation. , 2020 .

[19]  Yoed N. Kenett Going the Extra Creative Mile: The Role of Semantic Distance in Creativity – Theory, Research, and Measurement , 2018 .

[20]  M. Benedek,et al.  Neuroscience and Biobehavioral Reviews Eeg Alpha Power and Creative Ideation , 2022 .

[21]  Colin Martindale,et al.  Divergent thinking ability is related to faster relatedness judgments. , 2009 .

[22]  N. Kogan Commentary: Divergent-thinking research and the Zeitgeist. , 2008 .

[23]  Ning Hao,et al.  Neural correlates of serial order effect in verbal divergent thinking , 2017, Neuropsychologia.

[24]  Paul T. Sowden,et al.  The shifting sands of creative thinking: Connections to dual-process theory , 2014, 1409.2207.

[25]  Teresa M. Amabile,et al.  ? + ? = creativity. , 2018, Public health nursing.

[26]  M. Karwowski,et al.  Exploring the Creative Process: Integrating Psychometric and Eye-Tracking Approaches , 2018, Front. Psychol..

[27]  M. Runco,et al.  Divergent Thinking as an Indicator of Creative Potential , 2012 .

[28]  John Baer,et al.  Essentials of Creativity Assessment , 2008 .

[29]  Jonathan A. Plucker,et al.  Is the Proof in the Pudding? Reanalyses of Torrance's (1958 to Present) Longitudinal Data , 1999 .

[30]  Paul T. Sowden,et al.  Unearthing the creative thinking process: fresh insights from a think aloud study of garden design , 2017 .

[31]  Colin Martindale,et al.  Creativity and speed of information processing: A double dissociation involving elementary versus inhibitory cognitive tasks , 2008 .

[32]  E. Grigorenko,et al.  Identifying learning patterns of children at risk for Specific Reading Disability. , 2016, Developmental science.

[33]  Gavriel Salvendy,et al.  Can Traditional Divergent Thinking Tests Be Trusted in Measuring and Predicting Real-World Creativity? , 2011 .

[34]  A. Furnham,et al.  Intelligence and personality as predictors of divergent thinking: The role of general, fluid and crystallised intelligence , 2009 .

[35]  Charles Dobson,et al.  Evaluative and generative modes of thought during the creative process , 2012, NeuroImage.

[36]  S. Parnes Effects of extended effort in creative problem solving. , 1961 .

[37]  Heinz Holling,et al.  Typing Speed as a Confounding Variable and the Measurement of Quality in Divergent Thinking , 2017 .

[38]  Selcuk Acar,et al.  Assessing Associative Distance Among Ideas Elicited by Tests of Divergent Thinking , 2014 .

[39]  Alexander P. Christensen,et al.  Creativity assessment in neuroscience research. , 2019, Psychology of Aesthetics, Creativity, and the Arts.

[40]  W. R. Smith,et al.  Information, Experience, and Divergent Thinking: An Empirical Test , 2006 .

[41]  J. Guilford,et al.  Sixteen Divergent-Production Abilities at the Ninth-Grade Level , 1966 .

[42]  Matthijs Baas,et al.  Hedonic tone and activation level in the mood-creativity link: toward a dual pathway to creativity model. , 2008, Journal of personality and social psychology.

[43]  G. Bugmann,et al.  Paving the Way to Eureka—Introducing “Dira” as an Experimental Paradigm to Observe the Process of Creative Problem Solving , 2018, Front. Psychol..

[44]  Miriam Faust,et al.  Measuring spontaneous processes in creativity research , 2019, Current Opinion in Behavioral Sciences.

[45]  Todd Lubart,et al.  Creative Thinking in Music: Its Nature and Assessment Through Musical Exploratory Behaviors , 2012 .

[46]  Ilona Papousek,et al.  The creative brain in the figural domain: Distinct patterns of EEG alpha power during idea generation and idea elaboration , 2018, Neuropsychologia.

[47]  Roger E. Beaty,et al.  Why do ideas get more creative across time? An executive interpretation of the serial order effect in divergent thinking tasks. , 2012 .

[48]  Baptiste Barbot Preface: Perspectives on Creativity Development. , 2016, New directions for child and adolescent development.

[49]  Pablo P. L. Tinio,et al.  Where is the “g” in creativity? A specialization–differentiation hypothesis , 2015, Front. Hum. Neurosci..

[50]  Zachary C. Irving,et al.  Mind-wandering as spontaneous thought: a dynamic framework , 2016, Nature Reviews Neuroscience.

[51]  D M Harrington,et al.  Effects of explicit instructions to "be creative" on the psychological meaning of divergent thinking test scores. , 1975, Journal of personality.

[52]  John T. Willse,et al.  Assessing Creativity With Divergent Thinking Tasks: Exploring the Reliability and Validity of New Subjective Scoring Methods , 2008 .

[53]  Richard W. Hass Feasibility of online divergent thinking assessment , 2015, Comput. Hum. Behav..

[54]  T. Lubart,et al.  "Peaks, Slumps, and Bumps": Individual Differences in the Development of Creativity in Children and Adolescents. , 2016, New directions for child and adolescent development.

[55]  Nathan Zoanetti,et al.  Interactive computer based assessment tasks: How problem-solving process data can inform instruction , 2010 .

[56]  K. Gilhooly,et al.  Divergent thinking: strategies and executive involvement in generating novel uses for familiar objects. , 2007, British journal of psychology.

[57]  Jyrki Suomala,et al.  Default Mode and Executive Networks Areas: Association with the Serial Order in Divergent Thinking , 2016, PloS one.

[58]  Sharon L Thompson-Schill,et al.  Functional Fixedness in Creative Thinking Tasks Depends on Stimulus Modality. , 2016, Psychology of aesthetics, creativity, and the arts.

[59]  J. Kaufman,et al.  Beyond Big and Little: The Four C Model of Creativity , 2009 .

[60]  Yuval Hart,et al.  Creative foraging: An experimental paradigm for studying exploration and discovery , 2017, PloS one.

[61]  N. Jausovec Differences in EEG Activity During the Solution of Closed and Open Problems , 1997 .

[62]  Mark A. Runco,et al.  The Cambridge Handbook of Creativity: Divergent Thinking, Creativity, and Ideation , 2010 .

[63]  Todd Lubart,et al.  The generality-specificity of creativity: Exploring the structure of creative potential with EPoC , 2016 .

[64]  Yoed N. Kenett,et al.  Investigating the structure of semantic networks in low and high creative persons , 2014, Front. Hum. Neurosci..

[65]  J P GUILFORD,et al.  Relations of creative responses to working time and instructions. , 1957, Journal of experimental psychology.

[66]  Adam E. Green,et al.  Frontopolar activity and connectivity support dynamic conscious augmentation of creative state , 2015, Human brain mapping.

[67]  W. A. Bousfield,et al.  An Analysis of Sequences of Restricted Associative Responses , 1944 .

[68]  Richard W. Hass,et al.  Tracking the dynamics of divergent thinking via semantic distance: Analytic methods and theoretical implications , 2017, Memory & cognition.

[69]  John Baer Domain Specificity and the Limits of Creativity Theory , 2012 .

[70]  Sohee Park,et al.  Verbal creativity and schizotypal personality in relation to prefrontal hemispheric laterality: A behavioral and near-infrared optical imaging study , 2005, Schizophrenia Research.

[71]  P. Silvia,et al.  Default and Executive Network Coupling Supports Creative Idea Production , 2015, Scientific Reports.

[72]  T. Lubart,et al.  Assessing Creativity in the Classroom , 2011 .

[73]  Heinz Holling,et al.  The be-creative effect in divergent thinking: The interplay of instruction and object frequency , 2016 .

[74]  Jean E Pretz,et al.  The Creative Task Creator: A tool for the generation of customized, Web-based creativity tasks , 2008, Behavior research methods.

[75]  Ilona Papousek,et al.  Affective creativity meets classic creativity in the scanner , 2018, Human brain mapping.

[76]  A Partial Evaluation of Torrance's Tests of Creativity1 , 1970 .

[77]  Kevin J. Grimm,et al.  Longitudinal Multitrait-Multimethod Models for Developmental Research , 2009, Multivariate behavioral research.

[78]  Roger E. Beaty,et al.  Ready, Set, Create: What Instructing People to "Be Creative" Reveals About the Meaning and Mechanisms of Divergent Thinking , 2014 .

[79]  Jeremy R. Gray,et al.  Thin slices of creativity: Using single-word utterances to assess creative cognition , 2013, Behavior research methods.