Discernment and creativity: How well can people identify their most creative ideas?

How well can people judge the creativity of their ideas? The distinction between generating ideas and evaluating ideas appears in many theories of creativity, but the massive literature on generation has overshadowed the question of evaluation. After critically reviewing the notion of accuracy in creativity judgments, this article explores whether (1) people in general are discerning and (2) whether some people are more discerning than others. University students (n 226) completed four divergent thinking tasks and then decided which responses were their most creative. Judges then rated the creativity of all of the responses. Multilevel latent-variable models found that people’s choices strongly agreed with judges’ ratings of the responses; overall, people were discerning in their decisions. But some people were more discerning than others: people high in openness to experience, in particular, had stronger agreement between their decisions and the judges’ ratings. Creative people are thus doubly skilled: they are better at generating good ideas and at picking their best ideas.

[1]  M. Runco,et al.  Assessing the Accuracy of Judgments of Originality on Three Divergent Thinking Tests , 2004 .

[2]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[3]  Gregory J. Feist The Psychology of Science and the Origins of the Scientific Mind , 2006 .

[4]  Mark A. Runco,et al.  Commentary: Divergent Thinking Is Not Synonymous With Creativity , 2008 .

[5]  Robert R. McCrae,et al.  Aesthetic Chills as a Universal Marker of Openness to Experience , 2007 .

[6]  Sheri J. Broyles,et al.  Creativity and the Five-Factor Model , 1996 .

[7]  Michael D. Mumford,et al.  Commentary: Measuring divergent thinking: Is there really one solution to the problem? , 2008 .

[8]  David C. Funder On the accuracy of personality judgment: a realistic approach. , 1995 .

[9]  D. Funder On the accuracy of personality judgment: a realistic approach. , 1995, Psychological review.

[10]  Jonathan A. Plucker,et al.  Generalization of Creativity Across Domains: Examination of the Method Effect Hypothesis , 2004 .

[11]  John A. Johnson,et al.  The international personality item pool and the future of public-domain personality measures ☆ , 2006 .

[12]  Aaron Kozbelt A quantitative analysis of Beethoven as self-critic: implications for psychological theories of musical creativity , 2007 .

[13]  Soonmook Lee Commentary: Reliability and validity of uniqueness scoring in creativity assessment. , 2008 .

[14]  H. Wagner On measuring performance in category judgment studies of nonverbal behavior , 1993 .

[15]  John T. Willse,et al.  Rejoinder: The madness to our method: Some thoughts on divergent thinking , 2008 .

[16]  J P GUILFORD,et al.  The measurement of individual differences in originality. , 1953, Psychological bulletin.

[17]  Gregory J. Feist A Meta-Analysis of Personality in Scientific and Artistic Creativity , 1998, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[18]  Aaron Kozbelt,et al.  Factors affecting aesthetic success and improvement in creativity: a case study of the musical genres of Mozart , 2005 .

[19]  A. Kruglanski,et al.  The Social Psychology of Knowledge , 2010 .

[20]  N. Kogan Commentary: Divergent-thinking research and the Zeitgeist. , 2008 .

[21]  Paul J. Silvia,et al.  Creativity and Intelligence Revisited: A Latent Variable Analysis of Wallach and Kogan (1965) , 2008 .

[22]  R. Weisberg Creativity: Understanding Innovation in Problem Solving, Science, Invention, and the Arts , 2006 .

[23]  Michael D. Mumford,et al.  Evaluative Aspects of Creative Thought: Effects of Appraisal and Revision Standards , 2004 .

[24]  John T. Willse,et al.  Assessing Creativity With Divergent Thinking Tasks: Exploring the Reliability and Validity of New Subjective Scoring Methods , 2008 .

[25]  Jordan B. Peterson,et al.  Reliability, Validity, and Factor Structure of the Creative Achievement Questionnaire , 2005 .

[26]  A. Cropley In Praise of Convergent Thinking , 2006 .

[27]  John Baer,et al.  Commentary: Divergent Thinking Tests Have Problems, But This Is Not the Solution , 2008 .

[28]  Bengt Muthén,et al.  Latent Variable Growth Modeling with Multilevel Data , 1997 .

[29]  James C. Kaufman,et al.  Captions, consistency, creativity, and the consensual assessment technique: New evidence of reliability , 2007 .

[30]  W. R. Smith,et al.  Interpersonal and intrapersonal evaluations of creative ideas , 1992 .

[31]  John Baer,et al.  Creativity across domains : faces of the muse , 2005 .

[32]  Paul J. Silvia,et al.  An Introduction to Multilevel Modeling for Research on the Psychology of Art and Creativity , 2007 .

[33]  B. Muthén BEYOND SEM: GENERAL LATENT VARIABLE MODELING , 2002 .

[34]  Z. Wodniecka,et al.  Divergent Thinking and Evaluation Skills: Do They Always Go Together? , 2006 .

[35]  Donald B. Rubin,et al.  The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles. , 1974 .

[36]  D. Simonton Fickle fashion versus immortal fame: Transhistorical assessments of creative products in the opera house. , 1998 .

[37]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[38]  M. Runco,et al.  Developmental Trends in the Evaluative and Divergent Thinking of Children , 2001 .

[39]  R. Sawyer Explaining Creativity: The Science of Human Innovation , 2006 .

[40]  R. McCrae Creativity, divergent thinking, and openness to experience. , 1987 .

[41]  R. Sternberg RETRACTED ARTICLE: The Nature of Creativity , 2006 .

[42]  D. Hocevar,et al.  Ideational fluency as a confounding factor in the measurement of originality. , 1979 .

[43]  Kyung H Kim Commentary: The Torrance Tests of Creative Thinking Already Overcome Many of the Perceived Weaknesses That Silvia et al.'s (2008) Methods Are Intended to Correct , 2008 .

[44]  R. Hastie,et al.  The concept of accuracy in social judgment. , 1988 .

[45]  L. Cronbach Processes affecting scores on understanding of others and assumed similarity. , 1955, Psychological bulletin.

[46]  D. Simonton Origins of genius : Darwinian perspectives on creativity , 1999 .

[47]  Michael A. Wallach,et al.  Modes of thinking in young children: A study of the creativity-intelligence distinction. , 1965 .

[48]  Paul J. Silvia,et al.  On Introspection and Self-Perception: Does Self-Focused Attention Enable Accurate Self-Knowledge? , 2001 .

[49]  D. Gilbert,et al.  Decisions and revisions: the affective forecasting of changeable outcomes. , 2002, Journal of personality and social psychology.

[50]  L. Balázs,et al.  The influence of self-focused attention on heartbeat perception. , 1988, Psychophysiology.