Data-intensive evaluation of design creativity using novelty, value, and surprise

The increasing availability of large quantities of product-related data provides an opportunity to augment human designers with analytical models for evaluating the creativity of a new design. In this paper we describe three characteristics of a creative design: novelty, value, and surprise. We present an analytical framework for computationally evaluating the creativity of a new design. Building on our previous work, we associate each characteristic with a computational process, and develop a new model for evaluating surprise using predictive analytics. We describe an implementation of our analytical models as applied to a data-set of mobile devices. We report on the most surprising devices identified by our models and their corresponding novelty and value scores, and conclude by discussing the broader applications and implications of an analytical approach to evaluating creative designs.

[1]  Christopher M. Bishop,et al.  Novelty detection and neural network validation , 1994 .

[2]  Eric Horvitz,et al.  Prediction, Expectation, and Surprise: Methods, Designs, and Study of a Deployed Traffic Forecasting Service , 2005, UAI.

[3]  Douglas H. Fisher,et al.  Iterative Optimization and Simplification of Hierarchical Clusterings , 1996, J. Artif. Intell. Res..

[4]  K. Teigen,et al.  Surprises: low probabilities or high contrasts? , 2003, Cognition.

[5]  R. E. Carlson,et al.  Monotone Piecewise Cubic Interpolation , 1980 .

[6]  Mihaly Csikszentmihalyi,et al.  New Conceptions and Research Approaches to Creativity: Implications of a Systems Perspective for Creativity in Education , 2014 .

[7]  Jacob Goldenberg,et al.  Creativity in product innovation: Introduction: characterization and illustration of Creativity Templates , 2002 .

[8]  James Theiler,et al.  Accurate On-line Support Vector Regression , 2003, Neural Computation.

[9]  Rob Saunders,et al.  Curious Design Agents and Artificial Creativity - A Synthetic Approach to the Study of Creative Behaviour , 2001 .

[10]  M. W. Peters.  Towards Artificial Forms of Intelligence, Creativity, and Surprise , 1998 .

[11]  Sally M. Reis,et al.  The Assessment of Creative Products in Programs for Gifted and Talented Students , 1991 .

[12]  David H. Cropley,et al.  Engineering Creativity: A Systems Concept of Functional Creativity , 2005 .

[13]  Geraint A. Wiggins,et al.  A preliminary framework for description, analysis and comparison of creative systems , 2006, Knowl. Based Syst..

[14]  D. Berlyne.  Novelty, complexity, and hedonic value , 1970 .

[15]  A. Cardoso,et al.  Assessing Creativity : The importance of unexpected novelty , 2022 .

[16]  A. Cardoso,et al.  Modeling Forms of Surprise in Artificial Agents: Empirical and Theoretical Study of Surprise Functions , 2004 .

[17]  Tony Veale,et al.  Converging on the Divergent: The History (and Future) of the International Joint Workshops in Computational Creativity , 2009, AI Mag..

[18]  A. Cardoso,et al.  Modeling Forms of Surprise in an Artificial Agent , 2001 .

[19]  David J. Ketchen,et al.  THE APPLICATION OF CLUSTER ANALYSIS IN STRATEGIC MANAGEMENT RESEARCH: AN ANALYSIS AND CRITIQUE , 1996 .

[20]  Mary Lou Maher,et al.  Evaluating creativity in humans, computers, and collectively intelligent systems , 2010, DESIRE.

[21]  M. Boden.  The creative mind : myths & mechanisms , 1991 .

[22]  David H. Cropley,et al.  Measuring Creativity for Innovation Management , 2011 .

[23]  Katherine A. Brady,et al.  Modeling Expectation for Evaluating Surprise in Design Creativity , 2015 .

[24]  Jürgen Schmidhuber,et al.  Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes , 2008, ABiALS.

[25]  H. Simon,et al.  The Processes of Creative Thinking , 1959 .

[26]  David C. Brown,et al.  Developing computational design creativity systems , 2013 .

[27]  Kyle E. Jennings.  Developing Creativity: Artificial Barriers in Artificial Intelligence , 2010, Minds and Machines.

[28]  Steven M. Smith,et al.  Metrics for measuring ideation effectiveness , 2003 .

[29]  Jordi Vallverdú,et al.  Handbook of Research on Synthetic Emotions and Sociable Robotics: New Applications in Affective Computing and Artificial Intelligence , 2009 .

[30]  T. M. Amabile.  Social psychology of creativity: A consensual assessment technique. , 1982 .

[31]  Derek Partridge,et al.  Surprisingness and Expectation Failure: What's the Difference? , 1987, IJCAI.

[32]  Kazjon Grace,et al.  What to expect when you're expecting: The role of unexpectedness in computationally evaluating creativity , 2014, ICCC.

[33]  Douglas H. Fisher,et al.  Knowledge Acquisition Via Incremental Conceptual Clustering , 1987, Machine Learning.

[34]  Douglas H. Fisher,et al.  USING AI TO EVALUATE CREATIVE DESIGNS , 2012 .

[35]  G. Salvendy,et al.  Consumer‐based assessment of product creativity: A review and reappraisal , 2006 .

[36]  John S. Gero,et al.  The Situated Function - Behaviour - Structure Framework , 2002, AID.

[37]  Emiliano Lorini,et al.  The cognitive structure of surprise: looking for basic principles , 2007 .

[38]  Amaresh Chakrabarti,et al.  Assessing design creativity , 2011 .

[39]  N. Foo.  Conceptual Spaces—The Geometry of Thought , 2022 .

[40]  M. Lorenzen.  Creativity in context : Content, cost, chance and collection in the organization of the film industry , 2009 .

[41]  Sharon Bailin.  CREATIVITY IN CONTEXT , 2002 .

[42]  Graeme Ritchie,et al.  The transformational creativity hypothesis , 2006, New Generation Computing.

[43]  Irem Y. Tumer,et al.  The Potential of Creativity Metrics for Mechanical Engineering Concept Design , 2009 .

[44]  Karen O'Quin,et al.  Confirming the Three-Factor Creative Product Analysis Matrix Model in an American Sample , 1999 .

[45]  Wei-Min Shen,et al.  Surprise-Based Learning for Developmental Robotics , 2008, 2008 ECSIS Symposium on Learning and Adaptive Behaviors for Robotic Systems (LAB-RS).

[46]  S. Fienberg,et al.  The Clockwork Muse: The Predictability of Artistic Change. , 1991 .

[47]  M. Csíkszentmihályi.  Society, Culture, and Person: A Systems View of Creativity , 2014 .

[48]  David C. Brown,et al.  Creativity, Surprise & Design: An Introduction and Investigation , 2012 .

[49]  Katherine A. Brady,et al.  Computational Models of Surprise in Evaluating Creative Design , 2013 .

[50]  Mark T. Keane,et al.  Surprise: Disconfirmed expectations or representation-fit? , 2006 .

[51]  R. Sternberg.  The Nature of creativity : contemporary psychological perspectives , 1988 .

[52]  H. Switzky,et al.  Exploration and Curiosity , 2008 .

[53]  Kamran Baig.  An act of creation , 2003, BMJ : British Medical Journal.

[54]  D. Berlyne.  Curiosity and exploration. , 1966, Science.

[55]  C. W. Park,et al.  Familiarity and Its Impact on Consumer Decision Biases and Heuristics , 1981 .