Preference Models for Creative Artifacts and Systems

Although there is vigorous debate around definitions of creativity, there is general consensus that creativity i) has multiple facets, and ii) inherently involves a subjective value judgment by an evaluator. In this paper, we present evaluation of creative artifacts and computational creativity systems through a multiattribute preference modeling lens. Specifically, we introduce the use of multiattribute value functions for creativity evaluation and argue that there are significant benefits to explicitly representing creativity judgments as subjective preferences using formal mathematical models. Various implications are illustrated with the help of examples from and inspired by the creativity literature.

[1]  M. F. Washburn,et al.  Experiments on a Possible Test of Aesthetic Judgment of Pictures , 1918 .

[2]  T. Stewart.  Robustness of Additive Value Function Methods in MCDM , 1996 .

[3]  Simon Colton,et al.  Computational Creativity Theory: The FACE and IDEA Descriptive Models , 2011, ICCC.

[4]  Kalyanmoy Deb,et al.  Multiple Criteria Decision Making, Multiattribute Utility Theory: Recent Accomplishments and What Lies Ahead , 2008, Manag. Sci..

[5]  T. M. Amabile.  Social psychology of creativity: A consensual assessment technique. , 1982 .

[6]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Simon Colton,et al.  On impact and evaluation in computational creativity: a discussion of the Turing Test and an alternative proposal , 2011 .

[8]  R. Sternberg.  The Rainbow Project: Enhancing the SAT through assessments of analytical, practical, and creative skills , 2006 .

[9]  Eyke Hüllermeier,et al.  Preference Learning , 2005, Künstliche Intell..

[10]  Eyke Hllermeier,et al.  Preference Learning , 2010 .

[11]  Simon Colton,et al.  Evaluating Machine Creativity , 2001 .

[12]  Francisco Câmara Pereira.  Creativity and Artificial Intelligence , 2007 .

[13]  Theodor J. Stewart,et al.  Multiple criteria decision analysis - an integrated approach , 2001 .

[14]  R. Sternberg,et al.  An Investment Theory of Creativity and Its Development , 1991 .

[15]  M. Sklar.  Fonctions de repartition a n dimensions et leurs marges , 1959 .

[16]  F. B. Vernadat,et al.  Decisions with Multiple Objectives: Preferences and Value Tradeoffs , 1994 .

[17]  Rakesh K. Sarin,et al.  Measurable Multiattribute Value Functions , 1979, Oper. Res..

[18]  Ali E. Abbas,et al.  Multiattribute Utility Copulas , 2009, Oper. Res..

[19]  Simon Colton,et al.  Creativity Versus the Perception of Creativity in Computational Systems , 2008, AAAI Spring Symposium: Creative Intelligent Systems.

[20]  Simon Colton,et al.  Computational Creativity: The Final Frontier? , 2012, ECAI.

[21]  M. Boden.  The creative mind : myths & mechanisms , 1991 .

[22]  Anna Jordanous,et al.  A Standardised Procedure for Evaluating Creative Systems: Computational Creativity Evaluation Based on What it is to be Creative , 2012, Cognitive Computation.

[23]  Geraint A. Wiggins.  Searching for computational creativity , 2006, New Generation Computing.

[24]  R. Sternberg.  The Nature of creativity : contemporary psychological perspectives , 1988 .

[25]  R. Mayer.  Handbook of Creativity: Fifty Years of Creativity Research , 1998 .

[26]  S. Atkinson.  Explaining Creativity: The Science of Human Innovation , 2007 .

[27]  Kush R. Varshney,et al.  Cognition as a part of computational creativity , 2013, 2013 IEEE 12th International Conference on Cognitive Informatics and Cognitive Computing.

[28]  H. Simon,et al.  The Processes of Creative Thinking , 1959 .

[29]  Dan Ventura.  A Reductio Ad Absurdum Experiment in Sufficiency for Evaluating (Computational) Creative Systems , 2008 .

[30]  Tony Veale,et al.  Converging on the Divergent: The History (and Future) of the International Joint Workshops in Computational Creativity , 2009, AI Mag..

[31]  Graeme Ritchie,et al.  Some Empirical Criteria for Attributing Creativity to a Computer Program , 2007, Minds and Machines.

[32]  G. Ritchie.  Assessing Creativity , 2001 .

[33]  Anna K. Jordanous.  Evaluating computational creativity : a standardised procedure for evaluating creative systems and its application , 2013 .