Building Artistic Computer Colleagues with an Enactive Model of Creativity

This paper reports on the theory, design, and implementation of an artistic computer colleague that improvises and collaborates with human users in real-time. Our system, Drawing Apprentice, is based on existing theories of art, creative cognition, and collaboration synthesized into an enactive model of creativity. The implementation details of the Drawing Apprentice are provided along with early collaborative artwork created with the system. We present the enactive model of creativity as a potential theoretical framework for designing creative systems involving continuous improvisational collaboration between a human and computer.

[1]  S. Atkinson.  Explaining Creativity: The Science of Human Innovation , 2007 .

[2]  Nancy J. Nersessian,et al.  Creating Scientific Concepts , 2008 .

[3]  T. Ward,et al.  Modeling the Creative Process: A Grounded Theory Analysis of Creativity in the Domain of Art Making , 2002 .

[4]  Hanne De Jaegher.  Social understanding through direct perception? Yes, by interacting. , 2009, Consciousness and cognition.

[5]  H. Simon,et al.  The Processes of Creative Thinking , 1959 .

[6]  Celine Latulipe,et al.  Creativity factor evaluation: towards a standardized survey metric for creativity support , 2009, C&C '09.

[7]  Boyang Li,et al.  Goal-Driven Conceptual Blending: A Computational Approach for Creativity , 2012, ICCC.

[8]  Pablo Picasso,et al.  Le mystère Picasso , 1956 .

[9]  Todd Lubart,et al.  How can computers be partners in the creative process: Classification and commentary on the Special Issue , 2005, Int. J. Hum. Comput. Stud..

[10]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[11]  Allen Newell,et al.  Chunking in Soar: The anatomy of a general learning mechanism , 1985, Machine Learning.

[12]  Maria Adler,et al.  Enaction Toward A New Paradigm For Cognitive Science , 2016 .

[13]  Sylvia Weir,et al.  Action perception , 1974 .

[14]  R. Adamson.  Functional fixedness as related to problem solving; a repetition of three experiments. , 1952, Journal of experimental psychology.

[15]  M. Boden.  The creative mind : myths & mechanisms , 1991 .

[16]  Donald A. Norman,et al.  Affordance, conventions, and design , 1999, INTR.

[17]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[18]  A. Glenberg.  What memory is for: Creating meaning in the service of action , 1997, Behavioral and Brain Sciences.

[19]  Ben Shneiderman,et al.  Creativity support tools: accelerating discovery and innovation , 2007, CACM.

[20]  S. Kosslyn.  Image and Brain: The Resolution of the Imagery Debate , 1994, Journal of Cognitive Neuroscience.

[21]  Terri Gullickson.  The Creative Mind: Myths and Mechanisms. , 1995 .

[22]  Brian Magerko,et al.  Bottoms up: improvisational micro-agents , 2010, FDG.

[23]  L. Gabora.  Revenge of the “Neurds”: Characterizing Creative Thought in Terms of the Structure and Dynamics of Memory , 2010, 1308.5037.

[24]  Paul Dourish,et al.  Where the action is , 2001 .

[25]  Jeff Pressing,et al.  Cognitive Processes in Improvisation , 1984 .

[26]  Boyang Li,et al.  Distributed creative cognition in digital filmmaking , 2011, C&C '11.

[27]  Guy Hoffman,et al.  Gesture-based human-robot Jazz improvisation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[28]  Tracy Brown,et al.  The Embodied Mind: Cognitive Science and Human Experience , 2002, Cybern. Hum. Knowing.

[29]  W. Mauch,et al.  Contents , 2007, European Neuropsychopharmacology.

[30]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[31]  John M. Gaspar,et al.  Suppression of Salient Objects Prevents Distraction in Visual Search , 2014, The Journal of Neuroscience.

[32]  Donald A. Schön.  Designing as reflective conversation with the materials of a design situation , 1992, Knowl. Based Syst..

[33]  Simon Colton,et al.  Creativity Versus the Perception of Creativity in Computational Systems , 2008, AAAI Spring Symposium: Creative Intelligent Systems.

[34]  David Mendonça,et al.  Cognition in Jazz Improvisation: An Exploratory Study , 2004 .