Creative sketching partner: an analysis of human-AI co-creativity

The creative sketching partner (CSP) is a proof of concept intelligent interface to inspire designers while sketching in response to a specified design task. With this interactive system we are studying the effect of an AI model of visual and conceptual similarity for selecting the Al's sketch response as an inspiration to the current state of the user's sketch. Specifically, we are interested in the user's behavior and response to an AI partner when engaged in a design task. By developing deep learning models of the sketches from a large-scale dataset, the user can control the amount of visual and conceptual similarity of the AI response when requesting inspiration from the CSP. We conducted a study with 50 design students to examine the participants' interaction behavior and their self reports. The participants' behavior maps into clusters that are co-related with three types of design creativity: combinatorial, exploratory, and transformational. Our findings demonstrate that the tool can facilitate ideation and overcome design fixation. In addition, analysis suggests that inspiration related to conceptual similarity is more associated with transformational creativity and inspiration related to visual similarity occurs more frequently during the detailed stages of design and is more prevalent with combinatorial creativity.

[1]  Bo T. Christensen,et al.  Spontaneous Access and Analogical Incubation Effects , 2005 .

[2]  Amitava Das,et al.  Poetic Machine: Computational Creativity for Automatic Poetry Generation in Bengali , 2014, ICCC.

[3]  Nathalie Bonnardel,et al.  The Impact of Technology on Creativity in Design: An Enhancement? , 2010 .

[4]  John A. Biles,et al.  GenJam: A Genetic Algorithm for Generating Jazz Solos , 1994, ICMC.

[5]  Pegah Karimi,et al.  Deep Learning in a Computational Model for Conceptual Shifts in a Co-Creative Design System , 2019, ICCC.

[6]  Jason Hong,et al.  Sketch it, make it: sketching precise drawings for laser cutting , 2012, CHI EA '12.

[7]  Chih-Pin Hsiao.  SolidSketch: Toward Enactive Interactions for Semantic Model Creation , 2015, Creativity & Cognition.

[8]  Akshay Gupta,et al.  Viewpoints AI , 2013, AIIDE.

[9]  Julian Togelius,et al.  Sentient Sketchbook: Computer-aided game level authoring , 2013, FDG.

[10]  Pedro Lucas,et al.  Stay Awhile and Listen to 3Buddy, a Co-creative Level Design Support Tool , 2017, ICCC.

[11]  Graham W. Taylor,et al.  Adaptive deconvolutional networks for mid and high level feature learning , 2011, 2011 International Conference on Computer Vision.

[12]  Kenneth D. Forbus,et al.  Sketching for knowledge capture: a progress report , 2002, IUI '02.

[13]  Ellen Yi-Luen Do,et al.  Demonstrating the electronic cocktail napkin: a paper-like interface for early design , 1996, CHI Conference Companion.

[14]  Douglas Eck,et al.  A Neural Representation of Sketch Drawings , 2017, ICLR.

[15]  Adam Tauman Kalai,et al.  OMG UR Funny! Computer-Aided Humor with an Application to Chat , 2015, ICCC.

[16]  Steven M. Smith,et al.  Metrics for measuring ideation effectiveness , 2003 .

[17]  Jeffrey V. Nickerson,et al.  A fix for fixation? Rerepresenting and abstracting as creative processes in the design of information systems , 2010, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[18]  Jonathan Cagan,et al.  A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty , 2010 .

[19]  Lei Xu,et al.  Sketch-pix2seq: a Model to Generate Sketches of Multiple Categories , 2017, ArXiv.

[20]  Lina Lee,et al.  Relating Cognitive Models of Design Creativity to the Similarity of Sketches Generated by an AI Partner , 2019, Creativity & Cognition.

[21]  Guy Hoffman,et al.  Gesture-based human-robot Jazz improvisation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[22]  John S. Gero,et al.  Design and other types of fixation , 1996 .

[23]  Pegah Karimi,et al.  Creative Sketching Apprentice: Supporting Conceptual Shifts in Sketch Ideation , 2018, Design Computing and Cognition '18.

[24]  Brian Magerko,et al.  Co-Creative Drawing Agent with Object Recognition , 2016, AIIDE.

[25]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[26]  Maria C. Yang,et al.  A Step Beyond to Overcome Design Fixation: A Design-by-Analogy Approach , 2015 .