Creative Sense-Making: Quantifying Interaction Dynamics in Co-Creation

This paper describes a new technique for quantifying interaction dynamics during open-ended co-creation, such as collaborative drawing or playing pretend. We present a cognitive framework called creative sense-making. This framework synthesizes existing cognitive science theories and empirical investigations into open-ended improvisation to develop a method of quantifying cognitive states and types of interactions through time. We apply this framework to empirical studies of human collaboration (in the domain of pretend play) and AI-based systems (in the domain of collaborative drawing) to establish its validity through cross-domain application and inter-rater reliability within each domain. The creative sense-making framework described includes a qualitative coding technique, interaction coding software, and the cognitive theory behind their application.

[1]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[2]  Sune Steffensen,et al.  Temporal Dynamics in Human Interaction , 2014, Cybern. Hum. Knowing.

[3]  M. Auvray,et al.  Perceptual interactions in a minimalist virtual environment , 2009 .

[4]  Catholijn M. Jonker,et al.  Shared Mental Models - A Conceptual Analysis , 2010, COIN@AAMAS&MALLOW.

[5]  Douglas H. Fisher,et al.  USING AI TO EVALUATE CREATIVE DESIGNS , 2012 .

[6]  Sune Vork Steffensen,et al.  Care and conversing in dialogical systems , 2012 .

[7]  Brian Magerko,et al.  Empirically Studying Participatory Sense-Making in Abstract Drawing with a Co-Creative Cognitive Agent , 2016, IUI.

[8]  Celine Latulipe,et al.  Creativity factor evaluation: towards a standardized survey metric for creativity support , 2009, C&C '09.

[9]  Morten Fjeld,et al.  RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions , 2016, CHI.

[10]  Brian Magerko,et al.  An Enactive Characterization of Pretend Play , 2015, Creativity & Cognition.

[11]  Andruid Kerne,et al.  An Experimental Method for Measuring the Emergence of New Ideas in Information Discovery , 2008, Int. J. Hum. Comput. Interact..

[12]  A. Glenberg.  What memory is for: Creating meaning in the service of action , 1997, Behavioral and Brain Sciences.

[13]  M. Rohde,et al.  Sensitivity to social contingency or stability of interaction? Modelling the dynamics of perceptual crossing , 2008 .

[14]  Murray Turoff,et al.  The Delphi Method: Techniques and Applications , 1976 .

[15]  S. Nasuto,et al.  Emotion and Anticipation in an Enactive Framework for Cognition (Response to Andy Clark) , 2012, Front. Psychology.

[16]  Mary Lou Maher,et al.  IMPACT OF COLLABORATIVE VIRTUAL ENVIRONMENTS ON DESIGN BEHAVIOUR , 2006 .

[17]  Karl J. Friston.  The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[18]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[19]  Jérôme Bourbousson,et al.  How do Co-agents Actively Regulate their Collective Behavior States? , 2016, Front. Psychol..

[20]  Raymond J. Dolan,et al.  Exploration, novelty, surprise, and free energy minimization , 2013, Front. Psychol..

[21]  Karl J. Friston.  The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[22]  D. Vernon.  Artificial Cognitive Systems: A Primer , 2014 .

[23]  E. Salas,et al.  Shared mental models in expert team decision making. , 1993 .

[24]  J. Fleiss.  Measuring nominal scale agreement among many raters. , 1971 .

[25]  Susan R. Fussell,et al.  Effects of implicit sharing in collaborative analysis , 2014, CHI.

[26]  Hanne De Jaegher,et al.  We can work it out: an enactive look at cooperation , 2014, Front. Psychol..

[27]  David Vernon,et al.  Enaction as a conceptual framework for developmental cognitive robotics , 2010, Paladyn J. Behav. Robotics.

[28]  E. D. Paolo,et al.  Participatory sense-making , 2007 .

[29]  Tom Froese,et al.  Embodied social interaction constitutes social cognition in pairs of humans: A minimalist virtual reality experiment , 2014, Scientific Reports.

[30]  E. D. Paolo,et al.  Can social interaction constitute social cognition? , 2010, Trends in Cognitive Sciences.

[31]  Maria Adler,et al.  Enaction Toward A New Paradigm For Cognitive Science , 2016 .

[32]  Stefan Benus,et al.  Variability and stability in collaborative dialogues: turn-taking and filled pauses , 2009, INTERSPEECH.

[33]  John S. Gero,et al.  Fixation and Commitment While Designing and its Measurement , 2011 .

[34]  Celine Latulipe,et al.  Triangulating the personal creative experience: self-report, external judgments, and physiology , 2012, Graphics Interface.

[35]  R. Sawyer,et al.  Distributed creativity: How collective creations emerge from collaboration. , 2009, Psychology of Aesthetics, Creativity, and the Arts.