Beyond distributed representation: embodied cognition design supporting socio-sensorimotor couplings

Embodied Cognition has been proposed as a relevant theory for tangible and embedded interaction [14]. Based on two 2-year lasting Research-through-Design cases we identify three variations of the theory: 1) Distributed Representation and Computation, 2) Socially Situated Practices and 3) Sensorimotor Coupling & Enactment. Both social situatedness and sensorimotor coupling proved relevant for design and for understanding user behavior in context. We show how the 'social' and the 'sensorimotor' are part of one integrated sensemaking process we call 'socio-sensorimotor coupling'. We argue that the, intuitively appealing, idea of using tangibles for external representation actually hinders designing for sensemaking as socio-sensorimotor coupling. We present a vision of Embodied Cognition Design, which goes beyond a representational interpretation, aiming to intervene more directly into the socio-sensorimotor loop.

[1]  Eva Hornecker,et al.  Let's jam the reactable , 2013, ACM Trans. Comput. Hum. Interact..

[2]  Elise van den Hoven,et al.  Embodied metaphors in tangible interaction design , 2011, Personal and Ubiquitous Computing.

[3]  G. Miller,et al.  The Cognitive Sciences , 1984 .

[4]  R. van der Lugt.  Scaffolds for shared understanding , 2013 .

[5]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[6]  Jelle van Dijk,et al.  NOOT: a tool for sharing moments of reflection during creative meetings , 2011, C&C '11.

[7]  J. Gibson.  The Ecological Approach to Visual Perception , 1979 .

[8]  C. Goodwin.  Action and embodiment within situated human interaction , 2000 .

[9]  Toni Robertson,et al.  Cooperative Work and Lived Cognition: A Taxonomy of Embodied Actions , 1997, ECSCW.

[10]  Monika Richter,et al.  Cognition In The Wild , 2016 .

[11]  V. Dijk.  Creating traces, sharing insight : explorations in embodied cognition design , 2013 .

[12]  A. Chemero.  Radical Embodied Cognitive Science , 2009 .

[13]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[14]  Ian Horswill,et al.  Lifeworld Analysis , 1997, J. Artif. Intell. Res..

[15]  Jakob Tholander,et al.  Towards a new set of ideals: consequences of the practice turn in tangible interaction , 2008, TEI.

[16]  Joep Frens,et al.  Designing for the unknown : a design process for the future generation of highly interactive systems and products , 2008 .

[17]  Paul Dourish,et al.  Where the action is , 2001 .

[18]  Victor Kaptelinin,et al.  Acting with technology: Activity theory and interaction design , 2006, First Monday.

[19]  R. Beer.  The Cambridge Handbook of Artificial Intelligence: Dynamical systems and embedded cognition , 2014 .

[20]  A. Clark.  Being There: Putting Brain, Body, and World Together Again , 1996 .

[21]  Lucy Suchman,et al.  Human-Machine Reconfigurations: Plans and Situated Actions , 2006 .

[22]  Hiroshi Ishii,et al.  Tangible bits: beyond pixels , 2008, TEI.

[23]  André Rocque,et al.  Sein und Zeit . Von Martin Heidegger. 14. Auflage mit den Randbemerkungen. Tübingen: Max Niemeyer Verlag. 1977. 437 S. 28, – DM. , 1980, Dialogue.

[24]  Hanne De Jaegher.  Social understanding through direct perception? Yes, by interacting. , 2009, Consciousness and cognition.

[25]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[26]  Jelle van Dijk,et al.  Traces in creative spaces , 2011, C&C '11.

[27]  R. Mizen.  The embodied mind. , 2009, The Journal of analytical psychology.

[28]  W. Ramsey,et al.  The Cambridge Handbook of Artificial Intelligence , 2014 .

[29]  Maurice Merleau-Ponty.  Phenomenology of Perception , 1964 .

[30]  R. Ruiz,et al.  Sein und zeit , 2007 .

[31]  David Kirsh,et al.  Thinking with external representations , 2010, AI & SOCIETY.

[32]  Caroline Hummels,et al.  Tracing shared insight , 2013 .

[33]  Joep W. Frens,et al.  Tangible products: redressing the balance between appearance and action , 2004, Personal and Ubiquitous Computing.

[34]  James L. McClelland,et al.  Phenomenology of perception. , 1978, Science.

[35]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[36]  H. Dreyfus.  Intelligence without representation – Merleau-Ponty's critique of mental representation The relevance of phenomenology to scientific explanation , 2002 .

[37]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[38]  Stephan Wensveen,et al.  Embodying complexity through movement sonification: case study on empowering the speed-skater , 2011, CHItaly.