Really, really small: the palpability of the invisible

Our physical technology continues to grow smaller and smaller; so small that the computer itself is no longer seen as an object but a set of invisible distributed processes. Technology is becoming an inseparable aspect of experience, palpable yet invisible. At the same time, an extra-ordinary wealth of literature is emerging within human-computer interaction that is exploring experience, embodiment, subjectivity, and felt-life. This interest is often accompanied by research questions that are continuing to re-balance our understanding of the relationship between subjective and objective knowing, making, and doing. These emerging trends can be seen as a response to the phenomena of the really, really small: and marks a cognitive and creative shift from the visible to the invisible. This paper contextualizes the emerging recognition within HCI that there is value in designing for technology as experience, and offers a framework from the field of Somatics that can contribute to the discourse, particularly with regard to the body in everyday life. Somatics is exemplified through first-person methodologies and embodied approaches to learning and interacting. I present a set of design cases that demonstrate its application within HCI.

[1]  Kristina Andersen,et al.  Playing Games in the Emotional Space , 2005, Funology.

[2]  Daniel Salber,et al.  Position paper for the CHI 2001 workshop on "Building the Ubiquitous Computing User Experience" , 2001 .

[3]  Adam Blood,et al.  Visible and invisible , 2002 .

[4]  William James,et al.  Essays in Radical Empiricism , 1907 .

[5]  Mark L. Johnson.  The body in the mind: the bodily basis of meaning , 1987 .

[6]  M. Csíkszentmihályi.  Flow: The Psychology of Optimal Experience , 1990 .

[7]  H. Putnam,et al.  Reason, Truth and History. , 1987 .

[8]  Tony Salvador,et al.  Focus troupe: using drama to create common context for new product concept end-user evaluations , 1998, CHI Conference Summary.

[9]  P. Adam.  Saltmarsh ecology: Coping with the environment , 1990 .

[10]  Thecla Schiphorst,et al.  Breath, skin and clothing: Using wearable technologies as an interface into ourselves , 2006 .

[11]  S. Nettleton,et al.  The body in everyday life , 2002 .

[12]  B. Nardi.  Activity theory and human-computer interaction , 1995 .

[13]  Steve Benford,et al.  Ambiguity as a resource for design , 2003, CHI '03.

[14]  Jin Kjölberg,et al.  Designing full body movement interaction using modern dance as a starting point , 2004, DIS '04.

[15]  Francisco J. Varela,et al.  On Becoming Aware: A pragmatics of experiencing , 2003 .

[16]  W. James.  Varieties of Religious Experience , 2008 .

[17]  Thomas P. Kasulis,et al.  The Body: Toward an Eastern Mind-Body Theory , 1987 .

[18]  Jin Moen,et al.  From hand-held to body-worn: embodied experiences of the design and use of a wearable movement-based interaction concept , 2007, TEI.

[19]  Rudolf von Laban,et al.  Effort; economy of human movement , 1974 .

[20]  Tony P. Pridmore,et al.  Expected, sensed, and desired: A framework for designing sensing-based interaction , 2005, TCHI.

[21]  Philip H. Mirvis.  Flow: The Psychology of Optimal Experience , 1991 .

[22]  Thecla Schiphorst,et al.  Tools for interaction with the creative process of composition , 1990, CHI '90.

[23]  S. Vereza.  Philosophy in the flesh: the embodied mind and its challenge to Western thought , 2001 .

[24]  Jodi Forlizzi,et al.  The building blocks of experience: an early framework for interaction designers , 2000, DIS '00.

[25]  Pr Higate.  The Body in Everyday Life , 1998 .

[26]  Peter C. Wright,et al.  The Enchantments of Technology , 2005, Funology.

[27]  Frances Starr,et al.  Changes: notes on choreography , 1968 .

[28]  Steven Kleinman.  Bone, Breath, and Gesture: Practices of Embodiment , 1997 .

[29]  Giulio Jacucci,et al.  The emerging roles of performance within HCI and interaction design , 2006, Interact. Comput..

[30]  B. Massumi.  Parables for the Virtual: Movement, Affect, Sensation , 2002 .

[31]  I. Bartenieff,et al.  Body Movement: Coping with the Environment , 1980 .

[32]  Maurice Merleau-Ponty.  Phenomenology of Perception , 1964 .

[33]  J. Gibson.  The Senses Considered As Perceptual Systems , 1967 .

[34]  Paul Dourish,et al.  Where the action is , 2001 .

[35]  R. Schechner,et al.  The Grotowski sourcebook , 1997 .

[36]  Gregory D. Abowd,et al.  Ubiquitous computing: the impact on future interaction paradigms and HCI research , 1997, CHI Extended Abstracts.

[37]  Mathias Alexander,et al.  Body Image , Movement and Consciousness : Examples from a Somatic Practice in the Feldenkrais Method By , 2005 .

[38]  Thecla Schiphorst,et al.  Between Bodies: using Experience Modeling to Create Gestural Protocols for Physiological Data Transfer , 2004 .

[39]  Bill Verplank,et al.  Actors, hairdos & videotape—informance design , 1994, CHI Conference Companion.

[40]  Richard Schechner,et al.  Between Theater and Anthropology , 1985 .

[41]  Thecla Schiphorst.  Bodymaps: artifacts of touch (the sensuality and anarchy of touch) , 1997, SIGGRAPH '97.

[42]  Susanne Bødker,et al.  Through the Interface: A Human Activity Approach To User Interface Design , 1990 .

[43]  Bill Moggridge.  Design: Expressing experiences in design , 1999, INTR.

[44]  A. Damasio.  The Feeling of What Happens: Body and Emotion in the Making of Consciousness , 1999 .

[45]  J. Gibson.  Observations on active touch. , 1962, Psychological review.

[46]  Jens Riegelsberger,et al.  Reinventing trust, collaboration and compliance in social systems , 2006, CHI Extended Abstracts.

[47]  Lora Aroyo,et al.  PillowTalk: can we afford intimacy? , 2007, Tangible and Embedded Interaction.

[48]  Mads Vedel Jensen,et al.  A physical approach to tangible interaction design , 2007, TEI.

[49]  Nima Motamedi.  Keep in touch: a tactile-vision intimate interface , 2007, Tangible and Embedded Interaction.

[50]  Peter C. Wright,et al.  Putting ‘felt-life’ at the centre of human–computer interaction (HCI) , 2005, Cognition, Technology & Work.

[51]  Yvonne Rogers,et al.  Designing for or designing with? Informant design for interactive learning environments , 1997, CHI.

[52]  Thecla Schiphorst.  Affectionate computing: can we fall in love with a machine? , 2006, IEEE Multimedia.

[53]  Kjeld Schmidt,et al.  The Problem with `Awareness': Introductory Remarks on `Awareness in CSCW' , 2002, Computer Supported Cooperative Work (CSCW).

[54]  Frank Stajano,et al.  Interfacing with the invisible computer , 2002, NordiCHI '02.

[55]  P. Bach-y-Rita.  Brain mechanisms in sensory substitution , 1972 .

[56]  Augusto Boal.  Games for Actors and Non-Actors , 2021 .

[57]  T. Metzinger,et al.  The emergence of a shared action ontology: Building blocks for a theory , 2003, Consciousness and Cognition.

[58]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .

[59]  Jörn Hurtienne,et al.  Image schemas and their metaphorical extensions: intuitive patterns for tangible interaction , 2007, TEI.

[60]  Jenny Edwards,et al.  The feel dimension of technology interaction: exploring tangibles through movement and touch , 2007, TEI.

[61]  Murray G. Murphey,et al.  Truth and history , 2008 .

[62]  B. Nardi.  Context and consciousness: activity theory and human-computer interaction , 1995 .

[63]  Jane Fulton Suri,et al.  Experience prototyping , 2000, DIS '00.

[64]  Lucy Suchman.  Plans and situated actions: the problem of human-machine communication , 1987 .

[65]  Kristian T. Simsarian,et al.  Take it to the next stage: the roles of role playing in the design process , 2003, CHI Extended Abstracts.

[66]  M. Polanyi.  Chapter 7 – The Tacit Dimension , 1997 .

[67]  J. Newlove,et al.  Laban for actors and dancers : putting Laban's movement theory into practice : a step-by-step guide , 1993 .