In situ informants exploring an emotional mobile messaging system in their everyday practice

We have designed and built a mobile emotional messaging system named eMoto. With it, users can compose messages through using emotion-signalling gestures as input, rendering a message background of colours, shapes and animations expressing the emotional content. The design intent behind eMoto was that it should be engaging physically, intellectually and socially, and allow users to express themselves emotionally in all those dimensions, involving them in an affective loop experience. In here, we describe the user-centred design process that lead to the eMoto system, but focus mainly on the final study where we let five friends use eMoto for two weeks. The study method, which we name in situ informants, helped us enter and explore the subjective and distributed experiences of use, as well as how emotional communication unfolds in everyday practice when channelled through a system like eMoto. The in situ informants are on the one hand users of eMoto, but also spectators, that are close friends who observe and document user behaviour. Design conclusions include the need to support the sometimes fragile communication rhythm that friendships require-expressing memories of the past, sharing the present and planning for the future. We saw that emotions are not singular state that exist within one person alone, but permeates the total situation, changing and drifting as a process between the two friends communicating. We also gained insights into the under-estimated but still important physical, sensual aspects of emotional communication. Experiences of the in situ informants method pointed to the need to involve participants in the interpretation of the data obtained, as well as establishing a closer connection with the spectators.

[1]  Tuuli Mattelmäki,et al.  Mobile probes , 2004, NordiCHI '04.

[2]  A. Damasio Descartes' error: emotion, reason, and the human brain. avon books , 1994 .

[3]  Peter Paolucci,et al.  Designing Information Spaces: The Social Navigation Approach , 2003, J. Educ. Technol. Soc..

[4]  William W. Gaver,et al.  Design: Cultural probes , 1999, INTR.

[5]  Minna Isomursu,et al.  Experience clip: method for user participation and evaluation of mobile concepts , 2004, PDC 04.

[6]  Henry Lieberman,et al.  Visualizing the affective structure of a text document , 2003, CHI Extended Abstracts.

[7]  A. Damasio Descartes’ Error. Emotion, Reason and the Human Brain. New York (Grosset/Putnam) 1994. , 1994 .

[8]  A. F. Rovers,et al.  HIM: a framework for haptic instant messaging , 2004, CHI EA '04.

[9]  Kristina Höök,et al.  The enigmatics of affect , 2002, DIS '02.

[10]  J. Russell A circumplex model of affect. , 1980 .

[11]  Kirsten Boehner,et al.  Evaluating Affector: Co-Interpreting What “Works” , 2005 .

[12]  Allison Druin,et al.  Technology probes: inspiring design for and with families , 2003, CHI '03.

[13]  Jane Fulton Suri,et al.  Experience prototyping , 2000, DIS '00.

[14]  Kristina Höök,et al.  eMoto: affectively involving both body and mind , 2005, CHI Extended Abstracts.

[15]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[16]  Phoebe Sengers,et al.  Reflective design , 2005, Critical Computing.

[17]  Per Persson,et al.  Exms: an animated and avatar-based messaging system for expressive peer communication , 2003, GROUP.

[18]  B. Gaver,et al.  Provocative Awareness , 2002, Computer Supported Cooperative Work (CSCW).

[19]  Dana Chisnell,et al.  Handbook of Usability Testing , 2009 .

[20]  Allison Woodruff,et al.  Making space for stories: ambiguity in the design of personal communication systems , 2005, CHI.

[21]  Richard J. Davidson,et al.  Parsing the subcomponents of emotion and disorders of emotion: Perspectives from affective neuroscience. , 2003 .

[22]  Petra Sundström,et al.  Exploring the Affective Loop , 2005 .

[23]  Paul Dourish,et al.  Where the action is , 2001 .

[24]  Kristina Höök,et al.  A foundation for emotional expressivity , 2005, DUX '05.

[25]  Kristina Höök,et al.  Designing Information Spaces: The Social Navigation Approach , 2003, Computer Supported Cooperative Work.

[26]  Chris Dodge The bed: a medium for intimate communication , 1997, CHI Extended Abstracts.

[27]  Kirsten Boehner,et al.  Critical Technical Practice as a Methodology for Values in Design , 2004 .

[28]  G. Fricchione Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[29]  Konrad Tollmar,et al.  Virtually living together , 2000, DIS '00.

[30]  R.I.A. Mercuri,et al.  Technology as Experience , 2005, IEEE Transactions on Professional Communication.

[31]  Catherine Pelachaud,et al.  From brows to trust: evaluating embodied conversational agents , 2004 .

[32]  Konrad Tollmar,et al.  Virtually Living Together: A Design Framework for New Communication Media. , 2000 .

[33]  N. Thrift International Encyclopaedia of the Social and Behavioural Sciences , 2002 .

[34]  Jack Katz How Emotions Work , 1999 .

[35]  Kristina Höök,et al.  Designing Gestures for Affective Input: An Analysis of Shape, Effort and Valence , 2003 .

[36]  Joseph Kaye,et al.  Communicating intimacy one bit at a time , 2005, CHI Extended Abstracts.

[37]  Alan Cooper,et al.  The Inmates are Running the Asylum , 1999, Software-Ergonomie.

[38]  Jin Moen KinAesthetic Movement Interaction : Designing for the Pleasure of Motion , 2006 .

[39]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[40]  Pieter Jan Stappers,et al.  Gustbowl: technology supporting affective communication through routine ritual interactions , 2004, CHI EA '04.

[41]  Johannes Itten,et al.  Kunst der Farbe , 1983 .

[42]  Anna Ståhl,et al.  Designing for Emotional Expressivity , 2005 .

[43]  William W. Gaver,et al.  Feather, Scent, and Shaker: Supporting Simple Intimacy , 1996 .

[44]  Kristina Höök,et al.  Designing familiar open surfaces , 2006, NordiCHI '06.

[45]  Scott E. Hudson,et al.  The kinedit system: affective messages using dynamic texts , 2003, CHI '03.

[46]  Giulio Jacucci,et al.  Everyday Life as a Stage in Creating and Performing Scenarios for Wireless Devices , 2002, Personal and Ubiquitous Computing.

[47]  Paul Dourish,et al.  Affect: from information to interaction , 2005, Critical Computing.

[48]  Martin R. Gibbs,et al.  Mediating intimacy: designing technologies to support strong-tie relationships , 2005, CHI.

[49]  Kristina Höök,et al.  User-Centred Design and Evaluation of Affective Interfaces , 2004, From Brows to Trust.