Bodies-in-space : investigating technology usage in co-present group interaction

With mobile phones in people's pockets, digital devices in people's homes, and information systems in group meetings at work, technology is frequently present when people interact with each other. Unlike technology used by a single person at a desk, people, rather than technology usage, are the main focus in social settings. An important difference then between these two scenarios, individual and group, is the role of the body. Although non-verbal behaviour is not part of human-computer interaction, it is very much part of human-human interaction. This dissertation explores bodies-in-space-people's use of spatial and postural positioning of their bodies to maintain a social interaction when technology is supporting the social interaction of a co-present group. I begin this dissertation with a review of literature, looking at how and when bodies-in-space have been accounted for in research and design processes of technology for co-present groups. I include both literature from human-computer interaction as well the social sciences more generally. Building on this base, the following four chapters provide examples and discussion of methods to: (1) see (analytically), (2) notate, (3) adjust (choreograph), and (4) research in the laboratory, bodies-in-space. I conclude with reflections on the value of capturing bodies-in-space in the process of designing technology for co-present groups and emphasise a trend towards end-user involvement and its consequences for the scope of human-computer interaction research. All of the research in this dissertation derives from, and relates to, the real-world context of an intensive care unit of a hospital and was part of assessing the deployment of an electronic patient record.

[1]  Gregory D. Abowd,et al.  From the war room to the living room: decision support for home-based therapy teams , 2006, CSCW '06.

[2]  Alan F. Blackwell,et al.  Co-located group interaction design , 2008, CHI Extended Abstracts.

[3]  John Bowers,et al.  Assembling the senses: towards the design of cooperative interfaces for visually impaired users , 2004, CSCW.

[4]  D. Norman The psychology of everyday things", Basic Books Inc , 1988 .

[5]  Ina Wagner,et al.  Reconfiguring critical computing in an era of configurability , 2005, Critical Computing.

[6]  Andreas Paepcke,et al.  Cooperative gestures: multi-user gestural interactions for co-located groupware , 2006, CHI.

[7]  Toni Robertson,et al.  Cooperative Work and Lived Cognition: A Taxonomy of Embodied Actions , 1997, ECSCW.

[8]  Gunnar Stevens,et al.  Breaking It Up: An Industrial Case Study of Component-Based Tailorable Software Design , 2006, End User Development.

[9]  Yvonne Rogers,et al.  The introduction of a shared interactive surface into a communal space , 2004, CSCW.

[10]  Meredith Ringel Morris,et al.  Release, relocate, reorient, resize: fluid techniques for document sharing on multi-user interactive tables , 2004, CHI EA '04.

[11]  Trent Apted,et al.  Tabletop sharing of digital photographs for the elderly , 2006, CHI.

[12]  A. Kendon Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[13]  Matthew Chalmers,et al.  Production of pace as collaborative activity , 2004, CHI EA '04.

[14]  David England,et al.  Whole body interaction , 2009, Human-Computer Interaction Series.

[15]  Ronald J. Pelias Performative Inquiry: Embodiment and Its Challenges , 2008 .

[16]  Jacki O'Neill,et al.  Timing in the art of integration: 'that's how the bastille got stormed' , 2005, GROUP.

[17]  Elliot W. Eisner,et al.  ART AND KNOWLEDGE , 2007 .

[18]  Charlotte P. Lee,et al.  Between Chaos and Routine: Boundary Negotiating Artifacts in Collaboration , 2005, ECSCW.

[19]  Loucas T. Louca The syntax or the story behind it?: a usability study of student work with computer-based programming environments in elementary science , 2005, CHI.

[20]  Gunnar Ellingsen,et al.  From plans to planning: the case of nursing plans , 2007, GROUP.

[21]  Andrew Loxley,et al.  Introducing Visual Methods , 2008 .

[22]  Jon Hindmarsh,et al.  Engaging constable: revealing art with new technology , 2007, CHI.

[23]  Thomas G Rundall,et al.  Kaiser Permanente's experience of implementing an electronic medical record: a qualitative study , 2005, BMJ : British Medical Journal.

[24]  Giulio Jacucci,et al.  Supporting Collaboration Ubiquitously: An Augmented Learning Environment for Architecture Students , 2003, ECSCW.

[25]  Alan F. Blackwell Cognitive Dimensions of Notations: Understanding the Ergonomics of Diagram Use , 2008, Diagrams.

[26]  Regan L. Mandryk,et al.  Physiological indicators for the evaluation of co-located collaborative play , 2004, CSCW.

[27]  C. Heath,et al.  Body movement and speech in medical interaction: Postscript: the use of medical records and computers during the consultation , 1986 .

[28]  Lisa Kleinman,et al.  Physically present, mentally absent: technology use in face-to-face meetings , 2007, CHI Extended Abstracts.

[29]  Tim Coughlan,et al.  Interaction in creative tasks: ideation, representation and evaluation in composition , 2006 .

[30]  Yvonne Rogers,et al.  Finger talk: collaborative decision-making using talk and fingertip interaction around a tabletop display , 2004, CHI EA '04.

[31]  Meredith Ringel Morris,et al.  Beyond "social protocols": multi-user coordination policies for co-located groupware , 2004, CSCW.

[32]  Andrew F. Monk,et al.  Social enjoyment with electronic photo displays : Awareness and control , 2008 .

[33]  M. Sheelagh T. Carpendale,et al.  Collaborative coupling over tabletop displays , 2006, CHI.

[34]  Heather Strachan Nursing Information: The Electronic Patient Record , 2003 .

[35]  Jenny Edwards,et al.  Understanding movement for interaction design: frameworks and approaches , 2007, Personal and Ubiquitous Computing.

[36]  Fiona Jane Candy “Come on momma, let’s see the drummer”: movement-based interaction and the performance of personal style , 2006, Personal and Ubiquitous Computing.

[37]  Geraldine Fitzpatrick,et al.  UbiComp in opportunity spaces: challenges for participatory design , 2006, PDC '06.

[38]  C. Geertz The interpretation of cultures: Selected essays , 1975 .

[39]  Caroline Knowles,et al.  Picturing the social landscape: visual methods and the sociological imagination , 2004 .

[40]  Tom Rodden,et al.  Collaborating around collections: informing the continued development of photoware , 2004, CSCW.

[41]  Carl Gutwin,et al.  Loose Coupling and Healthcare Organizations: Deployment Strategies for Groupware , 2006, Computer Supported Cooperative Work (CSCW).

[42]  Caroline Hummels,et al.  Move to get moved: a search for methods, tools and knowledge to design for expressive and rich movement-based interaction , 2007, Personal and Ubiquitous Computing.

[43]  Eva Brandt,et al.  Designing exploratory design games: a framework for participation in Participatory Design? , 2006, PDC '06.

[44]  Dan Morris,et al.  Individual audio channels with single display groupware: effects on communication and task strategy , 2004, CSCW.

[45]  Dag Svanæs,et al.  Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems , 2004, CHI.

[46]  Ravin Balakrishnan,et al.  An Evaluation of Techniques for Reducing Spatial Interference in Single Display Groupware , 2005, ECSCW.

[47]  David B. Martin,et al.  Working the contract , 2007, OZCHI '07.

[48]  Marcus Sanchez Svensson,et al.  Instrumental action: the timely exchange of implements during surgical operations , 2007, ECSCW.

[49]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[50]  Gunnar Ellingsen,et al.  Seamless Integration: Standardisation across Multiple Local Settings , 2006, Computer Supported Cooperative Work (CSCW).

[51]  M. Sheets‐Johnstone The Primacy of Movement , 1999 .

[52]  Walter Bender,et al.  Influencing group participation with a shared display , 2004, CSCW.

[53]  Jonathan Histon,et al.  Avoiding interference: how people use spatial separation and partitioning in SDG workspaces , 2004, CSCW.

[54]  Anne Marie Piper,et al.  SIDES: A Cooperative Tabletop Computer Game for Social Skills Development , 2022 .

[55]  Rob Procter,et al.  Supporting informality: team working and integrated care records , 2004, CSCW.

[56]  Stephanie M. Wilson,et al.  Not all sharing is equal: the impact of a large display on small group collaborative work , 2006, CSCW '06.

[57]  Tony P. Pridmore,et al.  Expected, sensed, and desired: A framework for designing sensing-based interaction , 2005, TCHI.

[58]  Louise Barkhuus,et al.  From Mice to Men - 24 Years of Evaluation in CHI , 2007, CHI 2007.

[59]  Masanori Sugimoto,et al.  Caretta: a system for supporting face-to-face collaboration by integrating personal and shared spaces , 2004, CHI.

[60]  H. Garfinkel Studies in Ethnomethodology , 1968 .

[61]  Takeshi Naemura,et al.  Lumisight table: a face-to-face collaboration support system that optimizes direction of projected information to each stakeholder , 2004, CSCW.

[62]  M. Sheelagh T. Carpendale,et al.  Supporting Nurses' Information Flow by Integrating Paper and Digital Charting , 2009, ECSCW.

[63]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[64]  Steve Krug,et al.  Don't Make Me Think!: A Common Sense Approach to Web Usability , 2000 .

[65]  C. Macrae,et al.  A case of hand waving: Action synchrony and person perception , 2008, Cognition.

[66]  Mikael B. Skov,et al.  Supporting information access in a hospital ward by a context-aware mobile electronic patient record , 2006, Personal and Ubiquitous Computing.

[67]  Allison Druin,et al.  Single display groupware: a model for co-present collaboration , 1999, CHI '99.

[68]  Gerhard Fischer,et al.  Beyond "couch potatoes": from consumers to designers , 1998, Proceedings. 3rd Asia Pacific Computer Human Interaction (Cat. No.98EX110).

[69]  A. Busby,et al.  The role of the nurse in the medical ward round. , 1992, Journal of advanced nursing.

[70]  Regan L. Mandryk,et al.  System Guidelines for Co-located, Collaborative Work on a Tabletop Display , 2003, ECSCW.

[71]  Carla Simone,et al.  When once is not enough: the role of redundancy in a hospital ward setting , 2005, GROUP.

[72]  Andrew F. Monk,et al.  Designing appropriate affordances for electronic photo sharing media , 2006, CHI Extended Abstracts.

[73]  Andreas Paepcke,et al.  TeamTag: exploring centralized versus replicated controls for co-located tabletop groupware , 2006, CHI.

[74]  Eva Hornecker,et al.  A Design Theme for Tangible Interaction: Embodied Facilitation , 2005, ECSCW.

[75]  Pernille Bjørn,et al.  Health Care Categories have Politics too: Unpacking the Managerial Agendas of Electronic Triage Systems , 2007, ECSCW.

[76]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[77]  Alan F. Blackwell,et al.  The reification of metaphor as a design tool , 2006, TCHI.

[78]  Geraldine Fitzpatrick,et al.  Understanding the Paper Health Record in Practice: Implications for EHRs , 2000 .

[79]  Marcello Bastéa-Forte,et al.  Encouraging contribution to shared sketches in brainstorming meetings , 2007, CHI Extended Abstracts.

[80]  Alonso H. Vera,et al.  Collaborative knowledge management supporting mars mission scientists , 2004, CSCW.

[81]  Stefan Agamanolis,et al.  Sports over a distance , 2005, CIE.

[82]  Tatsuo Nakajima,et al.  Towards computer-supported face-to-face knowledge sharing , 2006, CHI EA '06.

[83]  Atsunobu Narita,et al.  Collaborative simulation interface for planning disaster measures , 2006, CHI EA '06.

[84]  Paul Atkinson,et al.  The clinical experience: The construction and reconstruction of medical reality , 1997 .

[85]  N. Presmeg The body in the mind: The bodily basis of meaning, imagination and reason , 1992 .

[86]  Giulio Jacucci,et al.  A manifesto for the performative development of ubiquitous media , 2005, Critical Computing.

[87]  M. Angrosino,et al.  Doing Ethnographic and Observational Research , 2007 .

[88]  John F. Canny,et al.  More than face-to-face: empathy effects of video framing , 2009, CHI.

[89]  Cecily Morrison,et al.  Electronic patient record use during ward rounds: a qualitative study of interaction between medical staff , 2008, Critical care.

[90]  J. Knowles,et al.  Handbook of the Arts in Qualitative Research: Perspectives, Methodologies, Examples, and Issues , 2008 .

[91]  Brian P. Bailey,et al.  Getting inspired!: understanding how and why examples are used in creative design practice , 2009, CHI.

[92]  Karen Hill,et al.  The sound of silence--nurses' non-verbal interaction within the ward round. , 2003, Nursing in critical care.

[93]  Saturnino Luz,et al.  Multidisciplinary Medical Team Meetings: An Analysis of Collaborative Working with Special Attention to Timing and Teleconferencing , 2006, Computer Supported Cooperative Work (CSCW).

[94]  Nick Bryan-Kinns,et al.  Inter-Play : Understanding Group Music Improvisation as a Form of Everyday Interaction , 2005 .

[95]  M. Carpendale,et al.  Evaluating the deployment of a mobile technology in a hospital ward , 2008, CSCW.

[96]  David Gerrett,et al.  A survey of validity and utility of electronic patient records in a general practice , 2001, BMJ : British Medical Journal.

[97]  Bonnie Blossom,et al.  Nonverbal Communication: Readings with Commentary , 1975 .

[98]  Tim Mansfield,et al.  Moving bodies, social selves: movement-oriented personas and scenarios , 2005, OZCHI.

[99]  Michael Twidale,et al.  Supporting multidisciplinary collaboration: requirements from novel HCI education , 2007, CHI.

[100]  H. Lærum,et al.  Doctors' use of electronic medical records systems in hospitals: cross sectional survey , 2001, BMJ : British Medical Journal.

[101]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[102]  Dan Cosley,et al.  A tag in the hand: supporting semantic, social, and spatial navigation in museums , 2009, CHI.

[103]  Blackford Middleton,et al.  The Value of Electronic Health Records , 2005 .

[104]  Paul Dourish,et al.  Where the action is , 2001 .

[105]  Christine Reid,et al.  The Myth of the Paperless Office , 2003, J. Documentation.

[106]  E. Manias,et al.  Nurse-doctor interactions during critical care ward rounds. , 2001, Journal of clinical nursing.

[107]  William Newman,et al.  Disruption of meetings by laptop use: is there a 10-second solution? , 2006, CHI EA '06.

[108]  M. Sheelagh T. Carpendale,et al.  Territoriality in collaborative tabletop workspaces , 2004, CSCW.

[109]  Tom Rodden,et al.  Ethnography considered harmful , 2009, CHI.

[110]  Steve Benford,et al.  Physical manipulation: evaluating the potential for tangible designs , 2009, TEI.

[111]  Christian Heath,et al.  Collaboration and controlCrisis management and multimedia technology in London Underground Line Control Rooms , 1992, Computer Supported Cooperative Work (CSCW).

[112]  Yvonne Rogers,et al.  Collaborating around vertical and horizontal large interactive displays: which way is best? , 2004, Interact. Comput..

[113]  J. Hindmarsh,et al.  Knowing Bodies at Work: Embodiment and Ephemeral Teamwork in Anaesthesia , 2007 .

[114]  Andrew F. Monk,et al.  Social enjoyment with electronic photograph displays: Awareness and control , 2008, Int. J. Hum. Comput. Stud..

[115]  Hiroshi Ishii,et al.  Kinetic sketchup: motion prototyping in the tangible design process , 2009, Tangible and Embedded Interaction.

[116]  Lora Aroyo,et al.  PillowTalk: can we afford intimacy? , 2007, Tangible and Embedded Interaction.

[117]  Carla Simone,et al.  PRODOC: an Electronic Patient Record to Foster Process-Oriented Practices , 2009, ECSCW.

[118]  Peter Johnson,et al.  Interaction in creative tasks , 2006, CHI.

[119]  Tovi Grossman,et al.  An exploratory study of input configuration and group process in a negotiation task using a large display , 2007, CHI.

[120]  M. Sheelagh T. Carpendale,et al.  An observational study on information flow during nurses' shift change , 2007, CHI.

[121]  Duncan Rowland,et al.  Life on the edge: supporting collaboration in location-based experiences , 2005, CHI.

[122]  J. Prosser Visual methods and the visual culture of schools , 2007 .

[123]  Timothy Koschmann,et al.  Reconsidering Common Ground: Examining Clark's Contribution Theory in the OR , 2003, ECSCW.

[124]  David Gauntlett Creative Explorations: New Approaches to Identities and Audiences , 2007 .

[125]  C. Goodwin,et al.  Seeing as a Situated Activity: Formulating Planes* , 1996 .

[126]  Pernille Bjørn,et al.  Steps toward a typology for health informatics , 2008, CSCW.

[127]  G P Nolan,et al.  Resistance is futile: assimilation of cellular machinery by HIV-1. , 2001, Immunity.

[128]  Rick Iedema,et al.  Reshaping ICU Ward Round Practices Using Video-Reflexive Ethnography , 2008, Qualitative health research.

[129]  J. Knottnerus,et al.  Real world research. , 2010, Journal of clinical epidemiology.

[130]  Gerrit C. van der Veer,et al.  Towards a Multimodal Interaction Space: categorisation and applications , 2007, Personal and Ubiquitous Computing.

[131]  R. Mackay Garfinkel and Ethnomethodology , 1987 .

[132]  D. Norman The psychology of everyday things , 1990 .

[133]  Edward Slingerland,et al.  What Science Offers the Humanities , 2008 .

[134]  Enrico W. Coiera,et al.  Interruptive communication patterns in the intensive care unit ward round , 2005, Int. J. Medical Informatics.

[135]  Madhu C. Reddy,et al.  Coordinating heterogeneous work: Information and representation in medical care , 2001, ECSCW.

[136]  Matthew Kam,et al.  Livenotes: a system for cooperative and augmented note-taking in lectures , 2005, CHI.

[137]  Chris Schmandt,et al.  Giving the caller the finger: collaborative responsibility for cellphone interruptions , 2005, CHI EA '05.

[138]  E. Goffman Frame analysis: An essay on the organization of experience , 1974 .

[139]  Ann Morrison,et al.  Like bees around the hive: a comparative study of a mobile augmented reality map , 2009, CHI.

[140]  Eli Blevis,et al.  Concepts that support collocated collaborative work inspired by the specific context of industrial designers , 2004, CSCW.

[141]  J. Brannen Mixing Methods: The Entry of Qualitative and Quantitative Approaches into the Research Process , 2005 .

[142]  Meredith Ringel Morris,et al.  Exploring the effects of group size and table size on interactions with tabletop shared-display groupware , 2004, CSCW.

[143]  Gunnar Ellingsen,et al.  Formalizing work: reallocating redundancy , 2006, CSCW '06.

[144]  E. Goffman The Presentation of Self in Everyday Life , 1959 .

[145]  Donald S. Blumenfeld-Jones Dance, Choreography, and Social Science Research , 2008 .

[146]  Hiroshi Ishii,et al.  BodyBeats: whole-body, musical interfaces for children , 2006, CHI Extended Abstracts.

[147]  Alan F. Blackwell,et al.  Tangible interface for collaborative information retrieval , 2004, CHI EA '04.