Showing Objects: Holding and Manipulating Artefacts in Video-mediated Collaborative Settings

In this paper we report on a pervasive practice in video-mediated communication: where participants show one another one or more objects. This is a distinct activity from others considered by researchers of video-mediated technologies that focus on a face-to-face orientation, or just on the support necessary to help people to refer to objects. We first present examples of this pervasive phenomenon in naturally occurring Skype conversations, revealing how this conduct is configured and organized within the interaction between participants. We reveal how the subtle adjustment of the position of the body, the head and gaze with respect to the handheld objects offers crucial resources for participants to achieve joint seeing. Then we report on a quite different setting, a naturalistic experiment where participants collaborate on a collective task with remote colleagues through maneuverable, orientable devices (Kubis). Again, in these experiments participants frequently show objects, and at times the devices provide additional resources to support these activities. But at other times they also involve some difficulties. We conclude by suggesting possible technological developments, some quite simple, others more radical, that might support participants to show objects, whether they are in domestic settings or undertaking work activities.

[1]  Hideaki Kuzuoka,et al.  Handling documents and discriminating objects in hybrid spaces , 2006, CHI.

[2]  Carman Neustaedter,et al.  Mechanics of Camera Work in Mobile Video Collaboration , 2015, CHI.

[3]  Christian Heath,et al.  Disembodied conduct: communication through video in a multi-media office environment , 1991, CHI.

[4]  Hiroshi Ishii,et al.  ClearBoard: a seamless medium for shared drawing and conversation with eye contact , 1992, CHI.

[5]  Steve Harrison,et al.  Family portals: connecting families through a multifamily media space , 2011, CHI.

[6]  Xiang Cao,et al.  Home video communication: mediating 'closeness' , 2010, CSCW '10.

[7]  Morgan G. Ames,et al.  Making love in the network closet: the benefits and work of family videochat , 2010, CSCW '10.

[8]  Kenton O'Hara,et al.  Everyday practices with mobile video telephony , 2006, CHI.

[9]  Carmen Egido,et al.  Teleconferencing as a technology to support cooperative work: Its , 1990 .

[10]  William W. Gaver,et al.  A Virtual Window on media space , 1995, CHI '95.

[11]  Jon Hindmarsh,et al.  Video in Qualitative Research: Analysing Social Interaction in Everyday Life , 2010 .

[12]  C. Heath,et al.  How do desk-top computers affect the doctor-patient interaction? , 1995, Family practice.

[13]  Christian Licoppe,et al.  The collaborative work of producing meaningful shots in mobile video telephony , 2009, Mobile HCI.

[14]  Hideaki Kuzuoka,et al.  Agora: a remote collaboration system that enables mutual monitoring , 1999, CHI Extended Abstracts.

[15]  Kori Inkpen Quinn,et al.  Video playdate: toward free play across distance , 2010, CHI.

[16]  S. Harrison Media Space 20+ Years of Mediated Life , 2009, Computer Supported Cooperative Work.

[17]  Hubert Knoblauch,et al.  PowerPoint, Communication, and the Knowledge Society , 2012 .

[18]  Abigail Sellen,et al.  One is not enough: multiple views in a media space , 1993, INTERCHI.

[19]  John C. Tang,et al.  HomeProxy: exploring a physical proxy for video communication in the home , 2013, CHI.

[20]  Hideaki Kuzuoka,et al.  Fractured Ecologies: Creating Environments for Collaboration , 2003, Hum. Comput. Interact..

[21]  Hideaki Kuzuoka,et al.  Hands on hitchcock: embodied reference to a moving scene , 2011, CHI.

[22]  Steve Benford,et al.  Revealing the realities of collaborative virtual reality , 2000, CVE '00.

[23]  John C. Tang,et al.  Experiences2Go: sharing kids' activities outside the home with remote family members , 2013, CSCW.

[24]  Barry A. T. Brown,et al.  The normal natural troubles of driving with GPS , 2012, CHI.

[25]  Hideki Koike,et al.  OmniEyeball: Spherical Display Embedded With Omnidirectional Camera Using Dynamic Spherical Mapping , 2016, UIST.

[26]  M. D. Fornel,et al.  Le cadre interactionnel de l'échange visiophonique , 1994 .

[27]  Carl Gutwin,et al.  Support for deictic pointing in CVEs: still fragmented after all these years' , 2014, CSCW.

[28]  Carman Neustaedter,et al.  Designing for families , 2009, CHI Extended Abstracts.

[29]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[30]  Tobias Höllerer,et al.  Integrating the physical environment into mobile remote collaboration , 2012, Mobile HCI.

[31]  Allan Kuchinsky,et al.  Turning away from talking heads: the use of video-as-data in neurosurgery , 1993, INTERCHI.

[32]  John C. Tang,et al.  Focusing on shared experiences: moving beyond the camera in video communication , 2012, DIS '12.

[33]  Steve Harrison,et al.  Connecting families: new technologies, family communication, and the impact on domestic space , 2010, GROUP '10.

[34]  Maurice Nevile,et al.  Organising the soundscape: Participants’ orientation to impending sound when turning on auditory objects in interaction , 2014 .

[35]  Steve Benford,et al.  Fragmented interaction: establishing mutual orientation in virtual environments , 1998, CSCW '98.

[36]  Tom Rodden,et al.  Turn it this way: grounding collaborative action with remote gestures , 2007, CHI.