Examining The Role of Smart TVs and VR HMDs in Synchronous At-a-Distance Media Consumption

This article examines synchronous at-a-distance media consumption from two perspectives: How it can be facilitated using existing consumer displays (through TVs combined with smartphones), and imminently available consumer displays (through virtual reality (VR) HMDs combined with RGBD sensing). First, we discuss results from an initial evaluation of a synchronous shared at-a-distance smart TV system, CastAway. Through week-long in-home deployments with five couples, we gain formative insights into the adoption and usage of at-a-distance media consumption and how couples communicated during said consumption. We then examine how the imminent availability and potential adoption of consumer VR HMDs could affect preferences toward how synchronous at-a-distance media consumption is conducted, in a laboratory study of 12 pairs, by enhancing media immersion and supporting embodied telepresence for communication. Finally, we discuss the implications these studies have for the near-future of consumer synchronous at-a-distance media consumption. When combined, these studies begin to explore a design space regarding the varying ways in which at-a-distance media consumption can be supported and experienced (through music, TV content, augmenting existing TV content for immersion, and immersive VR content), what factors might influence usage and adoption and the implications for supporting communication and telepresence during media consumption.

[1]  Chongyang Ma,et al.  Facial performance sensing head-mounted display , 2015, ACM Trans. Graph..

[2]  Matthew Chalmers,et al.  Personal Tracking of Screen Time on Digital Devices , 2016, CHI.

[3]  Frank Bentley,et al.  Ambient social tv: drawing people into a shared experience , 2008, CHI.

[4]  Frank Bentley,et al.  Together alone: motivations for live-tweeting a television series , 2014, CHI.

[5]  Laura Stafford Maintaining long-distance and cross-residential relationships , 2004 .

[6]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[7]  Michael Madary,et al.  Real Virtuality: A Code of Ethical Conduct. Recommendations for Good Scientific Practice and the Consumers of VR-Technology , 2016, Front. Robot. AI.

[8]  Steve Benford,et al.  Fragmented interaction: establishing mutual orientation in virtual environments , 1998, CSCW '98.

[9]  Loren G. Terveen,et al.  CollaboraTV: making television viewing social again , 2008, UXTV '08.

[10]  Sarah Diefenbach,et al.  All You Need is Love: Current Strategies of Mediating Intimate Relationships through Technology , 2012, TCHI.

[11]  Eyal Ofek,et al.  Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment , 2016, CSCW.

[12]  A. Aguila LIVING LONG-DISTANCE RELATIONSHIPS THROUGH COMPUTER-MEDIATED COMMUNICATION , 2011 .

[13]  Steve Benford,et al.  MASSIVE: a collaborative virtual environment for teleconferencing , 1995, TCHI.

[14]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[15]  Keita Higuchi,et al.  ImmerseBoard: Immersive Telepresence Experience using a Digital Whiteboard , 2015, CHI.

[16]  Manfred Tscheligi,et al.  Trends in the living room and beyond: results from ethnographic studies using creative and playful probing , 2008, CIE.

[17]  Azadeh Forghani,et al.  Media2gether: Sharing Media during a Call , 2014, GROUP.

[18]  Matthew Chalmers,et al.  Forget-me-not: History-less Mobile Messaging , 2016, CHI.

[19]  Robert E. Pinsker,et al.  Alone Together: Why We Expect More from Technology and Less from Each Other. , 2012 .

[20]  K. Gegenfurtner,et al.  Design Issues in Gaze Guidance Under review with ACM Transactions on Computer Human Interaction , 2009 .

[21]  Dong-Hee Shin,et al.  Defining sociability and social presence in Social TV , 2013, Comput. Hum. Behav..

[22]  Pierre Dragicevic,et al.  HCI Statistics without p-values , 2015 .

[23]  J. Hintze,et al.  Violin plots : A box plot-density trace synergism , 1998 .

[24]  Pablo César,et al.  Video mediated social interaction between groups: System requirements and technology challenges , 2011, Telematics Informatics.

[25]  Jeremy P. Birnholtz,et al.  Butler lies: awareness, deception and design , 2009, CHI.

[26]  David A. Shamma,et al.  Zync with Me , 2009, Social Interactive Television.

[27]  M. Dainton,et al.  Patterns of communication channel use in the maintenance of long‐distance relationships , 2002 .

[28]  Matthew Chalmers,et al.  Configuring Attention in the Multiscreen Living Room , 2015, ECSCW.

[29]  Crysta J. Metcalf,et al.  The uses of social television , 2008, CIE.

[30]  P H Abelson Planet Earth. , 1986, Science.

[31]  John C. Tang,et al.  Sharing Experiences over Video: Watching Video Programs together at a Distance , 2013, INTERACT.

[32]  Ana Tajadura-Jiménez,et al.  Working with the television on: an investigation into media multitasking , 2014, CHI Extended Abstracts.

[33]  Radu-Daniel Vatavu,et al.  Audience Silhouettes: Peripheral Awareness of Synchronous Audience Kinesics for Social Television , 2015, TVX.

[34]  Stephen A. Brewster,et al.  A review of collocated multi-user TV , 2015, Personal and Ubiquitous Computing.

[35]  Roderick Murray-Smith,et al.  A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays , 2015, CHI Extended Abstracts.

[36]  Leon Adam Watts,et al.  YourGloves, hothands and hotmits: devices to hold hands at a distance , 2012, UIST.

[37]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[38]  Volker Wulf,et al.  Jumping between devices and services: towards an integrated concept for social tv , 2011, EuroITV '11.

[39]  Niloofar Dezfuli,et al.  A study on interpersonal relationships for social interactive television , 2011, EuroITV '11.

[40]  Helena Bilandzic,et al.  Measuring Narrative Engagement , 2009 .

[41]  Naomi S. Altman,et al.  Points of Significance: Visualizing samples with box plots , 2014, Nature Methods.

[42]  Hirokazu Kato,et al.  Real world teleconferencing , 1999, CHI Extended Abstracts.

[43]  David Geerts,et al.  In front of and behind the second screen: viewer and producer perspectives on a companion app , 2014, TVX '14.

[44]  Paul Milgram,et al.  A Taxonomy of Real and Virtual World Display Integration , 1999 .

[45]  Carman Neustaedter,et al.  How and why teenagers use video chat , 2013, CSCW.

[46]  Robert E. Kraut,et al.  Watching together: integrating text chat with video , 2007, CHI.

[47]  Johnny Saldaña,et al.  The Coding Manual for Qualitative Researchers , 2009 .

[48]  Lora Oehlberg,et al.  Social TV: Designing for Distributed, Sociable Television Viewing , 2008, Int. J. Hum. Comput. Interact..

[49]  John C. Tang,et al.  Experiences2Go: sharing kids' activities outside the home with remote family members , 2013, CSCW.

[50]  Rufael Mekuria,et al.  Are we in sync?: synchronization requirements for watching online video together. , 2011, CHI.

[51]  Frank Bentley,et al.  Examining presence and lightweight messaging in a social television experience , 2008, TOMCCAP.

[52]  Ian Kegel,et al.  An emergent role for TV in social communication , 2009, EuroITV '09.

[53]  Kaisa Väänänen,et al.  Designing for presence in social television interaction , 2013, MUM.

[54]  Gregory D. Abowd,et al.  Towards a questionnaire for measuring affective benefits and costs of communication technologies , 2014, CSCW.

[55]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[56]  Carman Neustaedter,et al.  Intimacy in long-distance relationships over video chat , 2012, CHI.

[57]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[58]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[59]  Andy Brown,et al.  HCI over multiple screens , 2014, CHI Extended Abstracts.

[60]  Loni Dansie Long-distance dating relationships among college students: The benefits and drawbacks of using technology , 2012 .

[61]  John C. Tang,et al.  Focusing on shared experiences: moving beyond the camera in video communication , 2012, DIS '12.

[62]  Bernd Fröhlich,et al.  Immersive Group-to-Group Telepresence , 2013, IEEE Transactions on Visualization and Computer Graphics.

[63]  Daniel Boland,et al.  Lost in the rift , 2015, XRDS.