Towards socialVR: evaluating a novel technology for watching videos together

Social VR enables people to interact over distance with others in real-time. It allows remote people, typically represented as avatars, to communicate and perform activities together in a join shared virtual environment, extending the capabilities of traditional social platforms like Facebook and Netflix. This paper explores the benefits and drawbacks provided by a lightweight and low-cost Social VR platform (SocialVR), in which users are captured by several cameras and reconstructed in real-time. In particular, the paper contributes with (1) the design and evaluation of an experimental protocol for Social VR experiences; (2) the report of a production workflow for this new type of media experiences; and (3) the results of experiments with both end-users (N=15 pairs) and professionals (N=25) to evaluate the potential of the SocialVR platform. Results from the questionnaires and semi-structured interviews show that end-users rated positively towards the experiences provided by the SocialVR platform, which enabled them to sense emotions and communicate effortlessly. End-users perceived the photo-realistic experience of SocialVR similar to faceto-face scenarios and appreciated this new creative medium. From a commercial perspective, professionals confirmed the potential of this communication medium and encourage further research for the adoption of the platform in the commercial landscape.

[1]  C.-C. Jay Kuo,et al.  Technologies for 3D mesh compression: A survey , 2005, J. Vis. Commun. Image Represent..

[2]  Pablo Cesar,et al.  A pipeline for multiparty volumetric video conferencing: transmission of point clouds over low latency DASH , 2020, MMSys.

[3]  Mark H. Chignell,et al.  Impact of Retainability Failures on Video Quality of Experience , 2014, 2014 Tenth International Conference on Signal-Image Technology and Internet-Based Systems.

[4]  Petros Daras,et al.  An Integrated Platform for Live 3D Human Reconstruction and Motion Capturing , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  David Geerts,et al.  Understanding Social TV: a survey , 2011 .

[6]  Mel Slater,et al.  The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment , 2003, CHI '03.

[7]  Maria V. Sanchez-Vives,et al.  First Person Experience of Body Transfer in Virtual Reality , 2010, PloS one.

[8]  Heinrich Hußmann,et al.  Social Viewing in Cinematic Virtual Reality: Challenges and Opportunities , 2018, ICIDS.

[9]  Petros Daras,et al.  Subjective Visual Quality Assessment of Immersive 3D Media Compressed by Open-Source Static 3D Mesh Codecs , 2019, MMM.

[10]  Elizabeth F. Churchill,et al.  Collaborative Virtual Environments: Digital Places and Spaces for Interaction , 2001 .

[11]  Crysta J. Metcalf,et al.  Of social television comes home: a field study of communication choices and practices in tv-based text and voice chat , 2009, CHI.

[12]  William R. Sherman,et al.  Understanding Virtual RealityInterface, Application, and Design , 2002, Presence: Teleoperators & Virtual Environments.

[13]  Karolien Poels,et al.  The impact of social setting on the recall and recognition of in-game advertising , 2015, Comput. Hum. Behav..

[14]  Rufael Mekuria,et al.  Emerging MPEG Standards for Point Cloud Compression , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[15]  Maria Theodorou,et al.  Your Brain on the Movies: A Computational Approach for Predicting Box-office Performance from Viewer’s Brain Responses to Movie Trailers , 2017, Front. Neuroinform..

[16]  David R. Thomas,et al.  A General Inductive Approach for Analyzing Qualitative Evaluation Data , 2006 .

[17]  H. Macher,et al.  FIRST EXPERIENCES WITH KINECT V2 SENSOR FOR CLOSE RANGE 3D MODELLING , 2015 .

[18]  Eike Langbehn,et al.  Influence of avatar appearance on presence in social VR , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[19]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[20]  Michael Neff,et al.  Communication Behavior in Embodied Virtual Reality , 2018, CHI.

[21]  Holger Regenbrecht,et al.  The Experience of Presence: Factor Analytic Insights , 2001, Presence: Teleoperators & Virtual Environments.

[22]  Tomasz Bednarz,et al.  A systematic review of the current state of collaborative mixed reality technologies: 2013–2018 , 2019, AIMS Electronics and Electrical Engineering.

[23]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[24]  G. Mantovani.  Virtual Reality as a Communication Environment: Consensual Hallucination, Fiction, and Possible Selves , 1995 .

[25]  David C. Brogan,et al.  Diamond Park and Spline:Social Virtual Reality with 3D Animation, Spoken Interaction, and Runtime Extendability , 1997, Presence: Teleoperators & Virtual Environments.

[26]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[27]  Bernd Fröhlich,et al.  Immersive Group-to-Group Telepresence , 2013, IEEE Transactions on Visualization and Computer Graphics.

[28]  Rufael Mekuria,et al.  Point-Cloud Compression: Moving Picture Experts Group's New Standard in 2020 , 2019, IEEE Consumer Electronics Magazine.

[29]  Hans Stokking,et al.  Social VR Platform: Building 360-degree Shared VR Spaces , 2017, TVX.

[30]  Pablo César,et al.  Past, present, and future of social TV: A categorization , 2011, 2011 IEEE Consumer Communications and Networking Conference (CCNC).

[31]  Charles T. Loop,et al.  Holoportation: Virtual 3D Teleportation in Real-time , 2016, UIST.

[32]  Mario Montagud,et al.  Hybrid Broadcast/Broadband TV Services and Media Synchronization: Demands, Preferences and Expectations of Spanish Consumers , 2018, IEEE Transactions on Broadcasting.

[33]  Titus B. Zaharia,et al.  FAMC: The MPEG-4 standard for Animated Mesh Compression , 2008, 2008 15th IEEE International Conference on Image Processing.

[34]  Marc Erich Latoschik,et al.  Avatar realism and social interaction quality in virtual reality , 2016, 2016 IEEE Virtual Reality (VR).

[35]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[36]  Mel Slater,et al.  Using Presence Questionnaires in Reality , 2000, Presence: Teleoperators & Virtual Environments.

[37]  Pablo César,et al.  The implications of program genres for the design of social television systems , 2008, UXTV '08.

[38]  Abdallah El Ali,et al.  Measuring and Understanding Photo Sharing Experiences in Social Virtual Reality , 2019, CHI.

[39]  Craig Gotsman,et al.  Spectral compression of mesh geometry , 2000, EuroCG.

[40]  Blair MacIntyre,et al.  Enhancing the Experience of Virtual Conferences in Social Virtual Environments , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW).

[41]  Stephen A. Brewster,et al.  Examining The Role of Smart TVs and VR HMDs in Synchronous At-a-Distance Media Consumption , 2016, TCHI.

[42]  Rufael Mekuria,et al.  Are we in sync?: synchronization requirements for watching online video together. , 2011, CHI.

[43]  Mishal Dholakia,et al.  Dataspace: A Reconfigurable Hybrid Reality Environment for Collaborative Information Analysis , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[44]  Pablo César,et al.  Experiencing Virtual Reality Together: Social VR Use Case Study , 2018, TVX.

[45]  Greg Welch,et al.  A Systematic Review of Social Presence: Definition, Antecedents, and Implications , 2018, Front. Robot. AI.

[46]  Elizabeth F. Churchill,et al.  Collaborative virtual environments: An introductory review of issues and systems , 1998, Virtual Reality.

[47]  Rene Kaiser,et al.  Orchestration: tv-like mixing grammars applied to video-communication for social groups , 2013, ACM Multimedia.

[48]  Robin Wolff,et al.  A Mixed Reality Telepresence System for Collaborative Space Operation , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[49]  Marc Erich Latoschik,et al.  The Impact of Avatar Personalization and Immersion on Virtual Body Ownership, Presence, and Emotional Response , 2018, IEEE Transactions on Visualization and Computer Graphics.

[50]  Marc Levoy,et al.  The Use of Points as a Display Primitive , 2000 .

[51]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[52]  Marc Erich Latoschik,et al.  The effect of avatar realism in immersive social virtual realities , 2017, VRST.

[53]  Fernando Boronat,et al.  IDMS Solution for Hybrid Broadcast Broadband Delivery Within the Context of HbbTV Standard , 2019, IEEE Transactions on Broadcasting.

[54]  Mario Montagud,et al.  Content Format and Quality of Experience in Virtual Reality , 2020, ArXiv.

[55]  Wolfram Burgard,et al.  3-D Mapping With an RGB-D Camera , 2014, IEEE Transactions on Robotics.