The Influence of Spatial Representation on Remote Peer Consultation: A Study on Mixed Reality Remote Support for Choosing Furniture

This paper presents a study in which we investigated the use of different devices and mechanisms to implement Mixed Reality settings for peer recommendations on furniture. In particular, we developed a mechanism to scan rooms for new furniture to be placed in, make the resulting 3D environment available to users and display virtual furniture in it. In an exploratory study, we asked 21 participants to use this environment to support an imaginary friend in their buying decision on a couch for their living room. This was done in five conditions, including a static photo of the living room, 3D representations on mobile phones and PC screens as well as mobile (cardboard-based) VR and a dedicated VR HMD. In the study, we wanted to explore how display size, 3D experience and the fidelity of HMDs affect the quality of support for recommendations by the remote peers. Our results show that the screen-based and VR-based 3D mechanisms outperform a simple photo and that VR HMDs created highest perceptions of spatial presence and were preferred by users. Surprisingly, users perceived all mechanisms showing the 3D environment to create similar qualities of support for their recommendations. We analyze these findings and derive design recommendations from them.

[1]  Benjamin Cohen,et al.  Design and Implementation of TeleAdvisor: a Projection-Based Augmented Reality System for Remote Collaboration , 2015, Computer Supported Cooperative Work (CSCW).

[2]  Kori Inkpen Quinn,et al.  Remote shopping advice: enhancing in-store shopping with social technologies , 2014, CSCW.

[3]  Jing Yang,et al.  A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing , 2020, CHI.

[4]  Ahmad Al-Issa,et al.  Cultures of Trust: Effects of Avatar Faces and Reputation Scores on German and Arab Players in an Online Trust-Game , 2014, PloS one.

[5]  Lei Gao,et al.  An oriented point-cloud view for MR remote collaboration , 2016, SIGGRAPH ASIA Mobile Graphics and Interactive Applications.

[6]  Holger Regenbrecht,et al.  Social presence in two- and three-dimensional videoconferencing , 2005 .

[7]  Meredith Ringel Morris,et al.  Estimating the social costs of friendsourcing , 2014, CHI.

[8]  Jiro Tanaka,et al.  Go together: providing nonverbal awareness cues to enhance co-located sensation in remote communication , 2019, Human-centric Computing and Information Sciences.

[9]  Isaac Wang,et al.  Exploring Virtual Agents for Augmented Reality , 2019, CHI.

[10]  Dieter Schmalstieg,et al.  Mathematics and geometry education with collaborative augmented reality , 2003, Comput. Graph..

[11]  A. Schütz,et al.  Comparing immersive virtual reality and powerpoint as methods for delivering safety training: Impacts on risk perception, learning, and decision making , 2019, Safety Science.

[12]  Michael Prilla,et al.  Evaluating Pointing Modes and Frames of Reference for Remotely Supporting an Augmented Reality User in a Collaborative (Virtual) Environment: Evaluation within the Scope of a Remote Consultation Session , 2019, Mensch & Computer.

[13]  Tobias Höllerer,et al.  World-stabilized annotations and virtual scene navigation for remote collaboration , 2014, UIST.

[14]  Ross T. Smith,et al.  The Impact of Remote User’s Role in a Mixed Reality Mixed Presence System , 2019, VRCAI.

[15]  Ronald Azuma,et al.  A survey of augmented reality" Presence: Teleoperators and virtual environments , 1997 .

[16]  Robert W. Lindeman,et al.  Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration , 2018, CHI.

[17]  Michael Prilla,et al.  The effects of consultant avatar size and dynamics on customer trust in online consultations , 2020, MuC.

[18]  Dragos Datcu,et al.  Handheld Augmented Reality for Distributed Collaborative Crime Scene Investigation , 2016, GROUP.

[19]  Bruce H. Thomas,et al.  On the Shoulder of the Giant: A Multi-Scale Mixed Reality Collaboration with 360 Video Sharing and Tangible Interaction , 2019, CHI.

[20]  J. Lenzer,et al.  Knowing me, knowing you , 2008, BMJ : British Medical Journal.

[21]  Tobias Höllerer,et al.  Real-Time Re-Textured Geometry Modeling Using Microsoft HoloLens , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[22]  Dirk Heylen,et al.  With a little help from a holographic friend: the OpenIMPRESS mixed reality telepresence toolkit for remote collaboration systems , 2018, VRST.

[23]  Viswanath Venkatesh,et al.  Consumer Acceptance and Use of Information Technology: Extending the Unified Theory of Acceptance and Use of Technology , 2012, MIS Q..

[24]  Hao Tang,et al.  Integrating AR and VR for Mobile Remote Collaboration , 2019, 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct).

[25]  Michael Prilla,et al.  Augmented Reality Training for Industrial Assembly Work - Are Projection-based AR Assistive Systems an Appropriate Tool for Assembly Training? , 2020, CHI.

[26]  Bilge Mutlu,et al.  Handheld or Handsfree?: Remote Collaboration via Lightweight Head-Mounted Displays and Handheld Devices , 2015, CSCW.

[27]  M. A. Sasse,et al.  ’Knowing me, knowing you’ — Using profiles and social networking to improve recommender systems , 2006 .

[28]  Carman Neustaedter,et al.  Collaboration with 360° Videochat: Challenges and Opportunities , 2017, Conference on Designing Interactive Systems.

[29]  Seung-Eun Lee,et al.  An exploratory study of using 3D avatars as online salespeople , 2015 .

[30]  Michael Prilla,et al.  Show me your living room: investigating the role of representing user environments in AR remote consultations , 2020, Mensch & Computer.

[31]  Mark Billinghurst,et al.  The Effect of View Independence in a Collaborative AR System , 2015, Computer Supported Cooperative Work (CSCW).

[32]  José Luís Reis,et al.  The Intention to Use E-Commerce Using Augmented Reality - The Case of IKEA Place , 2020, ICITS.

[33]  Maximilian Speicher,et al.  360Anywhere: Mobile Ad-hoc Collaboration in Any Environment using 360 Video and Augmented Reality , 2018, Proc. ACM Hum. Comput. Interact..

[34]  Matt Adcock,et al.  Mixed Reality Remote Collaboration Combining 360 Video and 3D Reconstruction , 2019, CHI.

[35]  Marco Speicher,et al.  A Virtual Reality Couch Configurator Leveraging Passive Haptic Feedback , 2020, CHI Extended Abstracts.

[36]  Carman Neustaedter,et al.  Shopping Over Distance through a Telepresence Robot , 2018, Proc. ACM Hum. Comput. Interact..

[37]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[38]  M. Balafar,et al.  The state-of-the-art in expert recommendation systems , 2019, Eng. Appl. Artif. Intell..

[39]  Weidong Huang,et al.  Helping Hands: Using Augmented Reality to Provide Remote Guidance to Health Professionals , 2017, CSHI.

[40]  Luca Chittaro,et al.  Effects of Different Types of Virtual Reality Display on Presence and Learning in a Safety Training Scenario , 2018, IEEE Transactions on Visualization and Computer Graphics.

[41]  Huan Liu,et al.  Social recommendation: a review , 2013, Social Network Analysis and Mining.

[42]  Diane Gromala,et al.  Immersion in Cardboard VR Compared to a Traditional Head-Mounted Display , 2016, HCI.

[43]  Scott Bateman,et al.  Stabilized Annotations for Mobile Remote Assistance , 2016, CHI.

[44]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[45]  Diane Gromala,et al.  Cardboard Mobile Virtual Reality as an Approach for Pain Distraction in Clinical Settings: Comparison, Exploration and Evaluation with Oculus Rift , 2017, CHI Extended Abstracts.

[46]  Oliver Blunk,et al.  Möglichkeiten der Digitalisierung zur Beratung von hochkonfigurierbaren und hochindividualisierbaren Gütern , 2020, HMD Praxis der Wirtschaftsinformatik.

[47]  Zane Stromberga,et al.  Virtualisation devices for student learning: Comparison between desktop-based (Oculus Rift) and mobile-based (Gear VR) virtual reality in medical and health science education , 2017 .

[48]  Michael Prilla,et al.  Potentials of AR technology for the digitalization of consultancy intensive sales processes on the example of furniture sales , 2020, Wirtschaftsinformatik.

[49]  Matt Adcock,et al.  A Technique for Mixed Reality Remote Collaboration using 360 Panoramas in 3D Reconstructed Scenes , 2019, VRST.

[50]  Alexander Klippel,et al.  Desktop versus immersive virtual environments: effects on spatial learning , 2020, Spatial Cogn. Comput..

[51]  Jun Rekimoto,et al.  JackIn space: designing a seamless transition between first and third person view for effective telepresence collaborations , 2017, AH.

[52]  Dan Cosley,et al.  Do social explanations work?: studying and modeling the effects of social explanations in recommender systems , 2013, WWW.

[53]  Roman Rädle,et al.  Virtual Objects as Spatial Cues in Collaborative Mixed Reality Environments: How They Shape Communication Behavior and User Task Load , 2016, CHI.