VROOM: Virtual Robot Overlay for Online Meetings

Telepresence robots allow users to freely explore a remote space and provide a physical embodiment in that space. However, they lack a compelling representation of the remote user in the local space. We present VROOM (Virtual Robot Overlay for Online Meetings), a two-way system for exploring how to improve the social experience of robotic telepresence. For the local user, an augmented-reality (AR) interface shows a life-size avatar of the remote user overlaid on a telepresence robot. For the remote user, a head-mounted virtual-reality (VR) interface presents an immersive 360° view of the local space with mobile autonomy. The VR system tracks the remote user's head pose and hand movements, which are applied to an avatar. This provides the remote user with an identifiable self-embodiment and allows the local user to see the remote user's head direction and arm gestures.

[1]  Tobias Höllerer,et al.  World-stabilized annotations and virtual scene navigation for remote collaboration , 2014, UIST.

[2]  Robert W. Lindeman,et al.  Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration , 2018, CHI.

[3]  John F. Canny,et al.  Social Tele-Embodiment: Understanding Presence , 2001, Auton. Robots.

[4]  Peter Kazanzides,et al.  Alignment of the Virtual Scene to the Tracking Space of a Mixed Reality Head-Mounted Display. , 2017 .

[5]  Hideaki Kuzuoka,et al.  OmniGlobe: An Interactive I/O System For Symmetric 360-Degree Video Communication , 2019, Conference on Designing Interactive Systems.

[6]  Kenton O'Hara,et al.  Everyday practices with mobile video telephony , 2006, CHI.

[7]  Abigail Sellen,et al.  One is not enough: multiple views in a media space , 1993, INTERCHI.

[8]  Carman Neustaedter,et al.  Robotic Telepresence at Scale , 2017, CHI.

[9]  Charles T. Loop,et al.  Holoportation: Virtual 3D Teleportation in Real-time , 2016, UIST.

[10]  Bilge Mutlu,et al.  Can You See Me Now?: How Field of View Affects Collaboration in Robotic Telepresence , 2015, CHI.

[11]  Tovi Grossman,et al.  Loki: Facilitating Remote Instruction of Physical Tasks Using Bi-Directional Mixed-Reality Telepresence , 2019, UIST.

[12]  Hao Gao,et al.  A 6-DOF Telexistence Drone Controlled by a Head Mounted Display , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[13]  Susan R. Fussell,et al.  Gestures Over Video Streams to Support Remote Collaboration on Physical Tasks , 2004, Hum. Comput. Interact..

[14]  John C. Tang,et al.  A Framework for Understanding and Designing Telepresence , 2015, CSCW.

[15]  Don Kimber,et al.  Polly: "being there" through the parrot and a guide , 2014, MobileHCI '14.

[16]  Carman Neustaedter,et al.  Collaboration with 360° Videochat: Challenges and Opportunities , 2017, Conference on Designing Interactive Systems.

[17]  Jun Rekimoto,et al.  JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera , 2017, IEEE Trans. Vis. Comput. Graph..

[18]  Tobias Höllerer,et al.  Integrating the physical environment into mobile remote collaboration , 2012, Mobile HCI.

[19]  Carman Neustaedter,et al.  To Beam or Not to Beam: A Study of Remote Telepresence Attendance at an Academic Conference , 2016, CSCW.

[20]  Martin Kraus,et al.  A comparison of head-mounted and hand-held displays for 360° videos with focus on attitude and behavior change , 2016, MindTrek.

[21]  Bruce H. Thomas,et al.  On the Shoulder of the Giant: A Multi-Scale Mixed Reality Collaboration with 360 Video Sharing and Tangible Interaction , 2019, CHI.

[22]  Carman Neustaedter,et al.  Geocaching with a Beam: Shared Outdoor Activities through a Telepresence Robot with 360 Degree Viewing , 2018, CHI.

[23]  Carman Neustaedter,et al.  Shopping Over Distance through a Telepresence Robot , 2018, Proc. ACM Hum. Comput. Interact..

[24]  Carman Neustaedter,et al.  Mechanics of Camera Work in Mobile Video Collaboration , 2015, CHI.

[25]  Masahiko Inami,et al.  Mutual Telexistence System Using Retro-Reflective Projection Technology , 2004, Int. J. Humanoid Robotics.

[26]  Naoki Kawakami,et al.  TORSO: Development of a Telexistence Visual System Using a 6-d.o.f. Robot Head , 2008, Adv. Robotics.

[27]  Carman Neustaedter,et al.  Communicating Through A Telepresence Robot: A Study of Long Distance Relationships , 2017, CHI Extended Abstracts.

[28]  Henry Fuchs,et al.  General-purpose telepresence with head-worn optical see-through displays and projector-based lighting , 2013, 2013 IEEE Virtual Reality (VR).

[29]  Scott Bateman,et al.  Stabilized Annotations for Mobile Remote Assistance , 2016, CHI.

[30]  Bilge Mutlu,et al.  In-body experiences: embodiment, control, and trust in robot-mediated communication , 2013, CHI.

[31]  Kenton O'Hara,et al.  Hybrid Meetings in the Modern Workplace: Stories of Success and Failure , 2019, CRIWG/CollabTech.

[32]  David S. Kirk,et al.  Comparing remote gesture technologies for supporting collaborative physical tasks , 2006, CHI.

[33]  Hiroshi Ishii,et al.  ClearBoard: a seamless medium for shared drawing and conversation with eye contact , 1992, CHI.

[34]  Hideaki Kuzuoka,et al.  How Display Shapes Affect 360-Degree Panoramic Video Communication , 2018, Conference on Designing Interactive Systems.

[35]  Robert E. Kraut,et al.  --Understanding Effects of Proximity on Collaboration : Implications for Technologies to Support Remote Collaborative Work , 2001 .

[36]  Carl Gutwin,et al.  Improving interpretation of remote gestures with telepointer traces , 2002, CSCW '02.

[37]  Don Kimber,et al.  Polly Wanna Show You: Examining Viewpoint-Conveyance Techniques for a Shoulder-Worn Telepresence System , 2015, MobileHCI Adjunct.