A 360 ◦ Video-based Robot Platform for Telepresent Redirected Walking

Telepresence systems have the potential to overcome limits and distance constraints of the real-world by enabling people to remotely visit and interact with each other. However, current telepresence systems usually lack natural ways of supporting interaction and exploration of remote environments (REs). In particular, the usage of single webcams for capturing the RE provides only a limited illusion of spatial presence. Furthermore, typical movement controls of mobile platforms in today’s telepresence systems are often restricted to simple interaction devices. For these reasons, we introduce a prototype of a 360◦ video-based telepresence system consisting of a head-mounted display (HMD), a 360◦ camera, and a mobile robot platform. Considering the heterogeneous layouts between the user’s local environment (LE) in which the user’s motions are tracked and the RE, redirected walking (RDW) technology and different gains are applied to this system to allow users to explore a much larger RE than the LE. With this setup, users can get a 360◦ full-view rendered view on the HMD from the RE, and explore it by the most intuitive and natural way, e. g., by real walking in the user’s LE, and thus controlling movements of the robot platform in the RE.

[1]  J. Dichgans,et al.  Visual-Vestibular Interaction: Effects on Self-Motion Perception and Postural Control , 1978 .

[2]  Gerd Bruder,et al.  Analyses of human sensitivity to redirected walking , 2008, VRST '08.

[3]  John C. Tang,et al.  Embodied social proxy: mediating interpersonal connection in hub-and-satellite teams , 2010, CHI.

[4]  Delmer Smith,et al.  Delivering Advanced Technical Education Using Online, Immersive Classroom Technology , 2017 .

[5]  Fumihide Tanaka,et al.  A pilot study about remote teaching by elderly people to children over a two-way telepresence robot system , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  Zachary Wartell,et al.  Leveraging change blindness for redirection in virtual environments , 2011, 2011 IEEE Virtual Reality Conference.

[7]  Carman Neustaedter,et al.  To Beam or Not to Beam: A Study of Remote Telepresence Attendance at an Academic Conference , 2016, CSCW.

[8]  Gerd Bruder,et al.  Bending the Curve: Sensitivity to Bending of Curved Paths and Application in Room-Scale VR , 2017, IEEE Transactions on Visualization and Computer Graphics.

[9]  Eike Langbehn,et al.  Detection Thresholds for Rotation and Translation Gains in 360° Video-Based Telepresence Systems , 2018, IEEE Transactions on Visualization and Computer Graphics.

[10]  Gerd Bruder,et al.  Estimation of Detection Thresholds for Redirected Walking Techniques , 2010, IEEE Transactions on Visualization and Computer Graphics.

[11]  Saso Koceski,et al.  Evaluation of an Assistive Telepresence Robot for Elderly Healthcare , 2016, Journal of Medical Systems.

[12]  Allen Y. Yang,et al.  Augmented Telemedicine Platform for Real-Time Remote Medical Consultation , 2017, MMM.

[13]  Eike Langbehn,et al.  Immersive remote grasping: realtime gripper control by a heterogenous robot control system , 2016, VRST.

[14]  James Park,et al.  The Brain's Sense of Movement , 2003, The Yale Journal of Biology and Medicine.

[15]  Susumu Tachi Telexistence: Enabling Humans to Be Virtually Ubiquitous , 2016, IEEE Computer Graphics and Applications.