Head Motion - Based Robot's Controlling System Using Virtual Reality Glasses

This paper proposes head motion – based robot’s controlling system using virtual reality glasses that was implemented using various up-to date software and hardware solutions. System is consisted of robotic platform with DC motors controlled by micro controller with Wi-fi network interface. The second micro controller is used as access point and host of MJPG stereo vision camera stream. Virtual reality glasses are used to control motor by analyzing user’s head motion and to display stereo image from camera mounted in the front of the chassis. This article also introduces a user - centered head rotation system similar to yaw – pitch – roll that can be used to intuitively design functions of user interface. All source codes that were made for system implementation can be downloaded and tested.

[1]  Rolf Dornberger,et al.  Prototype-Based Research on Immersive Virtual Reality and on Self-Replicating Robots , 2018 .

[2]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[3]  Jörg Stückler,et al.  Direct visual-inertial odometry with stereo cameras , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[4]  David Bonyuet,et al.  Cooperative robot teleoperation through virtual reality interfaces , 2002, Proceedings Sixth International Conference on Information Visualisation.

[5]  Maria Bualat,et al.  Virtual Reality Interfaces for Visualization and Control of Remote Vehicles , 2001, Auton. Robots.

[6]  Robert Riener,et al.  Virtual reality for enhancement of robot-assisted gait training in children with central gait disorders. , 2011, Journal of rehabilitation medicine.

[7]  Robert Bieda,et al.  Metody wyznaczania kątów z żyroskopów dla filtru komplementarnego na potrzeby określania orientacji IMU , 2014 .

[8]  Kaikai Liu,et al.  Telepresence Robot with Autonomous Navigation and Virtual Reality: Demo Abstract , 2016, SenSys.

[9]  Jörg Stückler,et al.  Large-scale direct SLAM with stereo cameras , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Alireza Tavakkoli,et al.  A Robust and intuitive 3D interface for teleoperation of autonomous robotic agents through immersive virtual reality environments , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[11]  Yuka Kato A remote navigation system for a simple tele-presence robot with virtual reality , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Le Xie,et al.  Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms--A feasibility study. , 2016, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[13]  Kai-Tai Song,et al.  Virtual reality control of a robotic camera holder for minimally invasive surgery , 2017, 2017 11th Asian Control Conference (ASCC).

[14]  Daniel Cremers,et al.  Stereo DSO: Large-Scale Direct Sparse Visual Odometry with Stereo Cameras , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).