Virtual reality-based teleoperation construction robot control system with 3Dvisor device

In this paper, a virtual reality-based construction tele-robot control system is investigated. The system consists of a servo-controlled construction tele-robot, two joysticks for controlling the construction tele-robot, and virtual environment imaging system. The operator performs the teleoperation of the construction tele-robot by manipulating the graphic robot directly in virtual environment using the joysticks. Experiments research indicated that virtual reality technology improved the task efficiency and offered the possibility of performing teleoperation with greater safety. Up to now, the virtual environment imaging system used in this control system is always 2D working scene, no 3D stereoscopic sense in real-life operation. Aiming at the problems, a 3Dvisor device is introduced into this system in this paper, which can move the viewpoint even when the construction tele-robot doesn't move. At last, the evaluation experiments results based on risk indicator using 2D and 3D stereoscopic virtual environment image system respectively are both included in this paper. These experiments results indicate that using 3Dvisor device to present the 3D stereoscopic virtual working environment is effective to enhance the safety by decreasing the average generation force, but the contacting time still needs to be improved in the application.

[1]  Hoang Duong Tuan,et al.  Nonlinear adaptive control of master–slave system in teleoperation☆ , 2003 .

[2]  Mingde Gong.  Force feedback model of electro-hydraulic servo tele-operation robot based on velocity control , 2008 .

[3]  Jose J. González Sánchez,et al.  New stereoscopic virtual reality system application to cranial nerve microvascular decompression , 2010, Acta Neurochirurgica.

[4]  N. Ishikawa,et al.  Headmount stereoscopic monitor for endoscopic surgery , 2004, Surgical Endoscopy And Other Interventional Techniques.

[5]  Santiago Martín,et al.  GLSV: Graphics library stereo vision for OpenGL , 2008, Virtual Reality.

[6]  Hironao Yamada,et al.  Construction Tele-robotic System with Virtual Reality (CG Presentation of Virtual robot and Task Object using Stereo Vision System) , 2007, Control. Intell. Syst..

[7]  Anil T Ahuja,et al.  Stereoscopic virtual reality simulation for microsurgical excision of cerebral arteriovenous malformation: case illustrations. , 2009, Surgical neurology.

[8]  Andrew Squelch,et al.  3D Stereoscopic Visualization of Fenestrated Stent Grafts , 2008, CardioVascular and Interventional Radiology.

[9]  Thomas Sikora,et al.  Stereoscopic 3D from 2D video with super-resolution capability , 2008, Signal Process. Image Commun..

[10]  Antonio Bernardo,et al.  A Three-dimensional Interactive Virtual Dissection Model to Simulate Transpetrous Surgical Avenues , 2003, Neurosurgery.

[11]  Hironao Yamada,et al.  CONSTRUCTION TELE-ROBOTIC SYSTEM WITH VIRTUAL REALITY , 2002 .

[12]  Hironao Yamada,et al.  Master-Slave Control for Construction Robot Teleoperation - Application of a Velocity Control with a Force Feedback Model - , 2007, J. Robotics Mechatronics.

[13]  SikoraThomas,et al.  Stereoscopic 3D from 2D video with super-resolution capability , 2008 .

[14]  Philip N. Day,et al.  System design and user evaluation of Co-Star: An immersive stereoscopic system for cable harness design , 2007, Comput. Aided Des..

[15]  Amar R. Marathe,et al.  Virtual reality hardware and graphic display options for brain–machine interfaces , 2008, Journal of Neuroscience Methods.

[16]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[17]  Hironao Yamada,et al.  Development of a Hydraulic Tele-Operated Construction Robot using Virtual Reality , 2003 .

[18]  Thomas B. Sheridan.  Teleoperation, Telerobotics, and Telepresence: A Progress Report , 1992 .

[19]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[20]  Hugo Thienpont,et al.  Stereoscopic projector for polarized viewing with extended color gamut , 2010, Displays.

[21]  Hironao Yamada,et al.  Construction Tele-robot System With Virtual Reality , 2008, 2008 IEEE Conference on Robotics, Automation and Mechatronics.