Virtual force guided control method for teleoperated manipulator system over internet

Telepresence is a critical problem in robotic teleoperation systems. For the sake of collision avoidance between the end-effecter and the object, the human operator has to make close observations on the visual information. This overloads the visual sense of the human operator. On the other hand, there are some potential obstacles in gathering vision information. As a result, the advance notice of collision might be missed or neglected. In order to settle this issue, a virtual force guided control method for robotic teleoperation system is proposed in this paper. This approach combines position-force command strategy and virtual force feedback to perform proper operations, where the virtual force is generated by transforming visual information into reflective force. This control approach improves the operability of teleoperation system and enhances the effectiveness. Experiments are conducted and demonstrate the effectiveness of the virtual force guided control method.

[1]  Mamoru Mitsuishi,et al.  Information transformation-based tele-micro-handling/machining system , 1994, Proceedings IEEE Micro Electro Mechanical Systems An Investigation of Micro Structures, Sensors, Actuators, Machines and Robotic Systems.

[2]  Zoe Doulgeri,et al.  A web telerobotic system to teach industrial robot path planning and control , 2006, IEEE Transactions on Education.

[3]  Hongbin Zha,et al.  Camera pose determination from a single view of parallel lines , 2005, IEEE International Conference on Image Processing 2005.

[4]  Soonshin Han,et al.  Tele-operation of a Mobile Robot Using a Force Reflection Joystick with a Single Hall Sensor , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[5]  Pradeep K. Khosla,et al.  Integrating force and vision feedback within virtual environments for telerobotic systems , 1997, Proceedings of International Conference on Robotics and Automation.

[6]  李洪谊,et al.  Information Transformation-based Tele-robotic Systems , 2009 .

[7]  N. Xi,et al.  Real-Time Haptic Feedback in Internet-Based Telerobotic Operation , 2000 .

[8]  Zhu Feng.  A Note on Unique Solution Conditions of the P3P Problem , 2003 .

[9]  Mamoru Mitsuishi,et al.  Development of tele-operated micro-handling/machining system based on information transformation , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[10]  Jonathan Kofman,et al.  Teleoperation of a robot manipulator using a vision-based human-robot interface , 2005, IEEE Transactions on Industrial Electronics.

[11]  Rajiv Dubey,et al.  Design and implementation of visual-haptic assistive control system for virtual rehabilitation exercise and teleoperation manipulation , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Vijay Kumar,et al.  Visual and haptic collaborative tele-presence , 2001, Comput. Graph..

[14]  K. Ohnishi,et al.  Realization of virtual force sensation through bilateral teleoperation , 2006, 9th IEEE International Workshop on Advanced Motion Control, 2006..

[15]  Ning Xi,et al.  Internet based robots: applications, impacts, challenges and future directions , 2005, IEEE Workshop on Advanced Robotics and its Social Impacts, 2005..

[16]  Kostas Daniilidis,et al.  Stereo-based environment scanning for immersive telepresence , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Eckehard G. Steinbach,et al.  Telepresence Across Networks: A Combined Deadband and Prediction Approach , 2006, Tenth International Conference on Information Visualisation (IV'06).

[18]  Ali Shahdi,et al.  Model Predictive Control for Transparent Teleoperation Under Communication Time Delay , 2006, IEEE Transactions on Robotics.

[19]  Hideki Hashimoto,et al.  Internet-based obstacle avoidance of mobile robot using a force-reflection , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[20]  Martin Buss,et al.  Robust stability analysis of a bilateral teleoperation system using the parameter space approach , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  A K Bejczy,et al.  Sensors, Controls, and Man-Machine Interface for Advanced Teleoperation , 1980, Science.

[22]  B. Khademian,et al.  A robust multilateral shared controller for dual-user teleoperation systems , 2008, 2008 Canadian Conference on Electrical and Computer Engineering.

[23]  Ning Xi,et al.  Cooperative teleoperation of a multirobot system with force reflection via Internet , 2004, IEEE/ASME Transactions on Mechatronics.

[24]  Ning Xi,et al.  A case study of 3D stereoscopic vs. 2D monoscopic tele-reality in real-time dexterous teleoperation , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.