Towards Multi-DOF model mediated teleoperation: Using vision to augment feedback

In this paper, we address some of the challenges that arise as model-mediated teleoperation is applied to systems with multiple degrees of freedom and multiple sensors. Specifically we use a system with position, force, and vision sensors to explore an environment geometry in two degrees of freedom. The inclusion of vision is proposed to alleviate the difficulties of estimating an increasing number of environment properties. Vision can furthermore increase the predictive nature of model-mediated teleoperation, by effectively predicting touch feedback before the slave is even in contact with the environment. We focus on the case of estimating the location and orientation of a local surface patch at the contact point between the slave and the environment. We describe the various information sources with their respective limitations and create a combined model estimator as part of a multi-d.o.f. model-mediated controller. An experiment demonstrates the feasibility and benefits of utilizing vision sensors in teleoperation.

[1]  Jean-Jacques E. Slotine,et al.  Stable Adaptive Teleoperation , 1990, 1990 American Control Conference.

[2]  Dominiek Reynaerts,et al.  A Pragmatic Method for Stable Stiffness Reflection in Telesurgery , 2008, EuroHaptics.

[3]  R.P. Paul,et al.  Efficient control of a robotic system for time-delayed environments , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[4]  Hendrik Van Brussel,et al.  Stability of Model-Mediated Teleoperation: Discussion and Experiments , 2012, EuroHaptics.

[5]  Probal Mitra,et al.  Model mediation for time-delayed teleoperation , 2008 .

[6]  Hendrik Van Brussel,et al.  Enhanced Haptic Sensitivity for Soft Tissues using Teleoperation with Shaped Impedance Reflection , 2005 .

[7]  Allison M. Okamura,et al.  Environment Parameter Estimation during Bilateral Telemanipulation , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[8]  Kuu-young Young,et al.  Challenges in VR-based robot teleoperation , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[9]  Homayoun Seraji,et al.  Force Tracking in Impedance Control , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[10]  Martin Buss,et al.  Improvement of model-mediated teleoperation using a new hybrid environment estimation technique , 2010, 2010 IEEE International Conference on Robotics and Automation.

[11]  Dominiek Reynaerts,et al.  A Multi-Purpose Haptic D Device for Research on Physical Human-Robot Interaction , 2012 .

[12]  R. W. Daniel,et al.  Fundamental Limits of Performance for Force Reflecting Teleoperation , 1998, Int. J. Robotics Res..

[13]  Probal Mitra,et al.  Model-mediated Telemanipulation , 2008, Int. J. Robotics Res..

[14]  Jan Swevers,et al.  On-line identification of contact dynamics in the presence of geometric uncertainties , 2008, 2008 IEEE International Conference on Robotics and Automation.

[15]  Septimiu E. Salcudean,et al.  Adaptive transparent impedance reflecting teleoperation , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[16]  Blake Hannaford,et al.  A design framework for teleoperators with kinesthetic feedback , 1989, IEEE Trans. Robotics Autom..

[17]  Giovanni Ulivi,et al.  On-line processing of position and force measures for contour identification and robot control , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.