A Comparative Study of Eye-In-Hand Image-Based Visual Servoing: Stereo vs. Mono

Visual control of manipulators provides significant advantages when working with targets with unknown positions. Among all visual servoing categories, the stereo visual servoing has shown to be very effective when dealing with unstructured environments. In this paper a comparative study of eye-in-hand image-based visual servoing (IBVS) for two approaches of stereo and mono vision is presented and various cases of control schemes, and tracking and prediction algorithms are studied. In this study the vision systems are considered to be mounted on the end-effector of a 6 degrees of freedom (DOF) manipulator robot. Additionally, a method for position prediction and trajectory estimation of the moving target in order to use in a real-time catching task is proposed and developed using Kalman Filter and Extended Kalman Filter (EKF) as the trajectory estimators. Using the proposed estimation methods, the quality of the visual servoing in a catching procedure using a 6-DOF manipulator robot is compared for mono and stereo visual servoing systems. Finally, by applying the newly introduced acceleration command-based controller (AIBVS) to the visual servoing system, the results for both cases are presented to compare the effects on the quality of servoing tasks. The aforementioned scenarios of visual servoing are simulated and implemented based on a 6-DOF DENSO 6242G robot.

[1]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[2]  Zhao Jie,et al.  A Real-time Stereo Visual Servoing for Moving Object Grasping Based Parallel Algorithms , 2007, 2007 2nd IEEE Conference on Industrial Electronics and Applications.

[3]  Fumio Miyazaki,et al.  Tracking and catching of 3d flying target based on gag strategy , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[4]  Abolfazl Mohebbi,et al.  Augmented Image-Based Visual Servoing of a Manipulator Using Acceleration Command , 2014, IEEE Transactions on Industrial Electronics.

[5]  Y. Chan,et al.  A Kalman Filter Based Tracking Scheme with Input Estimation , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[6]  François Chaumette,et al.  2 1/2 D visual servoing: a possible solution to improve image-based and position-based visual servoings , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[7]  Pedro U. Lima,et al.  A testbed for robotic visual servoing and catching of moving objects , 1998, 1998 IEEE International Conference on Electronics, Circuits and Systems. Surfing the Waves of Science and Technology (Cat. No.98EX196).

[8]  Radu Horaud,et al.  Controlling robots with two cameras: how to do it properly , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[9]  H. Fujimoto,et al.  Proposal of 6 DOF visual servoing of moving object based on real-time distance identification , 2008, 2008 SICE Annual Conference.

[10]  Gregory D. Hager,et al.  Robot hand-eye coordination based on stereo vision , 1995 .

[11]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[12]  Toshiro Noritsugu,et al.  Performance and sensitivity in visual servoing , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[13]  Peter I. Corke,et al.  A robotics toolbox for MATLAB , 1996, IEEE Robotics Autom. Mag..

[14]  Peter K. Allen,et al.  Trajectory filtering and prediction for automated tracking and grasping of a moving object , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[15]  Koichi Hashimoto,et al.  Position based visual servoing for catching a 3-D flying object using RLS trajectory estimation from a monocular image sequence , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[16]  Peter I. Corke.  The Machine Vision Toolbox: a MATLAB toolbox for vision and vision-based control , 2005, IEEE Robotics & Automation Magazine.

[17]  Abolfazl Mohebbi,et al.  An eye-in-hand stereo visual servoing for tracking and catching moving objects , 2014, Proceedings of the 33rd Chinese Control Conference.

[18]  Vincenzo Lippiello,et al.  3D monocular robotic ball catching with an iterative trajectory estimation refinement , 2012, 2012 IEEE International Conference on Robotics and Automation.

[19]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[20]  Greg Welch,et al.  An Introduction to Kalman Filter , 1995, SIGGRAPH 2001.

[21]  Philippe Martinet,et al.  Stacking Jacobians properly in stereo visual servoing , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[22]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[23]  Wen-Fang Xie,et al.  Augmented Imaged Based Visual Servoing controller for a 6 DOF manipulator using acceleration command , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).