Determining the camera to robot-body transformation from planar mirror reflections

This paper presents a method for estimating the six-degrees-of-freedom transformation between a camera and the body of the robot on which it is rigidly attached. The robot maneuvers in front of a planar mirror, allowing the camera to observe fiducial features on the robot from several vantage points. Exploiting these measurements, we form a maximum-likelihood estimate of the camera-to-body transformation, without assuming prior knowledge of the robot motion or of the mirror configuration. Additionally, we estimate the mirror configuration with respect to the camera for each image. We validate the accuracy and correctness of our method with simulations and real-world experiments.

[1]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[2]  Stergios I. Roumeliotis,et al.  A Kalman Filter-Based Algorithm for IMU-Camera Calibration: Observability Analysis and Performance Evaluation , 2008, IEEE Transactions on Robotics.

[3]  Ivar Balslev,et al.  Mirror-based trinocular systems in robot-vision , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Kanbara Masayuki,et al.  3D Scene Reconstruction from Reflection Images in a Spherical Mirror , 2006 .

[5]  Joel A. Hesch,et al.  Camera to Robot-body Calibration Using Planar Mirror Reflections , 2008 .

[6]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[7]  K..  Sphereo : Determining Depth using Two Specular Spheres and a Single Camera , 1988 .

[8]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[9]  Olivier Strauss,et al.  Calibration of a multi-sensor system laser rangefinder/camera , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[10]  R. Siegwart,et al.  Observability Properties and Optimal Trajectories for On-line Odometry Self-Calibration , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[11]  Radu Horaud,et al.  Robot Hand-Eye Calibration Using Structure-from-Motion , 2001, Int. J. Robotics Res..

[12]  A. Krener,et al.  Nonlinear controllability and observability , 1977 .

[13]  Xavier Brun,et al.  Modeling and Calibration of Coupled Fish-Eye CCD Camera and Laser Range Scanner for Outdoor Environment Reconstruction , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[14]  In So Kweon,et al.  Single Camera Catadioptric Stereo System , 2005, ICCV 2005.

[15]  Shree K. Nayar,et al.  Planar catadioptric stereo: geometry and calibration , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  Yiu Cheung Shiu,et al.  Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB , 1989, IEEE Trans. Robotics Autom..

[17]  B. Scassellati,et al.  A Bayesian Robot That Distinguishes "Self" from "Other" , 2007 .

[18]  Stergios I. Roumeliotis,et al.  1|A Kalman filter-based algorithm for IMU-camera calibration , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Dong Hoon Lee,et al.  A moving planar mirror based approach for cultural reconstruction , 2004, Comput. Animat. Virtual Worlds.

[20]  N. Trawny,et al.  Indirect Kalman Filter for 3 D Attitude Estimation , 2005 .

[21]  Jack C. K. Chou,et al.  Finding the Position and Orientation of a Sensor on a Robot Manipulator Using Quaternions , 1991, Int. J. Robotics Res..

[22]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[24]  A. Ardeshir Goshtasby,et al.  Design of a single-lens stereo camera system , 1993, Pattern Recognit..

[25]  Masayuki Inaba,et al.  A stereo viewer based on a single camera with view-control mechanisms , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[26]  A. Wurz-Wessel,et al.  Calibration of a free-form surface mirror in a stereo vision system , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[27]  Robert Pless,et al.  Extrinsic calibration of a camera and laser range finder (improves camera calibration) , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).