Photometric Visual Servoing

This paper proposes a new way to achieve robotic tasks by two-dimensional (2-D) visual servoing. Indeed, instead of using classical geometric features such as points, straight lines, pose, or a homography, as is usually done, the luminance of all pixels in the image is considered here. The main advantage of this new approach is that it requires no tracking or matching process. The key point of our approach relies on the analytic computation of the interaction matrix. This computation is based either on a temporal luminance-constancy hypothesis or on a reflection model so that complex illumination changes can be considered. Experimental results on positioning and tracking tasks validate the proposed approach and show its robustness to approximated depths, low-textured objects, partial occlusions, and specular scenes. They also showed that luminance leads to lower positioning errors than a classical visual servoing based on 2-D geometric visual features.

[1]  P. Beckmann,et al.  The scattering of electromagnetic waves from rough surfaces , 1963 .

[2]  K. Torrance,et al.  Theory for off-specular reflection from roughened surfaces , 1967 .

[3]  J. Reichman Determination of absorption and scattering coefficients for nonhomogeneous media. 1: theory. , 1973, Applied optics.

[4]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[5]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[6]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[7]  Katsushi Ikeuchi,et al.  Determining Surface Orientations of Specular Surfaces by Using the Photometric Stereo Method , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[9]  Tomaso A. Poggio,et al.  Motion Field and Optical Flow: Qualitative Properties , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Patrick Rives,et al.  Positioning of a robot with respect to an object, tracking it and estimating its velocity by visual servoing , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[11]  Hidenori Kimura,et al.  LQ OPTIMAL AND NONLINEAR APPROACHES TO VISUAL SERVOING , 1993 .

[12]  Peter W. Hallinan A low-dimensional representation of human faces for arbitrary lighting conditions , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Nikolaos Papanikolopoulos,et al.  Selection of features and evaluation of visual measurements during robotic visual servoing tasks , 1995, J. Intell. Robotic Syst..

[14]  Giulio Sandini,et al.  Camera self orientation and docking maneuver using normal flow , 1995, Defense, Security, and Sensing.

[15]  Patrick Bouthemy,et al.  Exploiting Image Motion for Active Vision in a Visual Servoing Framework , 1996, Int. J. Robotics Res..

[16]  Hiroshi Murase,et al.  Subspace methods for robot vision , 1996, IEEE Trans. Robotics Autom..

[17]  Giulio Sandini,et al.  Visual Behaviors for Docking , 1997, Comput. Vis. Image Underst..

[18]  William J. Wilson,et al.  Automatic selection of image features for visual servoing , 1997, IEEE Trans. Robotics Autom..

[19]  Shahriar Negahdaripour,et al.  Revised Definition of Optical Flow: Integration of Radiometric and Geometric Cues for Dynamic Scene Analysis , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Marco La Cascia,et al.  Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  David J. Fleet,et al.  Robustly Estimating Changes in Image Appearance , 2000, Comput. Vis. Image Underst..

[23]  David J. Fleet,et al.  Computing Optical Flow with Physical Models of Brightness Variation , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  François Chaumette,et al.  Visual Servoing Based on Image Motion , 2001, Int. J. Robotics Res..

[25]  Ezio Malis,et al.  Improving vision-based control using efficient second-order minimization techniques , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[26]  Koichiro Deguchi,et al.  A Direct Interpretation of Dynamic Images with Camera and Object Motions for Vision Guided Robot Control , 2000, International Journal of Computer Vision.

[27]  Guillaume Morel,et al.  Extended-2D visual servoing , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[28]  Jean-Thierry Lapresté,et al.  A Hessian approach to visual servoing , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[29]  Selim Benhimane,et al.  A unified approach to visual tracking and servoing , 2005, Robotics Auton. Syst..

[30]  Éric Marchand,et al.  Feature tracking for visual servoing purposes , 2005, Robotics Auton. Syst..

[31]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[32]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[33]  Éric Marchand,et al.  Statistically robust 2-D visual servoing , 2006, IEEE Transactions on Robotics.

[34]  Selim Benhimane,et al.  Homography-based 2D Visual Tracking and Servoing , 2007, Int. J. Robotics Res..

[35]  Gregory D. Hager,et al.  Kernel-based visual servoing , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Geraldo F. Silveira,et al.  Real-time Visual Tracking under Arbitrary Illumination Changes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  C. V. Jawahar,et al.  Visual servoing based on Gaussian mixture models , 2008, 2008 IEEE International Conference on Robotics and Automation.

[38]  Christophe Collewet,et al.  Visual servoing set free from image processing , 2008, 2008 IEEE International Conference on Robotics and Automation.

[39]  Christophe Collewet,et al.  Modeling complex luminance variations for target tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  François Chaumette,et al.  Visual Servoing and Visual Tracking , 2008, Springer Handbook of Robotics.

[41]  Omar Tahri,et al.  On the efficient second order minimization and image-based visual servoing , 2008, 2008 IEEE International Conference on Robotics and Automation.

[42]  Christophe Collewet,et al.  Photometry-based visual servoing using light reflexion models , 2009, 2009 IEEE International Conference on Robotics and Automation.

[43]  Éric Marchand,et al.  Entropy-based visual servoing , 2009, 2009 IEEE International Conference on Robotics and Automation.