Structure From Controlled Motion

This paper deals with the recovery of 3D information using a single mobile camera in the context of active vision. First, we propose a general revisited formulation of the structure-from-known-motion issue. Within the same formalism, we handle various kinds of 3D geometrical primitives such as points, lines, cylinders, spheres, etc. We also aim at minimizing effects of the different measurement errors which are involved in such a process. More precisely, we mathematically determine optimal camera configurations and motions which lead to a robust and accurate estimation of the 3D structure parameters. We apply the visual servoing approach to perform these camera motions using a control law in closed-loop with respect to visual data. Real-time experiments dealing with 3D structure estimation of points and cylinders are reported. They demonstrate that this active vision strategy can very significantly improve the estimation accuracy.

[1]  John K. Tsotsos,et al.  Design and Performance of Trish, a Binocular Robot Head with Torsional Eye Movements , 1993, Int. J. Pattern Recognit. Artif. Intell..

[2]  Samia Boukir,et al.  Optimal estimation of 3D structures using visual servoing , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Giulio Sandini,et al.  Active Tracking Strategy for Monocular Depth Inference over Multiple Frames , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  David Vernon,et al.  Using camera motion to estimate range for robotic parts manipulation , 1990, IEEE Trans. Robotics Autom..

[5]  Dana H. Ballard,et al.  EGOMOTION USING ACTIVE VISION. , 1986 .

[6]  Hans-Hellmut Nagel,et al.  Analytical Results on Error Sensitivity of Motion Estimation from Two Views , 1990, ECCV.

[7]  James L. Crowley,et al.  Layered Control of a Binocular Camera Head , 1993, Int. J. Pattern Recognit. Artif. Intell..

[8]  Didier Juvin,et al.  Cylindrical object reconstruction from a sequence of images , 1992, Other Conferences.

[9]  M. Xie,et al.  Towards dynamic vision , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[10]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[11]  A. Lynn Abbott,et al.  Active surface reconstruction by integrating focus, vergence, stereo, and camera calibration , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[12]  Amar Mitiche,et al.  Interpretation of straight line correspondences using angular relations , 1989, Pattern Recognit..

[13]  Elizabeth R. Stuck,et al.  Detecting Moving Objects Using the Rigidity Constraint , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Jan-Olof Eklundh,et al.  A head-eye system - Analysis and design , 1992, CVGIP Image Underst..

[15]  Liuqing Huang,et al.  Relative depth from motion using normal flow: an active and purposive solution , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[16]  R. Bajcsy.  Active perception , 1988 .

[17]  Christopher M. Brown,et al.  Issues in selective perception , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[18]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[19]  Gilad Adiv,et al.  Inherent Ambiguities in Recovering 3-D Motion and Structure from a Noisy Flow Field , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Giulio Sandini,et al.  Dynamic aspects in active vision , 1992, CVGIP Image Underst..

[21]  J. Oliensis,et al.  Incorporating motion error in multi-frame structure from motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[22]  Yiannis Aloimonos,et al.  Exploratory active vision: theory , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[24]  S. Boukir.  Reconstruction 3D d'un environnement statique par vision active , 1993 .

[25]  Shahriar Negahdaripour,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence , 2004 .

[26]  Koichi Hashimoto,et al.  Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback , 1993 .

[27]  Patrick Rives,et al.  Closed-loop recursive estimation of 3D features for a mobile vision system , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[28]  Hiroshi Ishiguro,et al.  Realizing active vision by a mobile robot , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[29]  T. Vieville,et al.  An example of artificial oculomotor behavior , 1992, Proceedings of the 1992 IEEE International Symposium on Intelligent Control.

[30]  Beno Benhabib,et al.  Three-dimensional location estimation of circular features for machine vision , 1992, IEEE Trans. Robotics Autom..

[31]  Lee E. Weiss,et al.  Dynamic sensor-based control of robots with visual feedback , 1987, IEEE Journal on Robotics and Automation.

[32]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[33]  Amnon Shashua,et al.  Projective depth: A geometric invariant for 3D reconstruction from two perspective/orthographic views and for visual recognition , 1993, 1993 (4th) International Conference on Computer Vision.

[34]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[35]  Jake K. Aggarwal,et al.  Model Construction and Shape Recognition from Occluding Contours , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Narendra Ahuja,et al.  Motion and Structure from Line Correspondences; Closed-Form Solution, Uniqueness, and Optimization , 1992, IEEE Trans. Pattern Anal. Mach. Intell..