3D object reconstruction using stereo and motion

The extraction of reliable range data from images is investigated, considering, as a possible solution, the integration of different sensor modalities. Two different algorithms are used to obtain independent estimates of depth from a sequence of stereo images. The results are integrated on the basis of the uncertainty of each measure. The stereo algorithm uses a coarse-to-fine control strategy to compute disparity. An algorithm for depth-from-motion is used, exploiting the constraint imposed by active motion of the cameras. To obtain a 3D description of the objects, the motion of the cameras is purposefully controlled, in such a manner as to move around the objects in view while the gaze is directed toward a fixed point in space. This egomotion strategy, which is similar to that adopted by the human visuomotor system, allows a better exploration of partially occluded objects and simplifies the motion equations. When tested on real scenes, the algorithm demonstrated a low sensitivity to image noise, mainly due to the integration of independent measures. An experiment performed on a real scene containing several objects is presented. >

[1]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  Olivier Faugeras,et al.  Maintaining representations of the environment of a mobile robot , 1988, IEEE Trans. Robotics Autom..

[3]  Larry H. Matthies,et al.  Kalman filter-based algorithms for estimating depth from image sequences , 1989, International Journal of Computer Vision.

[4]  Berthold K. P. Horn,et al.  Determining Grasp Points Using Photometric Stereo and the PRISM Binocular Stereo System , 1984 .

[5]  Tomaso Poggio,et al.  Probabilistic Solution of Ill-Posed Problems in Computational Vision , 1987 .

[6]  Lina Massone,et al.  Shape From Occluding Contours , 1985, Other Conferences.

[7]  Giulio Sandini,et al.  Uncertainty Analysis In Visual Motion And Depth Estimation From Active Egomotion , 1989, Defense, Security, and Sensing.

[8]  Gérard G. Medioni,et al.  Detection of Intensity Changes with Subpixel Accuracy Using Laplacian-Gaussian Masks , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  T. D. Williams,et al.  Depth from camera motion in a real world scene , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  H. K. Nishihara,et al.  Practical Real-Time Imaging Stereo Matcher , 1984 .

[11]  Verzekeren Naar Sparen,et al.  Cambridge , 1969, Humphrey Burton: In My Own Time.

[12]  Giulio Sandini,et al.  Motor and spatial aspects in artificial vision , 1988 .

[13]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[14]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[15]  Takeo Kanade,et al.  The cycle of uncertainty and constraint in robot perception , 1988 .

[16]  Daryl T. Lawton,et al.  Processing translational motion sequences , 1983, Comput. Vis. Graph. Image Process..

[17]  Katsushi Ikeuchi,et al.  Determining Grasp Configurations using Photometric Stereo and the PRISM Binocular Stereo System , 1986 .

[18]  Giulio Sandini,et al.  Active vision: integration of fixed and mobile cameras , 1988 .

[19]  Daphna Weinshall,et al.  The MIT vision machine , 1988 .

[20]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[21]  Thomas M. Strat,et al.  One-Eyed Stereo: A General Approach to Modeling 3-D Scene Geometry , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yuan-Fang Wang,et al.  Matching Three-Dimensional Objects Using Silhouettes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Giulio Sandini,et al.  Extraction of 3-D Information and Volumetric Uncertainty from Multiple Stereo Images , 1988, ECAI.

[24]  Dana H. Ballard,et al.  ACTIVE NAVIGATION: TRACKING AN ENVIRONMENTAL POINT CONSIDERED BENEFICIAL. , 1986 .

[25]  Giulio Sandini,et al.  Analysis of object motion and camera motion in real scenes , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[26]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[27]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..