A hybrid scheme incorporating stereo-matching and shape-from-shading for spatial object recognition

Abstract Manufacturing flexibility can benefit from the use of non-contact computer-vision based shape-recovery methods. In this paper, a novel hybrid scheme is proposed, which combines stereo-vision and shape-from-shading recovery for obtaining more reliable absolute shape information about a viewed object. This iterative scheme first utilizes stereo-vision to obtain basic depth information along the boundary and through the surface of the object. Subsequently, the depth map is input to the shape-from-shading algorithm to obtain feature patterns. This information is fed back to the stereo-vision algorithm to improve upon the accuracy of the depth map. A cost function, in the form of a weighted sum of distances from smoothness and brightness, is utilized for the pattern matching. The performance of the proposed scheme was verified via experiments.

[1]  C.-C. Jay Kuo,et al.  Shape from Photometric Ratio and Stereo , 1996, J. Vis. Commun. Image Represent..

[2]  Guangjun Zhang,et al.  Modeling and Calibration of Grid Structured Light Based 3-D Vision Inspection , 2000 .

[3]  Martin Loftus,et al.  A new approach to reverse engineering based on vision information , 1998 .

[4]  Tony P. Pridmore,et al.  Geometrical Modeling from Multiple Stereo Views , 1989, Int. J. Robotics Res..

[5]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[6]  Santanu Das,et al.  3D tool wear measurement and visualisation using stereo imaging , 1997 .

[7]  Alfred M. Bruckstein,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[8]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[9]  Arthur Robert Weeks,et al.  The Pocket Handbook of Image Processing Algorithms In C , 1993 .

[10]  Berthold K. P. Horn.  Height and gradient from shading , 1989, International Journal of Computer Vision.