A bin picking system based on depth from defocus

Abstract. It is generally accepted that to develop versatile bin-picking systems capable of grasping and manipulation operations, accurate 3-D information is required. To accomplish this goal, we have developed a fast and precise range sensor based on active depth from defocus (DFD). This sensor is used in conjunction with a three-component vision system, which is able to recognize and evaluate the attitude of 3-D objects. The first component performs scene segmentation using an edge-based approach. Since edges are used to detect the object boundaries, a key issue consists of improving the quality of edge detection. The second component attempts to recognize the object placed on the top of the object pile using a model-driven approach in which the segmented surfaces are compared with those stored in the model database. Finally, the attitude of the recognized object is evaluated using an eigenimage approach augmented with range data analysis. The full bin-picking system will be outlined, and a number of experimental results will be examined.

[1]  Ramakant Nevatia,et al.  Recognizing 3-D Objects Using Surface Descriptions , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Ovidiu Ghita,et al.  A REAL-TIME LOW-COST VISION SENSOR FOR ROBOTIC BIN PICKING , 2001 .

[4]  David A. Forsyth,et al.  3D Object Recognition Using Invariance , 1995, Artif. Intell..

[5]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jean Ponce,et al.  Invariant Properties of Straight Homogeneous Generalized Cylinders and Their Contours , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jack Bresenham,et al.  Algorithm for computer control of a digital plotter , 1965, IBM Syst. J..

[8]  Horst Bunke,et al.  Edge Detection in Range Images Based on Scan Line Approximation , 1999, Comput. Vis. Image Underst..

[9]  Jeff L. Edwards.  An active, appearance-based approach to the pose estimation of complex objects , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[10]  Murali Subbarao,et al.  Depth from defocus: A spatial domain approach , 1994, International Journal of Computer Vision.

[11]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[12]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[13]  Max A. Viergever,et al.  Blurring strategies for image segmentation using a multiscale linking model , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  A. Murat Tekalp,et al.  Fusion of color and edge information for improved segmentation and edge linking , 1997, Image Vis. Comput..

[15]  Katsushi Ikeuchi,et al.  Detectability, Uniqueness, and Reliability of Eigen Windows for Stable Verification of Partially Occluded Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Josef Kittler,et al.  Edge-Labeling Using Dictionary-Based Relaxation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[18]  Tony Lindeberg,et al.  Scale selection for differential operators , 1994 .

[19]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Sameer A. Nene,et al.  A simple algorithm for nearest neighbor search in high dimensions , 1997 .

[21]  D. Kriegman,et al.  On recognizing and positioning curved 3D objects from image contours , 1989, [1989] Proceedings. Workshop on Interpretation of 3D Scenes.

[22]  Sanjoy K. Mitter,et al.  A hierarchical approach to high resolution edge contour reconstruction , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Thomas C. Henderson.  Efficient 3-D Object Representations for Industrial Vision Systems , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Alex Pentland,et al.  Simple range cameras based on focal error , 1994 .

[25]  Ramakant Nevatia,et al.  Three-Dimensional Descriptions Based on the Analysis of the Invariant and Quasi-Invariant Properties of Some Curved-Axis Generalized Cylinders , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Paul F. Whelan,et al.  A video-rate range sensor based on depth from defocus , 2001 .

[27]  Jun Shen,et al.  An optimal linear operator for step edge detection , 1992, CVGIP Graph. Model. Image Process..

[28]  T. Lindeberg.  On Scale Selection for Di erential Operators , 1993 .

[29]  David J. Kriegman,et al.  On Recognizing and Positioning Curved 3-D Objects from Image Contours , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Shree K. Nayar,et al.  Real-time focus range sensor , 1995, Proceedings of IEEE International Conference on Computer Vision.

[31]  Santanu Chaudhury,et al.  A new approach for aggregating edge points into line segments , 1993, Pattern Recognit..

[32]  HebertMartial,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999 .

[33]  William H. Press,et al.  Numerical recipes in C , 2002 .

[34]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.

[35]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Azriel Rosenfeld,et al.  3-D Shape Recovery Using Distributed Aspect Matching , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  David G. Lowe,et al.  The viewpoint consistency constraint , 2015, International Journal of Computer Vision.

[38]  Muralidhara Subbarao.  Efficient Depth Recovery through Inverse Optics , 1989 .

[39]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[40]  Fredrik Bergholm,et al.  Edge Focusing , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  IkeuchiKatsushi,et al.  Detectability, Uniqueness, and Reliability of Eigen Windows for Stable Verification of Partially Occluded Objects , 1997 .