Range surface characterization and segmentation using neural networks

Abstract This paper presents an integrated neural net-based approach to the segmentation of range images into distinct surfaces, which is an essential step in range image analysis and interpretation. A two-stage connectionist neural net model is proposed which extracts local surface features at each image point and groups pixels via local interactions among different features. The first stage computes surface parameters, e.g., surface normals, curvature and discontinuities (crease and jump) by optimally projecting the local range profile onto a set of non-orthogonal basis functions. In the second stage, adjacent pixels compete with each other based on the surface features associated with them to group themselves into different surface patches. Daugman's projection neural net (DPNN) and Kohonen's self-organizing neural net (KSNN) are used for the feature extraction and region-growing, respectively. Empirical performance analysis shows that the feature extraction using neural net is quite robust with respect to the additive noise. Experimental results are included to demonstrate the performance of the proposed technique.

[1]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[2]  John Daugman,et al.  Neural networks for image transformation, analysis, and compression , 1988, Neural Networks.

[3]  Rama Chellappa,et al.  Stochastic and deterministic networks for texture segmentation , 1990, IEEE Trans. Acoust. Speech Signal Process..

[4]  Michael Brady,et al.  Computational Approaches to Image Understanding , 1982, CSUR.

[5]  Alireza Khotanzad,et al.  Classification of invariant image representations using a neural network , 1990, IEEE Trans. Acoust. Speech Signal Process..

[6]  Naokazu Yokoya,et al.  Range Image Segmentation Based on Differential Geometry: A Hybrid Approach , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  H. Tunley,et al.  Dynamic image segmentation and optic flow extraction , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[8]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[9]  Anil K. Jain,et al.  MRF model-based segmentation of range images , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[10]  Anil K. Jain,et al.  Segmentation and Classification of Range Images , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Sugata Ghosal,et al.  Segmentation of range images: an orthogonal moment-based integrated approach , 1993, IEEE Trans. Robotics Autom..

[12]  Michael A. Arbib,et al.  A biologically inspired neural network model for 3-D motion detection , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[13]  D. A. Fay,et al.  Real-time early vision neurocomputing , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[14]  Yoshiaki Shirai,et al.  Object Recognition Using Three-Dimensional Information , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Rama Chellappa,et al.  A unified approach to boundary perception: edges, textures, and illusory contours , 1993, IEEE Trans. Neural Networks.

[16]  Ramakant Nevatia,et al.  Structured Descriptions of Complex Objects , 1973, IJCAI.

[17]  Jean-Michel Jolion,et al.  Robust Clustering with Applications in Computer Vision , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Thomas C. Henderson Efficient 3-D Object Representations for Industrial Vision Systems , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Mitsuo Kawato,et al.  Computational theory and neural network model of perceiving shape from shading in monocular depth perception , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[20]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Wesley E. Snyder,et al.  Closing gaps in edges and surfaces , 1992, Image Vis. Comput..

[22]  Yoshiaki Shirai,et al.  Recognition of polyhedrons with a range finder , 1971, IJCAI.