Relaxation by Hopfield network in stereo image matching

Abstract This paper outlines a relaxation approach using the Hopfield neural network for solving the global stereovision matching problem. The primitives used are edge segments. The similarity, smoothness and uniqueness constraints are transformed into the form of an energy function whose minimum value corresponds to the best solution of the problem. We combine two methods: (a) optimization/relaxation [1] and (b) relaxation merit [2] with the above three constraints mapped in an energy function. The main contribution is made (1) by applying a learning strategy in the similarity constraint and (2) by introducing specific conditions to overcome the violation of the smoothness constraint and to avoid the serious problem arising from the required fixation of a disparity limit. So, we improve the stereovision matching process. A better performance of the proposed method is illustrated with a comparative analysis against a classical relaxation method.

[1]  Rama Chellappa,et al.  Artificial Neural Networks for Computer Vision , 1991, Research Notes in Neural Computing.

[2]  Jae Chang Shim,et al.  Stereo correspondence using the Hopfield neural network of a new energy function , 1994, Pattern Recognit..

[3]  Keith E. Price,et al.  Relaxation Matching Techniques-A Comparison , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Takeo Kanade,et al.  Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Thomas S. Huang,et al.  Learning and Feature Selection in Stereo Matching , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Steven W. Zucker,et al.  On the Foundations of Relaxation Labeling Processes , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Kim L. Boyer,et al.  Robust Contour Decomposition Using a Constant Curvature Criterion , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Nasser M. Nasrabadi,et al.  Hopfield network for stereo vision correspondence , 1992, IEEE Trans. Neural Networks.

[9]  Eric Paul Krotkov,et al.  Active Computer Vision by Cooperative Focus and Stereo , 1989, Springer Series in Perception Engineering.

[10]  Theodosios Pavlidis,et al.  Why progress in machine vision is so slow , 1992, Pattern Recognit. Lett..

[11]  Christopher M. Bishop,et al.  Neural Network for Pattern Recognition , 1995 .

[12]  Woo Young Choi,et al.  Stereo matching technique based on the theory of possibility , 1992, Pattern Recognit. Lett..

[13]  Thomas O. Binford,et al.  Depth from Edge and Intensity Based Stereo , 1981, IJCAI.

[14]  Gonzalo Pajares,et al.  A Neural Network model in stereovision matching , 1995, Neural Networks.

[15]  T. Ozanian Approaches for Stereo Matching , 1995 .

[16]  Jake K. Aggarwal,et al.  Stereo Matching in the Presence of Narrow Occluding Objects Using Dynamic Disparity Search , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jia-Guu Leu,et al.  Detecting the dislocations in metal crystals from microscopic images , 1990, Pattern Recognit..

[18]  Gonzalo Pajares Martinsanz Estrategia de solución al problema de la correspondencia en visión estereoscópica por la jerarquía metodológica y la integración de criterios , 1995 .

[19]  R. J. Schalkoff,et al.  ANN Implementation of Stereo Vision Using a Multi-Layer Feedback Architecture , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[20]  Yassine Ruichek,et al.  A neural matching algorithm for 3-D reconstruction from stereo pairs of linear images , 1996, Pattern Recognit. Lett..

[21]  Alireza Khotanzad,et al.  Stereopsis by constraint learning feed-forward neural networks , 1993, IEEE Trans. Neural Networks.

[22]  Gonzalo Pajares,et al.  Stereo matching technique based on the perceptron criterion function , 1995, Pattern Recognit. Lett..

[23]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[24]  Martin A. Fischler,et al.  Computational Stereo , 1982, CSUR.

[25]  William J. Christmas,et al.  Structural Matching in Computer Vision Using Probabilistic Relaxation , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[27]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[28]  Thomas M. Breuel,et al.  Finding lines under bounded error , 1996, Pattern Recognit..

[29]  Azriel Rosenfeld,et al.  Scene Labeling by Relaxation Operations , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[30]  D. Maravall,et al.  Contribution to the matching problem in stereovision , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[31]  Shmuel Peleg,et al.  Stereo by Incremental Matching of Contours , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Robert M. Haralick,et al.  Structural Descriptions and Inexact Matching , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[35]  Anil K. Jain,et al.  Analysis and Interpretation of Range Images , 1989, Springer Series in Perception Engineering.

[36]  W. Eric L. Grimson,et al.  Computational Experiments with a Feature Based Stereo Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Nasser M. Nasrabadi A Stereo Vision Technique Using Curve-Segments and Relaxation Matching , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Pilar Rubio RP: un algoritmo eficiente para la búsqueda de correspondencias en visión estereoscópica , 1993 .

[40]  E. R. Haddow,et al.  A parallel binocular stereo algorithm utilizing dynamic programming and relaxation labelling , 1987 .

[41]  Shmuel Peleg,et al.  A New Probabilistic Relaxation Scheme , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Shuichi Tanaka,et al.  A rule-based approach to binocular stereopsis , 1988 .

[43]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[44]  Dong Hyun Kim,et al.  Analysis of quantization error in line-based stereo matching , 1994, Pattern Recognit..

[45]  Azriel Rosenfeld,et al.  Point pattern matching by relaxation , 1980, Pattern Recognit..

[46]  Gruia-Catalin Roman,et al.  A parallel algorithm for incremental stereo matching on SIMD machines , 1991, IEEE Trans. Robotics Autom..

[47]  Narendra Ahuja,et al.  Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[49]  Vipin Kumar,et al.  Parallel Algorithms for Machine Intelligence and Vision , 2011, Symbolic Computation.

[50]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[51]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[52]  Azriel Rosenfeld,et al.  Some experiments in relaxation image matching using corner features , 1983, Pattern Recognit..

[53]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[54]  K. Ramesh Babu,et al.  Linear Feature Extraction and Description , 1979, IJCAI.

[55]  Wen-Hsiang Tsai,et al.  Relaxation by the Hopfield neural network , 1992, Pattern Recognit..

[56]  Kim L. Boyer,et al.  Structural Stereopsis for 3-D Vision , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[58]  Jake K. Aggarwal,et al.  Positioning three-dimensional objects using stereo images , 1987, IEEE J. Robotics Autom..

[59]  Gérard G. Medioni,et al.  Detection of Intensity Changes with Subpixel Accuracy Using Laplacian-Gaussian Masks , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.