Learning Lateral Interactions for Feature Binding and Sensory Segmentation

We present a hybrid learning method bridging the fields of recurrent neural networks, unsupervised Hebbian learning, vector quantization, and supervised learning to implement a sophisticated image and feature segmentation architecture. This architecture is based on the competitive layer model (CLM), a dynamic feature binding model, which is applicable on a wide range of perceptual grouping and segmentation problems. A predefined target segmentation can be achieved as attractor states of this linear threshold recurrent network, if the lateral weights are chosen by Hebbian learning. The weight matrix is given by the correlation matrix of special pattern vectors with a structure dependent on the target labeling. Generalization is achieved by applying vector quantization on pair-wise feature relations, like proximity and similarity, defined by external knowledge. We show the successful application of the method to a number of artifical test examples and a medical image segmentation problem of fluorescence microscope cell images.

[1]  C. von der Malsburg The what and why of binding: the modeler's perspective. , 1999, Neuron.

[2]  Richard Hans Robert Hahnloser,et al.  Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit , 2000, Nature.

[3]  DeLiang Wang,et al.  Texture segmentation using Gaussian-Markov random fields and neural oscillator networks , 2001, IEEE Trans. Neural Networks.

[4]  DeLiang Wang,et al.  Image Segmentation Based on Oscillatory Correlation , 1997, Neural Computation.

[5]  Heiko Wersing,et al.  A computational feature binding model of human texture perception , 2004, Cognitive Processing.

[6]  Longin Jan Latecki,et al.  Application of planar shape comparison to object retrieval in image databases , 2002, Pattern Recognit..

[7]  Heiko Wersing,et al.  A Competitive-Layer Model for Feature Binding and Sensory Segmentation , 2001, Neural Computation.

[8]  Steven W. Zucker,et al.  On the Foundations of Relaxation Labeling Processes , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jochen J. Steil,et al.  Data Driven Generation of Interactions for Feature Binding and Relaxation Labeling , 2002, ICANN.

[10]  Azriel Rosenfeld,et al.  Scene Labeling by Relaxation Operations , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Pau-Choo Chung,et al.  Polygonal approximation using a competitive Hopfield neural network , 1994, Pattern Recognit..

[12]  Shmuel Peleg,et al.  Determining Compatibility Coefficients for Curve Enhancement Relaxation Processes , 1978 .

[13]  Marcello Pelillo,et al.  Learning Compatibility Coefficients for Relaxation Labeling Processes , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Daihee Park,et al.  On the Design of BSB Neural Associative Memories Using Semidefinite Programming , 1999, Neural Computation.

[15]  Xiaohui Xie,et al.  Learning Winner-take-all Competition Between Groups of Neurons in Lateral Inhibitory Networks , 2000, NIPS.

[16]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[17]  William Nick Street,et al.  An adaptive resource-allocating network for automated detection, segmentation, and classification of breast cancer nuclei topic area: image processing and recognition , 2003, IEEE Trans. Neural Networks.

[18]  Heiko Wersing,et al.  A neural network architecture for automatic segmentation of fluorescence micrographs , 2002, ESANN.

[19]  Richard S. Zemel,et al.  Learning to Segment Images Using Dynamic Feature Binding , 1991, Neural Computation.

[20]  Renzo Perfetti,et al.  A synthesis procedure for brain-state-in-a-box neural networks , 1995, IEEE Trans. Neural Networks.

[21]  Chuan-Yu Chang,et al.  Medical image segmentation using a contextual-constraint-based Hopfield neural cube , 2001, Image Vis. Comput..

[22]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[23]  J. Kittler,et al.  RELAXATION LABELING ALGORITHMS - A REVIEW , 1985 .

[24]  Jooyoung Park,et al.  Design of GBSB neural associative memories using semidefinite programming , 1999, IEEE Trans. Neural Networks.

[25]  Heiko Wersing,et al.  Dynamical Stability Conditions for Recurrent Neural Networks with Unsaturating Piecewise Linear Transfer Functions , 2001, Neural Computation.

[26]  Risto Miikkulainen,et al.  Topographic Receptive Fields and Patterned Lateral Interaction in a Self-Organizing Model of the Primary Visual Cortex , 1997, Neural Computation.

[27]  Heiko Wersing Spatial feature binding and learning in competitive neural layer architectures , 2000 .

[28]  Josef Kittler,et al.  Relaxation labelling algorithms - a review , 1986, Image Vis. Comput..

[29]  Helge J. Ritter,et al.  A neural classifier enabling high-throughput topological analysis of lymphocytes in tissue sections , 2001, IEEE Transactions on Information Technology in Biomedicine.

[30]  Risto Miikkulainen,et al.  Self-organization and segmentation in a laterally connected orientation map of spiking neurons , 1998, Neurocomputing.

[31]  Joachim M. Buhmann,et al.  Unsupervised Texture Segmentation in a Deterministic Annealing Framework , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Zhaoping Li,et al.  A Neural Model of Contour Integration in the Primary Visual Cortex , 1998, Neural Computation.

[33]  Helge Ritter,et al.  A Spatial Approach to Feature Linking , 1990 .