Theoretical foundation of the intersecting cortical model and its use for change detection of aircraft, cars, and nuclear explosion tests

The intersecting cortical model (ICM) is a model based on neural network techniques especially designed for image processing. It was derived from several visual cortex models and is basically the intersection of these models, i.e. the common elements amongst these models. The theoretical foundation of the ICM is given and it is shown how the ICM can be derived as a reduced set of equations of the pulse-coupled neural network based upon models proposed by Eckhorn and Reitboeck.Tests of the ICM are presented: one on a series of images of an aircraft moving in the sky; two on car detection; and one on preparations of underground nuclear explosions.The ICM is shown here, in a few examples, to be useful in imagery change detection: aircraft moving against a homogeneous background without precise geometric matching; car on a road; two cars moving in an urban setting without precise geometric matching; and for a linear structure in a complex background. The ICM can be used when the moving objects are not too small and the background is not too difficult. Changes involving larger linear structures can be detected even if the background is not homogeneous.

[1]  J. Potter.  Scene segmentation using motion information , 1977 .

[2]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[3]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[4]  J. Sethian,et al.  A level set approach to a unified model for etching, deposition, and lithography II: three-dimensional simulations , 1995 .

[5]  Oberdan Parodi,et al.  Temporal coding in vision: coding by the spike arrival times leads to oscillations in the case of moving targets , 1996, Biological Cybernetics.

[6]  Thomas Lindblad,et al.  Parameter adaptation in a simplified pulse-coupled neural network , 1999, Other Conferences.

[7]  W. Eric L. Grimson,et al.  Using adaptive tracking to classify and monitor activities in a site , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[8]  Yee-Hong Yang,et al.  Experimental evaluation of motion constraint equations , 1991, CVGIP Image Underst..

[9]  Rudolf Mester,et al.  Detection and description of moving objects by stochastic modelling and analysis of complex scenes , 1996, Signal Process. Image Commun..

[10]  H. John Caulfield,et al.  Pulse-coupled neural network sensor fusion , 1998, Defense, Security, and Sensing.

[11]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  J. Sethian,et al.  Dynamical behaviour of a premixed turbulent open V-flame , 1995 .

[13]  James A. Sethian,et al.  A Level Set Approach to a Unified Model for Etching, Deposition, and Lithography I: Algorithms and T , 1995 .

[14]  Jason M. Kinser,et al.  Image object signatures from centripetal autowaves , 2000, Pattern Recognit. Lett..

[15]  H.C.S. Rughooputh,et al.  Neural network based automated texture classification system , 2000, Electronic Imaging.

[16]  John L. Johnson,et al.  Guest Editorial Overview Of Pulse Coupled Neural Network (PCNN) Special Issue , 1999, IEEE Trans. Neural Networks.

[17]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Sudeep Sarkar,et al.  Perceptual Organization Based Computational Model for Robust Segmentation of Moving Objects , 2002, Comput. Vis. Image Underst..

[19]  Ramesh C. Jain,et al.  On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  James A. Sethian,et al.  Level Set Methods for Curvature Flow, Image Enchancement, and Shape Recovery in Medical Images , 1997, VisMath.

[21]  John L. Johnson,et al.  Stabilized input with a feedback pulse‐coupled neural network , 1996 .

[22]  Ramesh C. Jain,et al.  Separating Non-Stationary from Stationary Scene Components in a Sequence of Real World TV Images , 1977, IJCAI.

[23]  S. Yoshizawa,et al.  An Active Pulse Transmission Line Simulating Nerve Axon , 1962, Proceedings of the IRE.

[24]  Jason M. Kinser,et al.  The intersecting cortical model in image processing , 2004 .

[25]  Jake K. Aggarwal,et al.  Segmentation through the detection of changes due to motion , 1979 .

[26]  Reinhard Eckhorn,et al.  Feature Linking via Synchronization among Distributed Assemblies: Simulations of Results from Cat Visual Cortex , 1990, Neural Computation.

[27]  J. L. Johnson,et al.  Observation of periodic waves in a pulse-coupled neural network. , 1993, Optics letters.

[28]  D. Chopp.  Computing Minimal Surfaces via Level Set Curvature Flow , 1993 .

[29]  R. FitzHugh.  Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[30]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[31]  John L. Johnson.  Pulse-coupled neural networks can benefit ATR , 1999, Other Conferences.

[32]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[33]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Jason M. Kinser,et al.  Simplified pulse-coupled neural network , 1996, Defense + Commercial Sensing.

[35]  Ilya A. Rybak,et al.  The model of a neural network visual preprocessor , 1992, Neurocomputing.

[36]  Jason M. Kinser,et al.  Image Processing using Pulse-Coupled Neural Networks , 1998, Perspectives in Neural Computing.

[37]  W. Reichardt.  Autokorrelations-Auswertung als Funktionsprinzip des Zentralnervensystems , 1957 .

[38]  J. Sethian.  Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[39]  Ashraf Elnagar,et al.  Motion detection using background constraints , 1995, Pattern Recognit..

[40]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  J. Sethian,et al.  Projection methods coupled to level set interface techniques , 1992 .

[42]  Larry S. Davis,et al.  Detection of Independent Motion Using Directional Motion Estimation , 1999, Comput. Vis. Image Underst..

[43]  Jason M. Kinser,et al.  Pulse image processing using centripetal autowaves , 2000, SPIE Defense + Commercial Sensing.

[44]  Ramesh C. Jain,et al.  An approach to the segmentation of textured dynamic scenes , 1983, Comput. Vis. Graph. Image Process..

[45]  DeLiang Wang,et al.  Emergent synchrony in locally coupled neural oscillators , 1995, IEEE Trans. Neural Networks.

[46]  A. Winfree.  Varieties of spiral wave behavior: An experimentalist's approach to the theory of excitable media. , 1991, Chaos.

[47]  Jason M. Kinser.  Future projects in pulse image processing , 1999, Other Conferences.

[48]  M. Grayson.  The heat equation shrinks embedded plane curves to round points , 1987 .

[49]  Minas E. Spetsakis,et al.  Structure from motion using line correspondences , 1990, International Journal of Computer Vision.

[50]  Atsushi Imiya,et al.  Randomized polygon search for planar motion detection , 1996, Pattern Recognit. Lett..

[51]  James A. Sethian,et al.  Flow under Curvature: Singularity Formation, Minimal Surfaces, and Geodesics , 1993, Exp. Math..