Invariant pattern recognition: A review

In this document we review and compare some of the classical and modern techniques for solving the problem of invariant pattern recognition. Such techniques include integral transforms, construction of algebraic moments and the use of structured neural networks. In all cases we assume that the nature of the invariance group is known a priori. Many of the methods described apply to specific geometrical transformation groups; however some of the techniques are highly general and applicable to large classes of invariance groups. We also review some results regarding the existence and structure of invariants under certain kinds of groups.

[1]  J. Richardson.  PATTERN RECOGNITION AND GROUP THEORY , 1972 .

[2]  J. C. Dunn.  Continuous Group Averaging and Pattern Classification Problems , 1973, SIAM J. Comput..

[3]  Peter D. Welch,et al.  The Fast Fourier Transform and Its Applications , 1969 .

[4]  Scale-rotation invariant pattern recognition applied to image data compression , 1988, Pattern Recognit. Lett..

[5]  John Shawe-Taylor,et al.  Symmetries and discriminability in feedforward network architectures , 1993, IEEE Trans. Neural Networks.

[6]  F. Fallside,et al.  Neural networks for signal processing : proceedings of the 1991 IEEE workshop , 1991 .

[7]  Henry Stark,et al.  Three - Dimensional Object Recognition From Multiple Views , 1987, Other Conferences.

[8]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[9]  Colin Giles,et al.  Learning, invariance, and generalization in high-order neural networks. , 1987, Applied optics.

[10]  Rama Chellappa,et al.  A higher-order neural network for distortion invariant pattern recognition , 1992, Pattern Recognit. Lett..

[11]  Ronald N. Bracewell,et al.  The Fourier Transform and Its Applications , 1966 .

[12]  Kemal Oflazer,et al.  A rotation, scaling, and translation invariant pattern classification system , 1993, Pattern Recognit..

[13]  Harry Wechsler,et al.  Invariance in Pattern Recognition , 1987 .

[14]  Michael Thompson,et al.  Frontiers of Pattern Recognition , 1975 .

[15]  Michael Spann,et al.  A comparison between Fourier-Mellin descriptors and moment based features for invariant object recognition using neural networks , 1991, Pattern Recognit. Lett..

[16]  W. Scott,et al.  Group Theory. , 1964 .

[17]  David Lovell,et al.  The neocognitron as a system for handwritten character recognition : limitations and improvements , 1994 .

[18]  R. Gilmore,et al.  Lie Groups, Lie Algebras, and Some of Their Applications , 1974 .

[19]  M. Golubitsky,et al.  Singularities and groups in bifurcation theory , 1985 .

[20]  Kemal Oflazer,et al.  A rotation, scaling and translation invariant pattern classification system , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[21]  Hee-Yeung Hwang,et al.  Scale and rotation invariant pattern recognition using complex-log mapping and augmented second order neural network , 1993 .

[22]  L. Marton,et al.  Advances in Electronics and Electron Physics , 1958 .

[23]  Andrej Dobnikar,et al.  Invariant pattern classification neural network versus FT approach , 1992, Microprocess. Microprogramming.

[24]  C. Chevalley.  Theory of Lie Groups , 1946 .

[25]  Yajun Li,et al.  Reforming the theory of invariant moments for pattern recognition , 1992, Pattern Recognit..

[26]  W. Ledermann.  Introduction to Group Characters , 1977 .

[27]  Paulo J. G. Lisboa,et al.  Translation, rotation, and scale invariant pattern recognition by high-order neural networks and moment classifiers , 1992, IEEE Trans. Neural Networks.

[28]  Meghanad D. Wagh,et al.  A class of translation invariant transforms , 1977 .

[29]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[30]  Yann LeCun,et al.  Generalization and network design strategies , 1989 .

[31]  P. S. Moharir,et al.  Pattern-recognition transforms , 1992 .

[32]  Jan Flusser,et al.  Pattern recognition by affine moment invariants , 1993, Pattern Recognit..

[33]  R. Duren,et al.  A comparison of second-order neural networks to transform-based method for translation- and orientation-invariant object recognition , 1991, Neural Networks for Signal Processing Proceedings of the 1991 IEEE Workshop.

[34]  Minoru Fukumi,et al.  Rotation-invariant neural pattern recognition system with application to coin recognition , 1992, IEEE Trans. Neural Networks.

[35]  Reiner Lenz,et al.  Group invariant pattern recognition , 1990, Pattern Recognit..

[36]  J Duvernoy,et al.  Circular-Fourier-radial-Mellin transform descriptors for pattern recognition. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[37]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[38]  M. Ferraro,et al.  Relationship between integral transform invariances and Lie group theory , 1988 .

[39]  Noboru Ohnishi,et al.  Augmented multi-layer perceptron for rotation- and scale-invariant hand-written numeral recognition , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[40]  Etienne Barnard,et al.  Shift invariance and the neocognitron , 1990, Neural Networks.

[41]  Michael Clausen,et al.  Fast Fourier transforms , 1993 .

[42]  Russ Duren,et al.  A new neural network architecture for rotationally invariant object recognition , 1991, [1991] Proceedings of the 34th Midwest Symposium on Circuits and Systems.

[43]  Joe Harris,et al.  Representation Theory: A First Course , 1991 .

[44]  Alireza Khotanzad,et al.  Classification of invariant image representations using a neural network , 1990, IEEE Trans. Acoust. Speech Signal Process..

[45]  David A. Pintsov.  Invariant pattern recognition, symmetry, and Radon transforms , 1989 .

[46]  Kunihiko Fukushima,et al.  Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position , 1982, Pattern Recognit..

[47]  H. Arsenault,et al.  Experiments on pattern recognition using invariant Fourier-Mellin descriptors. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[48]  J. Craggs.  Applied Mathematical Sciences , 1973 .

[49]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Stefanos D. Kollias,et al.  Invariant image classification using triple-correlation-based neural networks , 1994, IEEE Trans. Neural Networks.

[51]  Y. H. Huh,et al.  On-line recognition of hand-printed Korean characters , 1982, Pattern Recognit..

[52]  D Casasent,et al.  Hybrid processor to compute invariant moments for pattern recognition. , 1980, Optics letters.

[53]  J Mas,et al.  Symmetry processing in neural network models , 1989 .

[54]  Yunlong Sheng,et al.  Invariant pattern recognition using Fourier-Mellin transforms and neural networks , 1991 .

[55]  Zhi-Qiang Liu,et al.  On the minimum number of templates required for shift, rotation and size invariant pattern recognition , 1988, Pattern Recognit..

[56]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[57]  Yann LeCun,et al.  Tangent Prop - A Formalism for Specifying Selected Invariances in an Adaptive Network , 1991, NIPS.

[58]  Shingo Tomita,et al.  A note on a higher-order neural network for distortion invariant pattern recognition , 1994, Pattern Recognit. Lett..

[59]  J. Shawe-Taylor.  Building symmetries into feedforward networks , 1989 .

[60]  M. I. Kargapolov,et al.  Fundamentals of the theory of groups , 1979 .

[61]  Lilly Spirkovska,et al.  Robust position, scale, and rotation invariant object recognition using higher-order neural networks , 1992, Pattern Recognit..

[62]  D. Casasent,et al.  Position, rotation, and scale invariant optical correlation. , 1976, Applied optics.

[63]  Reiner Lenz,et al.  Group Theoretical Methods in Image Processing , 1990, Lecture Notes in Computer Science.

[64]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[65]  James L. McClelland,et al.  James L. McClelland, David Rumelhart and the PDP Research Group, Parallel distributed processing: explorations in the microstructure of cognition . Vol. 1. Foundations . Vol. 2. Psychological and biological models . Cambridge MA: M.I.T. Press, 1987. , 1989, Journal of Child Language.