State of the art in pattern recognition

This paper reviews statistical, adaptive, and heuristic techniques used in laboratory investigations of pattern recognition problems. The discussion includes correlation methods, discriminant analysis, maximum likelihood decisions minimax techniques, perceptron-like algorithms, feature extraction, preprocessing, clustering and nonsupervised learning. Two-dimensional distributions are used to illustrate the properties of the various procedures. Several experimental projects, representative of prospective applications, are also described.

[1]  R. O. Duda,et al.  TRAINING A THRESHOLD LOGIC UNIT WITH IMPERFECTLY CLASSIFIED PATTERNS , 1944 .

[2]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[3]  R. Penrose.  A Generalized inverse for matrices , 1955 .

[4]  Louis Weinberg,et al.  Automation and Remote Control , 1957 .

[5]  C. K. Chow,et al.  An optimum character recognition system using decision functions , 1957, IRE Trans. Electron. Comput..

[6]  R. Sokal,et al.  A QUANTITATIVE APPROACH TO A PROBLEM IN CLASSIFICATION† , 1957, Evolution; International Journal of Organic Evolution.

[7]  Bernard Gold,et al.  Machine recognition of hand-sent Morse code , 1959, IRE Trans. Inf. Theory.

[8]  W. W. Bledsoe,et al.  Pattern recognition and reading by machine , 1959, IRE-AIEE-ACM '59 (Eastern).

[9]  D J Rogers,et al.  A Computer Program for Classifying Plants. , 1960, Science.

[10]  Worthie Doyle,et al.  Recognition of sloppy, hand-printed characters , 1960, IRE-AIEE-ACM '60 (Western).

[11]  Oliver G. Selfridge,et al.  Pattern recognition by machine , 1960 .

[12]  L. P. Horwitz,et al.  Pattern Recognition Using Autocorrelation , 1961, Proceedings of the IRE.

[13]  Carl Kesler.  ANALYSIS AND SIMULATIONS OF A NERVE CELL MODEL , 1961 .

[14]  Marvin Minsky,et al.  Steps toward Artificial Intelligence , 1995, Proceedings of the IRE.

[15]  Franz L. Alt,et al.  Digital Pattern Recognition by Moments , 1962, JACM.

[16]  W. Highleyman.  Linear Decision Functions, with Application to Pattern Recognition , 1962, Proceedings of the IRE.

[17]  T. W. Anderson,et al.  Classification into two Multivariate Normal Distributions with Different Covariance Matrices , 1962 .

[18]  Stephen Warshall,et al.  A Theorem on Boolean Matrices , 1962, JACM.

[19]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[20]  C. K. Chow,et al.  A Recognition Method Using Neighbor Dependence , 1962, IRE Trans. Electron. Comput..

[21]  Gordon Pask,et al.  The Simulation of Learning and Decision-Making Behavior , 1962 .

[22]  R. O. Winder,et al.  THRESHOLD LOGIC IN ARTIFICIAL INTELLIGENCE , 1962 .

[23]  L. Kanal.  Evaluation of a Class of Pattern-Recognition Networks , 1962 .

[24]  James J. Baker,et al.  A note on multiplying Boolean matrices , 1962, CACM.

[25]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[26]  R. E. Bonner,et al.  A "Logical Pattern" Recognition Program , 1962, IBM J. Res. Dev..

[27]  Frank P. Kuhl,et al.  Classification and recognition of hand-printed characters , 1963 .

[28]  Bruce H. McCormick,et al.  The Illinois Pattern Recognition Computer-ILLIAC III , 1963, IEEE Trans. Electron. Comput..

[29]  Evon C. Greanias,et al.  The Recognition of Handwritten Numerals by Contour Analysis , 1963, IBM J. Res. Dev..

[30]  Nils J. Nilsson,et al.  DETERMINATION AND DETECTION OF FEATURES IN PATTERNS , 1963 .

[31]  Chao-Ning Liu,et al.  Computer-Automated Design of Multifont Print Recognition Logic , 1963, IBM J. Res. Dev..

[32]  James S. Bryan.  Experiments in Adaptive Pattern Recognition , 1963, IEEE Transactions on Military Electronics.

[33]  Wilbur H. Highleyman,et al.  Data for Character Recognition Studies , 1963, IEEE Transactions on Electronic Computers.

[34]  Karl Steinbuch,et al.  Learning Matrices and Their Applications , 1963, IEEE Trans. Electron. Comput..

[35]  C. A. Gaston.  A Simple Test for Linear Separability , 1963, IEEE Trans. Electron. Comput..

[36]  Shuji Doshita,et al.  The Automatic Speech Recognition System for Conversational Sound , 1963, IEEE Trans. Electron. Comput..

[37]  C. J. Tunis,et al.  A Pattern Identification System Using Linear Decision Functions , 1963, IBM Syst. J..

[38]  Karl Steinbuch,et al.  Adaptive Systems in Pattern Recognition , 1963, IEEE Trans. Electron. Comput..

[39]  Pier Giorgio Perotto,et al.  A New Method for Automatic Character Recognition , 1963, IEEE Trans. Electron. Comput..

[40]  Raymond E. Bonner,et al.  On Some Clustering Techniques , 1964, IBM J. Res. Dev..

[41]  M I Bernstein.  COMPUTER RECOGNITION OF ON-LINE, HAND-WRITTEN CHARACTERS , 1964 .

[42]  C. L. Sheng,et al.  A Method for Testing and Realization of Threshold Functions , 1964, IEEE Trans. Electron. Comput..

[43]  King-Sun Fu,et al.  A sequential decision approach to problems in pattern recognition and learning , 1964 .

[44]  C. N. Liu.  A Programmed Algorithm for Designing Multifont Character Recognition Logics , 1964, IEEE Trans. Electron. Comput..

[45]  C. Hugh Mays,et al.  Effects of Adaptation Parameters on Convergence Time and Tolerance for Adaptive Threshold Elements , 1964, IEEE Trans. Electron. Comput..

[46]  Alan G. Konheim,et al.  Linear and Nonlinear Methods in Pattern Classification , 1964, IBM J. Res. Dev..

[47]  R. Narasimhan,et al.  Labeling Schemata and Synctactic Descriptions of Pictures , 1964, Inf. Control..

[48]  David B. Cooper,et al.  Nonsupervised Adaptive Signal Detection and Pattern Recognition , 1964, Inf. Control..

[49]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[50]  H. J. Scudder,et al.  Probability of error of some adaptive pattern-recognition machines , 1965, IEEE Trans. Inf. Theory.

[51]  Geoffrey H. Ball,et al.  Data analysis in the social sciences: what about the details? , 1965, AFIPS '65 (Fall, part I).

[52]  C. K. Chow,et al.  Statistical Independence and Threshold Functions , 1965, IEEE Trans. Electron. Comput..

[53]  J. B. Rosen.  Pattern separation by convex programming , 1965 .

[54]  R. L. Kashyap,et al.  An Algorithm for Linear Inequalities and its Applications , 1965, IEEE Trans. Electron. Comput..

[55]  D. W. Peterson.  Discriminant functions: properties, classes, and computational techniques , 1965 .

[56]  F. K. Becker,et al.  Automatic equalization for digital communication , 1965 .

[57]  Filson Henry Glanz,et al.  Statistical extrapolation in certain adaptive pattern-recognition systems , 1965 .

[58]  C. N. Liu,et al.  An Experimental Investigation of a Mixed-Font Print Recognition System , 1966, IEEE Trans. Electron. Comput..

[59]  King-Sun Fu,et al.  A modified sequential recognition machine using time-varying stopping boundaries , 1966, IEEE Trans. Inf. Theory.

[60]  Bernard Wadsworth.  PEPR - A Developmental System For Rapid Processing Of Bubble-Chamber Film , 1966, Other Conferences.

[61]  David J. Hall,et al.  A pattern recognition experiment with near-optimum results , 1966, IEEE Trans. Electron. Comput..

[62]  Azriel Rosenfeld,et al.  Sequential Operations in Digital Picture Processing , 1966, JACM.

[63]  J. M.S Prewitt,et al.  Pictorial Data Processing Methods In Microscopy , 1966, Other Conferences.

[64]  George Nagy,et al.  Recognition of Printed Chinese Characters , 1966, IEEE Trans. Electron. Comput..

[65]  J. K. Hawkins,et al.  Automatic Shape Detection For Programmed Terrain Classification , 1966, Other Conferences.

[66]  John C. Hancock,et al.  Nonsupervised sequential classification and recognition of patterns , 1966, IEEE Trans. Inf. Theory.

[67]  Richard O. Duda,et al.  Pattern Classification by Iteratively Determined Linear and Piecewise Linear Discriminant Functions , 1966, IEEE Trans. Electron. Comput..

[68]  George Nagy,et al.  Self-corrective character recognition system , 1966, IEEE Trans. Inf. Theory.

[69]  G. P. Moore,et al.  Statistical analysis and functional interpretation of neuronal spike data. , 1966, Annual review of physiology.

[70]  R. Kashyap,et al.  Recovery of functions from noisy measurements taken at randomly selected points and its application to pattern classification , 1966 .

[71]  John D. Spragins,et al.  Learning without a teacher , 1966, IEEE Trans. Inf. Theory.

[72]  Colin C. Blaydon,et al.  On a pattern classification result of Aizerman, Braverman, and Rozonoer (Corresp.) , 1966, IEEE Trans. Inf. Theory.

[73]  C. Chow.  A class of nonlinear recognition procedures , 1966 .

[74]  R. W. Lucky,et al.  Techniques for adaptive equalization of digital communication systems , 1966 .

[75]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[76]  H. P. Friedman,et al.  On Some Invariant Criteria for Grouping Data , 1967 .

[77]  Stanley C. Fralick,et al.  Learning to recognize patterns without a teacher , 1967, IEEE Trans. Inf. Theory.

[78]  Josef Raviv,et al.  Decision making in Markov chains applied to the problem of pattern recognition , 1967, IEEE Trans. Inf. Theory.

[79]  J. Rubin.  Optimal classification into groups: an approach for solving the taxonomy problem. , 1967, Journal of theoretical biology.

[80]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[81]  Azriel Rosenfeld,et al.  Computer representation of planar regions by their skeletons , 1967, CACM.

[82]  FRED W. SMITH,et al.  Pattern Classifier Design by Linear Programming , 1968, IEEE Transactions on Computers.

[83]  J. H. Munson,et al.  Experiments with Highleyman's Data , 1968, IEEE Transactions on Computers.

[84]  George Nagy,et al.  An Autonomous Reading Machine , 1968, IEEE Transactions on Computers.

[85]  John A. McLaughlin,et al.  Nth-Order Autocorrelations in Pattern Recognition , 1968, Inf. Control..

[86]  D. Beetle,et al.  Flexible analog time compression of short utterances , 1968 .