Interactive pattern analysis and classification systems: A survey and commentary

Starting with the era of learning machines, reasons are presented for the current emergence of graphics-oriented interactive pattern analysis and classification systems (IPACS) as a general approach to practical pattern-recognition problems. A number of representative systems and their application to a wide variety of patterns are surveyed. Various aspects of alternative hardware and software implementations are commented upon and computational algorithms and mappings relevant to interactive analysis and classification of patterns are discussed.

[1]  D. Hilbert.  Ueber die stetige Abbildung einer Line auf ein Flächenstück , 1891 .

[2]  M. L. Dertouzos,et al.  CIRCAL-2: General-purpose on-line circuit design , 1972 .

[3]  F. P. Fischer,et al.  Cluster Mapping with Experimental Computer Graphics , 1969, IEEE Transactions on Computers.

[4]  D. Raj Reddy,et al.  A Procedure for the Segmentation of Connected Speech , 1968 .

[5]  J. Hartigan.  REPRESENTATION OF SIMILARITY MATRICES BY TREES , 1967 .

[6]  Arthur R. Butz,et al.  Alternative Algorithm for Hilbert's Space-Filling Curve , 1971, IEEE Transactions on Computers.

[7]  Theodore Bially,et al.  Space-filling curves: Their generation and their application to bandwidth reduction , 1969, IEEE Trans. Inf. Theory.

[8]  Karl Pearson F.R.S..  LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[9]  Sarah B. Holt,et al.  The genetics of dermal ridges , 1968 .

[10]  King-Sun Fu,et al.  A Dynamic Programming Approach to Sequential Pattern Recognition , 1967, IEEE Trans. Electron. Comput..

[11]  L. C. Hobbs.  Display applications and technology , 1966 .

[12]  Gerard V. Trunk,et al.  Statistical Estimation of the Intrinsic Dimensionality of Data Collections , 1968, Inf. Control..

[13]  Solomon Kullback,et al.  Information Theory and Statistics , 1960 .

[14]  Arthur R. Butz,et al.  Convergence with Hilbert's Space Filling Curve , 1969, J. Comput. Syst. Sci..

[15]  Keinosuke Fukunaga,et al.  A Criterion and an Algorithm for Grouping Data , 1970, IEEE Transactions on Computers.

[16]  Robert S. Bennett,et al.  The intrinsic dimensionality of signal collections , 1969, IEEE Trans. Inf. Theory.

[17]  J. Kruskal.  Nonmetric multidimensional scaling: A numerical method , 1964 .

[18]  Robin Williams,et al.  A Survey of Data Structures for Computer Graphics Systems , 1971, CSUR.

[19]  Gerard V. Trunk.  Parameter identification using intrinsic dimensionality , 1972, IEEE Trans. Inf. Theory.

[20]  E. O. Zeitler,et al.  Uses of earth resources data in the NASA/MSC Earth Resources Research Data Facility. , 1971 .

[21]  Laveen N. Kanal,et al.  Classification of binary random patterns , 1965, IEEE Trans. Inf. Theory.

[22]  George G. Lendaris,et al.  Diffraction-pattern sampling for automatic pattern recognition , 1970 .

[23]  O. Firschein,et al.  Automatic Subclass Determination for pattern-Recognition Applications , 1963 .

[24]  J. C. R. Licklider,et al.  Man-Computer Symbiosis , 1960 .

[25]  Edward A. Evans,et al.  Feature Definition and Extraction. , 1970 .

[26]  C. N. Liu.  A Programmed Algorithm for Designing Multifont Character Recognition Logics , 1964, IEEE Trans. Electron. Comput..

[27]  D N Streeter,et al.  Research on advanced computer methods for biological data processing. AMRL-TR-66-24. , 1966, AMRL-TR. Aerospace Medical Research Laboratories.

[28]  G. Palmieri,et al.  Preliminary experimental results with PAPA no. 2 , 1962 .

[29]  H. P. Friedman,et al.  On Some Invariant Criteria for Grouping Data , 1967 .

[30]  J. Elashoff,et al.  On the choice of variables in classification problems with dichotomous variables. , 1967, Biometrika.

[31]  Andries van Dam,et al.  Data and storage structures for interactive graphics , 1971, ACM SIGPLAN Notices.

[32]  Douglas T. Ross.  The AED approach to generalized computer-aided design , 1967, ACM '67.

[33]  D. Reddy.  Computer recognition of connected speech. , 1967, The Journal of the Acoustical Society of America.

[34]  Charles L. Wilson,et al.  MSDS: An Experimental 24-Channel Multispectral Scanner System , 1971 .

[35]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[36]  Glen J. Culler.  An Attack on the Problems of Speech Analysis and Synthesis with the Power of an On-Line System , 1969, IJCAI.

[37]  Joseph B. Kruskal.  Comments on "A Nonlinear Mapping for Data Structure Analysis" , 1971, IEEE Trans. Computers.

[38]  M. Mathews,et al.  Talker‐Recognition Procedure Based on Analysis of Variance , 1963 .

[39]  L. N. Kanal,et al.  Recognition system design by statistical analysis , 1964 .

[40]  William G. Wee,et al.  Generalized Inverse Approach to Adaptive Multiclass Pattern Classification , 1968, IEEE Transactions on Computers.

[41]  Robert H. Anderson.  Syntax-directed recognition of hand-printed two-dimensional mathematics , 1967, Symposium on Interactive Systems for Experimental Applied Mathematics.

[42]  Lyle B. Smith,et al.  A Survey of Interactive Graphical Systems for Mathematics , 1970, CSUR.

[43]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[44]  David R. Hill,et al.  Man-Machine Interaction Using Speech , 1971, Adv. Comput..

[45]  W. J. Dixon.  Use of displays with packaged statistical programs , 1967, AFIPS '67 (Fall).

[46]  R. D. Parslow,et al.  Advanced Computer Graphics , 1971, Springer US.

[47]  Ronald M. Baecker,et al.  INTERACTIVE COMPUTER-MEDIATED ANIMATION , 1969 .

[48]  David B. Connell,et al.  PROGRAMMING PACKAGE FOR ON-LINE PATTERN RECOGNITION. , 1970 .

[49]  Frank Rosenblatt,et al.  Perceptron Simulation Experiments , 1960, Proceedings of the IRE.

[50]  M. L. Berman,et al.  Project Merlin a Graphics Operating System , 1971 .

[51]  John D. Joyce,et al.  Reactive displays: improving man-machine graphical communication , 1967, AFIPS '67 (Fall).

[52]  Thomas W. Calvert,et al.  Nonorthogonal Projections for Feature Extraction in Pattern Recognition , 1969, IEEE Transactions on Computers.

[53]  Hubert V. Pipberger,et al.  The Love‐at‐First‐Sight Effect in Research , 1968 .

[54]  Keinosuke Fukunaga,et al.  Application of the Karhunen-Loève Expansion to Feature Selection and Ordering , 1970, IEEE Trans. Computers.

[55]  J. C. Gray,et al.  Compound data structure for computer aided design; a survey , 1967, ACM National Conference.

[56]  J. Tukey.  The Future of Data Analysis , 1962 .

[57]  David J. Hall,et al.  A pattern recognition experiment with near-optimum results , 1966, IEEE Trans. Electron. Comput..

[58]  Tzay Y. Young,et al.  Randomly Generated Nonlinear Transformations for Pattern Recognition , 1969, IEEE Trans. Syst. Sci. Cybern..

[59]  George Nagy,et al.  An Interactive System for Reading Unformatted Printed Text , 1971, IEEE Transactions on Computers.

[60]  Philip M. Lewis,et al.  The characteristic selection problem in recognition systems , 1962, IRE Trans. Inf. Theory.

[61]  Donald M. Levy,et al.  A Dynamic Programming Approach to the Selection of Pattern Features , 1968, IEEE Trans. Syst. Sci. Cybern..

[62]  Edward A. Patrick,et al.  Interactive pattern analysis and classification utilizing prior knowledge , 1971, Pattern Recognit..

[63]  M A Woodbury,et al.  Clinical data representation in multidimensional space. , 1970, Computers and biomedical research, an international journal.

[64]  Franklin F. Kuo,et al.  Computer oriented circuit design , 1969 .

[65]  Burton D. Fried,et al.  On the user's point of view , 1967, Symposium on Interactive Systems for Experimental Applied Mathematics.

[66]  B. Chandrasekaran,et al.  On dimensionality and sample size in statistical pattern classification , 1971, Pattern Recognit..

[67]  Calyampudi R. Rao.  The use and interpretation of principal component analysis in applied research , 1964 .

[68]  T. Kailath.  The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[69]  Peter M. Will,et al.  An experimental laboratory for pattern recognition and signal processing , 1972, CACM.

[70]  William G. Wee,et al.  On feature selection in a class of distribution-free pattern classifiers , 1970, IEEE Trans. Inf. Theory.

[71]  John W. Sammon,et al.  An Optimal Discriminant Plane , 1970, IEEE Transactions on Computers.

[72]  R. Shepard.  The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[73]  John W. Sammon,et al.  Interactive Pattern Analysis and Classification , 1970, IEEE Transactions on Computers.

[74]  Satosi Watanabe,et al.  Knowing and guessing , 1969 .

[75]  Godfried T. Toussaint,et al.  Note on optimal selection of independent binary-valued features for pattern recognition (Corresp.) , 1971, IEEE Trans. Inf. Theory.

[76]  Donald F. Roberts,et al.  An interactive-graphic subsystem for pattern analysis , 1971, Pattern Recognit..

[77]  K. Fukunaga,et al.  Authors' Reply3 , 1971, IEEE Trans. Computers.

[78]  M. D. Prince.  Man-computer graphics for computer-aided design , 1966 .

[79]  Harold Cummins,et al.  Dermatoglyphic stigmata in mongoloid imbeciles , 1939 .

[80]  Keinosuke Fukunaga,et al.  A Two-Dimensional Display for the Classification of Multivariate Data , 1971, IEEE Transactions on Computers.

[81]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[82]  G. V. Trunk.  Comments on "An Algorithm for Finding Intrinsic Dimensionality of Data" , 1971, IEEE Trans. Computers.

[83]  Demetrios G. Lainiotis,et al.  A class of upper bounds on probability of error for multihypotheses pattern recognition (Corresp.) , 1969, IEEE Trans. Inf. Theory.

[84]  Pierre Jules Louis Edmond Vicens,et al.  Aspects of speech recognition by computer , 1969 .

[85]  A. Wald.  Contributions to the Theory of Statistical Estimation and Testing Hypotheses , 1939 .

[86]  Calyampudi R. Rao,et al.  Advanced Statistical Methods in Biometric Research. , 1953 .

[87]  Douglas R. Anderson,et al.  Mapping Multidimensional Space to One Dimension for Computer Output Display , 1968, IEEE Transactions on Computers.

[88]  Carl Christensen,et al.  Multi-function graphics for a large computer system , 1967, AFIPS '67 (Fall).

[89]  E. S. Gilbert.  On Discrimination Using Qualitative Variables , 1968 .

[90]  E H Wood,et al.  A computer-controlled scintiscanning system and associated computer graphic techniques for study of regional distribution of blood flow. , 1970, Computers and biomedical research, an international journal.

[91]  Jürg Nievergelt,et al.  Emerging concepts in computer graphics , 1970 .

[92]  G H Ball,et al.  A clustering technique for summarizing multivariate data. , 1967, Behavioral science.

[93]  Laveen N. Kanal,et al.  RECOGNITION, MACHINE “RECOGNITION”, AND STATISTICAL APPROACHES , 1969 .

[94]  Ira W. Cotton,et al.  Data structures and techniques for remote computer graphics , 1968, AFIPS '68 (Fall, part I).

[95]  Raymond E. Bonner,et al.  On Some Clustering Techniques , 1964, IBM J. Res. Dev..

[96]  Thomas W. Calvert.  Projections of multidimensional data for use in man-computer graphics , 1968, AFIPS '68 (Fall, part I).

[97]  D. G. Lainiotis,et al.  COMMENTS ON LINEAR FEATURE EXTRACTION. , 1969 .

[98]  John F. Heafner,et al.  On-Line Computer Classification of Handprinted Chinese Characters as a Translation Aid , 1967, IEEE Trans. Electron. Comput..

[99]  Laveen N. Kanal,et al.  THE COMPLEXITY OF PATTERNS AND PATTERN RECOGNITION SYSTEMS. , 1969 .

[100]  William S. Mohn.  Two Statistical Feature Evaluation Techniques Applied to Speaker Identification , 1971, IEEE Transactions on Computers.

[101]  Gorden Stanley.  SARF a signature analysis research facility based on interactive computer graphics , 1968 .

[102]  Donald R. Brown,et al.  Recognizing patterns : studies in living and automatic systems , 1970 .

[103]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[104]  Arthur R. Butz,et al.  Space Filling Curves and Mathematical Programming , 1968, Inf. Control..

[105]  George Nagy,et al.  State of the art in pattern recognition , 1968 .

[106]  Jack Minker,et al.  Relational Data System Study. , 1970 .

[107]  H. Chernoff.  A BOUND ON THE CLASSIFICATION ERROR FOR DISCRIMINATING BETWEEN POPULATIONS WITH SPECIFIED MEANS AND VARIANCES. , 1970 .

[108]  James S. Bryan.  Experiments in Adaptive Pattern Recognition , 1963, IEEE Transactions on Military Electronics.

[109]  L. D. Harmon,et al.  Man-machine interaction in human-face identification , 1972 .

[110]  Yu-Chi Ho,et al.  On pattern classification algorithms--Introduction and survey , 1968 .

[111]  J. Kruskal.  Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[112]  Demetrios G. Lainiotis,et al.  Comments on linear feature extraction [Corresp.] , 1969, IEEE Trans. Inf. Theory.

[113]  C. I. Johnson,et al.  Interactive graphics in data processing: principles of interactive systems , 1968 .

[114]  Keinosuke Fukunaga,et al.  An Algorithm for Finding Intrinsic Dimensionality of Data , 1971, IEEE Transactions on Computers.

[115]  Robert G. Miller.  Statistical prediction by discriminant analysis , 1962 .