Artificial neural networks for document analysis and recognition

Artificial neural networks have been extensively applied to document analysis and recognition. Most efforts have been devoted to the recognition of isolated handwritten and printed characters with widely recognized successful results. However, many other document processing tasks, like preprocessing, layout analysis, character segmentation, word recognition, and signature verification, have been effectively faced with very promising results. This paper surveys the most significant problems in the area of offline document image processing, where connectionist-based approaches have been applied. Similarities and differences between approaches belonging to different categories are discussed. A particular emphasis is given on the crucial role of prior knowledge for the conception of both appropriate architectures and learning algorithms. Finally, the paper provides a critical analysts on the reviewed approaches and depicts the most promising research guidelines in the field. In particular, a second generation of connectionist-based models are foreseen which are based on appropriate graphical representations of the learning environment.

[1]  Adnan Amin,et al.  Hand-printed arabic character recognition system using an artificial network , 1996, Pattern Recognit..

[2]  King-Sun Fu,et al.  An Image Understanding System Using Attributed Symbolic Representation and Inexact Graph-Matching , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Robert M. Haralick,et al.  Document image restoration using binary morphological filters , 1996, Electronic Imaging.

[4]  S.C. Hinds,et al.  A rule-based system for document image segmentation , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[5]  Toyohide Watanabe,et al.  Structure recognition methods for various types of documents , 2005, Machine Vision and Applications.

[6]  Tin Kam Ho,et al.  Recognition of handwritten digits by combining independent learning vector quantizations , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[7]  Tetsuya Itoh,et al.  Document Image Segmentation into Text, Continuous-Tone and Screened-Halftone Region by the Neural Networks , 1996, MVA.

[8]  Seong-Whan Lee,et al.  Faxed image restoration using Kalman filtering , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[9]  Robert Sabourin,et al.  A neural network approach to off-line signature verification using directional PDF , 1996, Pattern Recognit..

[10]  Hang Joon Kim,et al.  Support Vector Machines for Texture Classification , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Lawrence O'Gorman,et al.  Document Image Analysis Systems - Guest Editors' Introduction to the Special Issue , 1992, Computer.

[12]  Ching Y. Suen,et al.  A feature for character recognition based on directional distance distributions , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[13]  Giovanni Soda,et al.  Links between LVQ and Backpropagation , 1997, Pattern Recognit. Lett..

[14]  Suzanne Liebowitz Taylor,et al.  Extraction of data from preprinted forms , 2007, Machine Vision and Applications.

[15]  Yann LeCun,et al.  Multi-Digit Recognition Using a Space Displacement Neural Network , 1991, NIPS.

[16]  Cheng-Lin Liu,et al.  Handwritten digit recognition: benchmarking of state-of-the-art techniques , 2003, Pattern Recognit..

[17]  Ching Y. Suen,et al.  A new system for reading handwritten zip codes , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[18]  Sargur N. Srihari,et al.  Classification of newspaper image blocks using texture analysis , 1989, Comput. Vis. Graph. Image Process..

[19]  Marinette Revenu,et al.  A Static Signature Verification System Based on A Cooperating Neural Networks Architecture , 1994, Int. J. Pattern Recognit. Artif. Intell..

[20]  Richard Szeliski,et al.  Using character recognition and segmentation to tell computer from humans , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[21]  Giovanni Soda,et al.  Indexing and retrieval of words in old documents , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[22]  Réjean Plamondon,et al.  Automatic signature verification and writer identification - the state of the art , 1989, Pattern Recognit..

[23]  S. Imade,et al.  Segmentation and classification for mixed text/image documents using neural network , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[24]  Rajjan Shinghal,et al.  A hybrid classifier for recognizing handwritten numerals , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[25]  Rama Chellappa,et al.  Multiscale Segmentation of Unstructured Document Pages Using Soft Decision Integration , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Dimitris A. Pados,et al.  On overfitting, generalization, and randomly expanded training sets , 2000, IEEE Trans. Neural Networks Learn. Syst..

[27]  Sung-Bae Cho,et al.  Neural-network classifiers for recognizing totally unconstrained handwritten numerals , 1997, IEEE Trans. Neural Networks.

[28]  Majid Mirmehdi,et al.  Combining statistical measures to find image text regions , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[29]  Michel Gilloux,et al.  A hybrid radial basis function network/hidden Markov model handwritten word recognition system , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[30]  Giovanni Soda,et al.  Edge-backpropagation for noisy logo recognition , 2003, Pattern Recognit..

[31]  Gale L. Martin,et al.  Centered-Object Integrated Segmentation and Recognition of Overlapping Handprinted Characters , 1993, Neural Computation.

[32]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Jun Shen,et al.  Neuro-fuzzy synergism to the intelligent system for edge detection and enhancement , 2003, Pattern Recognit..

[34]  Dong-Chul Park,et al.  Weighted centroid neural network for edge preserving image compression , 2001, IEEE Trans. Neural Networks.

[35]  Mario Vento,et al.  Signature Verification: Increasing Performance by a Multi-Stage System , 2000, Pattern Analysis & Applications.

[36]  Jianying Hu,et al.  Document image layout comparison and classification , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[37]  Ching Y. Suen,et al.  An HMM-MLP Hybrid Model for Cursive Script Recognition , 2000, Pattern Analysis & Applications.

[38]  Wang Hao,et al.  Fast recognition of handwritten digits using pairwise coupling support vector machine , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[39]  Francesca Cesarini,et al.  Encoding of modified X-Y trees for document classification , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[40]  Charalambos Strouthopoulos,et al.  Text identification for document image analysis using a neural network , 1998, Image Vis. Comput..

[41]  Shamik Sural,et al.  An MLP using Hough transform based fuzzy feature extraction for Bengali script recognition , 1999, Pattern Recognit. Lett..

[42]  Lee Luan Ling Neural approaches for human signature verification , 1995, ICDAR.

[43]  Francesca Cesarini,et al.  INFORMys: A Flexible Invoice-Like Form-Reader System , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Yannis A. Dimitriadis,et al.  Structured document labeling and rule extraction using a new recurrent fuzzy-neural system , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[45]  Horst Bunke,et al.  Writer identification using text line based features , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[46]  S. Srihari,et al.  Variable duration hidden markov model and morphological segmentation for handwritten word recognition , 1995, IEEE Transactions on Image Processing.

[47]  M. Ferraro,et al.  A comparison of Neural and Graphical Models for Syntactic and Structural Pattern Recognition , 2003 .

[48]  Alexander Shustorovich,et al.  Neural network positioning and classification of handwritten characters , 1996, Neural Networks.

[49]  Charalambos Strouthopoulos,et al.  Text extraction in complex color documents , 2002, Pattern Recognit..

[50]  Yasuto Ishitani Flexible and Robust Model Matching based on Association Graph for Form Image Understanding , 2000, Pattern Analysis & Applications.

[51]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[52]  George Nagy,et al.  HIERARCHICAL REPRESENTATION OF OPTICALLY SCANNED DOCUMENTS , 1984 .

[53]  Michael D. Garris,et al.  Neural network-based systems for handprint OCR applications , 1998, IEEE Trans. Image Process..

[54]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[55]  Harry Wechsler,et al.  Classification of binary document images into textual or nontextual data blocks using neural network models , 2005, Machine Vision and Applications.

[56]  Yuan Yan Tang,et al.  Four directional adjacency graphs (FDAG) and their application in locating fields in forms , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[57]  John S. Denker,et al.  Improving Rejection Performance on Handwritten Digits by Training with Rubbish , 1993, Neural Computation.

[58]  Anil K. Jain,et al.  Page segmentation using tecture analysis , 1996, Pattern Recognit..

[59]  Jin Wang,et al.  Resolving multifont character confusion with neural networks , 1993, Pattern Recognit..

[60]  Wan-Chi Siu,et al.  Length estimation of digit strings using a neural network with structure-based features , 1998, J. Electronic Imaging.

[61]  Hang Joon Kim,et al.  Segmentation of touching characters using an MLP , 1998, Pattern Recognit. Lett..

[62]  Frank Y. Shih,et al.  Adaptive document block segmentation and classification , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[63]  Sargur N. Srihari,et al.  Gradient-based contour encoding for character recognition , 1996, Pattern Recognit..

[64]  David S. Doermann,et al.  Classification of document page images based on visual similarity of layout structures , 1999, Electronic Imaging.

[65]  Giovanni Soda,et al.  A serial combination of connectionist-based classifiers for OCR , 2001, International Journal on Document Analysis and Recognition.

[66]  Rajjan Shinghal,et al.  Symbolic/neural recognition of cursive amounts on bank cheques , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[67]  John F. Kolen,et al.  From Sequences to Data Structures: Theory and Applications , 2001 .

[68]  Peter E. Hart,et al.  Image continuation , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[69]  Ehud Rivlin,et al.  Offline cursive script word recognition – a survey , 1999, International Journal on Document Analysis and Recognition.

[70]  Seong-Whan Lee Off-Line Recognition of Totally Unconstrained Handwritten Numerals Using Multilayer Cluster Neural Network , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[71]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[72]  Josef A. Nossek,et al.  The evaluation of feature extraction criteria applied to neural network classifiers , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[73]  Emmanuel Augustin,et al.  A neural network-hidden Markov model hybrid for cursive word recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[74]  Marco Gori,et al.  Adaptive graphical pattern recognition for the classification of company logos , 2001, Pattern Recognit..

[75]  Zen Chen,et al.  Identification of business forms using relationships between adjacent frames , 2005, Machine Vision and Applications.

[76]  Ling Guan,et al.  A neural learning approach for adaptive image restoration using a fuzzy model-based network architecture , 2001, IEEE Trans. Neural Networks.

[77]  Hong Yan,et al.  Character and line extraction from color map images using a multi-layer neural network , 1994, Pattern Recognit. Lett..

[78]  Gilles Burel,et al.  Cooperation of multi-layer perceptrons for the estimation of skew angle in text document images , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[79]  Jinhyung Kim,et al.  NETeye: A Neural Network System for Recognizing Multi-font / multi-size Hangul (Korean Script) Documents , 1991 .

[80]  K Fukushima,et al.  Handwritten alphanumeric character recognition by the neocognitron , 1991, IEEE Trans. Neural Networks.

[81]  Anil K. Jain,et al.  Document Representation and Its Application to Page Decomposition , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[82]  W. P. de Waard Neural techniques and postal code detection , 1994, Pattern Recognit. Lett..

[83]  Lawrence O'Gorman,et al.  Document image analysis: A bibliography , 1992, Machine Vision and Applications.

[84]  Franco Scarselli,et al.  Are Multilayer Perceptrons Adequate for Pattern Recognition and Verification? , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  Lawrence O'Gorman,et al.  The Document Spectrum for Page Layout Analysis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[86]  Paul D. Gader,et al.  Neural networks with enhanced outlier rejection ability for off-line handwritten word recognition , 2002, Pattern Recognit..

[87]  Mario Vento,et al.  A neural network classifier for OCR using structural descriptions , 1995, Machine Vision and Applications.

[88]  Santanu Chaudhury,et al.  Signature verification using multiple neural classifiers , 1997, Pattern Recognit..

[89]  Raveendran Paramesran,et al.  New Invariant Moments for Non-Uniformly Scaled Images , 2000, Pattern Analysis & Applications.

[90]  Rajat Raina,et al.  Classification with Hybrid Generative/Discriminative Models , 2003, NIPS.

[91]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[92]  Alessandro Sperduti,et al.  A general framework for adaptive processing of data structures , 1998, IEEE Trans. Neural Networks.

[93]  Hiroshi Sako,et al.  Discriminative learning quadratic discriminant function for handwriting recognition , 2004, IEEE Transactions on Neural Networks.

[94]  David Chapman,et al.  Learning to See Where and What: Training a Net to Make Saccades and Recognize Handwritten Characters , 1992, NIPS.

[95]  P. Ahmed,et al.  A neural network based dedicated thinning method , 1995, Pattern Recognit. Lett..

[96]  Bidyut Baran Chaudhuri,et al.  Skeletonization by a topology-adaptive self-organizing neural network , 2001, Pattern Recognit..

[97]  Lawrence O'Gorman,et al.  Document Image Analysis , 1996 .

[98]  Markus Schenkel,et al.  Off-line cursive handwriting recognition compared with on-line recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[99]  Christopher K. I. Williams,et al.  Combining Belief Networks and Neural Networks for Scene Segmentation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[100]  Edward R. Dougherty,et al.  Document restoration and enhancement using optimal iterative and paired morphological filters , 1997, Electronic Imaging.

[101]  Sargur N. Srihari,et al.  Dynamic classifier combination using neural network , 1995, Electronic Imaging.

[102]  Kuo-Chin Fan,et al.  Classification of document blocks using density feature and connectivity histogram , 1995, Pattern Recognit. Lett..

[103]  Alessandro Sperduti,et al.  Guest Editors' Introduction: Special Section on Connectionist Models for Learning in Structured Domains , 2001, IEEE Trans. Knowl. Data Eng..

[104]  Seong-Whan Lee,et al.  A new methodology for gray-scale character segmentation and recognition , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[105]  Kenji Suzuki,et al.  Neural Edge Enhancer for Supervised Edge Enhancement from Noisy Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[106]  Sung-Bae Cho,et al.  Recognition of large-set printed Hangul (Korean script) by two-stage backpropagation neural classifier , 1992, Pattern Recognit..

[107]  Marco Gori,et al.  Robust combination of neural networks and hidden Markov models for speech recognition , 2003, IEEE Trans. Neural Networks.

[108]  Jin Wang,et al.  Segmentation of merged characters by neural networks and shortest-path , 1993, SAC '93.

[109]  Patrick Shen-Pei Wang,et al.  An Adaptive Modular Neural Network with Application to Unconstrained Character Recognition , 1994, Int. J. Pattern Recognit. Artif. Intell..

[110]  Thomas D. Griffin,et al.  Recognition enhancement by linear tournament verification , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[111]  Gyeonghwan Kim,et al.  An approach for locating segmentation points of handwritten digit strings using a neural network , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[112]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[113]  George Nagy,et al.  Twenty Years of Document Image Analysis in PAMI , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[114]  Gian Antonio Mian,et al.  Trademark shapes description by string-matching techniques , 1994, Pattern Recognit..

[115]  Dianhui Wang,et al.  Edge-preserving nonlinear image restoration using adaptive components-based radial basis function neural networks , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[116]  Ching Y. Suen,et al.  A two-stage multi-network OCR system with a soft pre-classifier and a network selector , 1995, ICDAR.

[117]  Hong Yan,et al.  Linking broken character borders with variable sized masks to improve recognition , 1996, Pattern Recognit..

[118]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[119]  Kunihiko Fukushima,et al.  Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position , 1982, Pattern Recognit..

[120]  Hong Yan,et al.  Off-line signature verification based on geometric feature extraction and neural network classification , 1997, Pattern Recognit..

[121]  James A. Pittman,et al.  Recognizing Hand-Printed Letters and Digits Using Backpropagation Learning , 1991, Neural Computation.

[122]  David S. Doermann,et al.  The Indexing and Retrieval of Document Images: A Survey , 1998, Comput. Vis. Image Underst..

[123]  Harry Wechsler,et al.  Classification of binary document images into textual or nontextual data blocks using network models , 1995 .

[124]  DeLiang Wang,et al.  Weight adaptation and oscillatory correlation for image segmentation , 2000, IEEE Trans. Neural Networks Learn. Syst..

[125]  Maurice Milgram,et al.  Transformation Invariant Autoassociation with Application to Handwritten Character Recognition , 1994, NIPS.

[126]  Jongmin Yoon,et al.  Performance comparison of several feature selection methods based on node pruning in handwritten character recognition , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[127]  Giovanni Soda,et al.  Logo Recognition by Recursive Neural Networks , 1997, GREC.

[128]  Paolo Frasconi,et al.  Learning in multilayered networks used as autoassociators , 1995, IEEE Trans. Neural Networks.

[129]  Flávio Bortolozzi,et al.  Off-line signature verification, without a priori knowledge of class /spl omega//sub 2/. A new approach , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[130]  Seong-Whan Lee,et al.  A self-organizing neural tree for large-set pattern classification , 1998, IEEE Trans. Neural Networks.

[131]  Yoshua Bengio,et al.  Bias learning, knowledge sharing , 2003, IEEE Trans. Neural Networks.

[132]  Seong-Whan Lee,et al.  Integrated segmentation and recognition of connected handwritten characters with recurrent neural network , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[133]  Réjean Plamondon,et al.  Automatic Signature Verification: The State of the Art - 1989-1993 , 1994, Int. J. Pattern Recognit. Artif. Intell..

[134]  Anil K. Jain,et al.  Segmentation of Document Images , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[135]  Adnan Amin,et al.  Recognition of printed Arabic text using neural networks , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[136]  K. W. Wong,et al.  A two-stage binarization approach for document images , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[137]  Jung-Hsien Chiang,et al.  Comparison of crisp and fuzzy character neural networks in handwritten word recognition , 1995, IEEE Trans. Fuzzy Syst..

[138]  Nikolaos Papanikolopoulos,et al.  Self-organizing maps for the skeletonization of sparse shapes , 2000, IEEE Trans. Neural Networks Learn. Syst..

[139]  Eric Lecolinet,et al.  A Survey of Methods and Strategies in Character Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[140]  Suzanne Liebowitz Taylor,et al.  Classification and functional decomposition of business documents , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[141]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[142]  Jung-Hsien Chiang,et al.  Handwritten word recognition with character and inter-character neural networks , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[143]  P. Stubberud,et al.  Adaptive image restoration of text images that contain touching or broken characters , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[144]  Sargur N. Srihari,et al.  Multifont classification using typographical attributes , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[145]  Bernard Widrow,et al.  30 years of adaptive neural networks: perceptron, Madaline, and backpropagation , 1990, Proc. IEEE.

[146]  Seong-Whan Lee,et al.  Multi-lingual, multi-font and multi-size large-set character recognition using self-organizing neural network , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[147]  David J. Burr,et al.  Experiments on neural net recognition of spoken and written text , 1988, IEEE Trans. Acoust. Speech Signal Process..

[148]  Wei Wang,et al.  Hierarchical neural network for recognizing hand-written characters in engineering drawings , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[149]  Karim Faez,et al.  A hybrid handwritten word recognition using self-organizing feature map, discrete HMM, and evolutionary programming , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[150]  Ezequiel López-Rubio,et al.  A robust two-stage system for image segmentation , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[151]  Friedrich M. Wahl,et al.  Document Analysis System , 1982, IBM J. Res. Dev..

[152]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[153]  Keechul Jung,et al.  Neural network-based text location in color images , 2001, Pattern Recognit. Lett..

[154]  A. Jennings,et al.  A Low Level Feature Based Neural Network Segmenter for Fully Cursive Handwritten Words , 1998 .

[155]  LiMin Fu,et al.  Neural networks in computer intelligence , 1994 .

[156]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[157]  R. Tetzlaff,et al.  Binary image coding using cellular neural networks , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[158]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .