Backpropagation neural networks

Abstract Wythoff, B.J., 1993. Backpropagation neural networks. A tutorial. Chemometrics and Intelligent Laboratory Systems , 18: 115–155. Artificial neural networks have enjoyed explosive growth in the past ten years. An indication of the rate of growth of research in this area is the fact that, although the first research journal devoted exclusively to this subject was just introduced in 1987, there are now at least five refereed neural net research journals. These developments are being taken seriously by the semiconductor industry as well: in addition to a host of products developed by smaller firms, Intel, AT & T Bell Labs, Motorola and Hitachi have all introduced silicon implementations of neural network algorithms. Neural networks have a very broad scope of potential application, including many tasks central to chemical research and development. This tutorial begins with a short history of neural network research, and a review of chemical applications. The bulk, however, is devoted to providing a clear and detailed introduction to the theory behind backpropagation neural networks, along with a discussion of practical issues facing developers.

[1]  Morton E. Munk,et al.  A neural network approach to infrared spectrum interpretation , 1990 .

[2]  J. U. Thomsen,et al.  Pattern recognition of the 1H NMR spectra of sugar alditols using a neural network , 1989 .

[3]  J. Zupan,et al.  Neural networks: A new method for solving chemical problems or just a passing phase? , 1991 .

[4]  S P Levine,et al.  Spectral peak verification and recognition using a multilayered neural network. , 1990, Analytical chemistry.

[5]  Tomoo Aoyama,et al.  Obtaining the correlation indices between drug activity and structural parameters using a neural network , 1991 .

[6]  B. Kowalski,et al.  Computerized learning machines applied to chemical problems. Interpretation of infrared spectrometry data , 1969 .

[7]  H. H. Thodberg,et al.  Optimal minimal neural interpretation of spectra , 1992 .

[8]  Tom Tollenaere,et al.  SuperSAB: Fast adaptive back propagation with good scaling properties , 1990, Neural Networks.

[9]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[10]  H Ichikawa,et al.  Neural networks applied to quantitative structure-activity relationship analysis. , 1990, Journal of medicinal chemistry.

[11]  P. Gemperline,et al.  Spectroscopic calibration and quantitation using artificial neural networks , 1990 .

[12]  Erkki Oja,et al.  Improved Simulated Annealing, Boltzmann Machine, and Attributed Graph Matching , 1990, EURASIP Workshop.

[13]  Thomas L. Isenhour,et al.  Computerized learning machines applied to chemical problems. Convergence rate and predictive ability of adaptive binary pattern classifiers , 1969 .

[14]  M. E. Johnson,et al.  Generalized simulated annealing for function optimization , 1986 .

[15]  T. Sejnowski,et al.  Predicting the secondary structure of globular proteins using neural network models. , 1988, Journal of molecular biology.

[16]  Gary M. Hieftje,et al.  Classification of Alloys with an Artificial Neural Network and Multivariate Calibration of Glow-Discharge Emission Spectra , 1991 .

[17]  Isao Karube,et al.  Detection of odorants using an array of piezoelectric crystals and neural-network pattern recognition , 1991 .

[18]  Robert A. Jacobs,et al.  Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[19]  Gerald M. Maggiora,et al.  Applications of neural networks in chemistry. 1. Prediction of electrophilic aromatic substitution reactions , 1990, J. Chem. Inf. Comput. Sci..

[20]  Peter C. Jurs,et al.  Interpretation of infrared spectra using pattern recognition techniques , 1974 .

[21]  P. C. Jurs,et al.  Pattern recognition techniques applied to the interpretation of infrared spectra , 1974 .

[22]  P. Harrington,et al.  Fuzzy multivariate rule‐building expert systems: Minimal neural networks , 1991 .

[23]  Tomoo Aoyama,et al.  Basic Operating Characteristics of Neural Networks When Applied to Structure-Activity Studies , 1991 .

[24]  Eduardo D. Sontag,et al.  Feedforward Nets for Interpolation and Classification , 1992, J. Comput. Syst. Sci..

[25]  David E. Rumelhart,et al.  MSnet: A Neural Network which Classifies Mass Spectra , 1990 .

[26]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[27]  R Langridge,et al.  Improvements in protein secondary structure prediction by an enhanced neural network. , 1990, Journal of molecular biology.

[28]  Eduardo D. Sontag,et al.  Remarks on Interpolation and Recognition Using Neural Nets , 1990, NIPS.

[29]  M. Munk,et al.  Neural network models for infrared spectrum interpretation , 1991 .

[30]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[31]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[32]  Howard T. Mayfield,et al.  Pattern recognition of jet fuel chromatographic data by artificial neural networks with back-propagation of error , 1991 .

[33]  Paul J. Gemperline,et al.  Nonlinear multivariate calibration using principal components regression and artificial neural networks , 1991 .