Backpropagation of an Image Similarity Metric for Autoassociative Neural Networks

Autoassociative Neural Networks (AANNs) are most commonly used for image data compression. The goal of an AANN for image data is to have the network output be ‘similar’ to the input. Most of the research in this area use backpropagation training with Mean-Squared Error (MSE) as the optimisation criteria. This paper presents an alternative error function called the Visual Difference Predictor (VDP) based on concepts from the human-visual system. Using the VDP as the error function provides a criteria to train an AANN more efficiently, and results in faster convergence of the weights, while producing an output image perceived to be very similar by a human observer.

[1]  Philip D. Wasserman,et al.  Neural computing - theory and practice , 1989 .

[2]  R Hecht-Nielsen,et al.  Replicator neural networks for universal optimal source coding. , 1995, Science.

[3]  Richard S. H. Mah,et al.  Some theoretical results on nonlinear principal components analysis , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[4]  N. E. Sharkey,et al.  Models of cognition : a review of cognitive science , 1989 .

[5]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[6]  Erkki Oja,et al.  Principal components, minor components, and linear neural networks , 1992, Neural Networks.

[7]  Garrison W. Cottrell,et al.  Non-Linear Dimensionality Reduction , 1992, NIPS.

[8]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[9]  Paolo Frasconi,et al.  Learning in multilayered networks used as autoassociators , 1995, IEEE Trans. Neural Networks.

[10]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[11]  Jacob Nachmias,et al.  On the psychometric function for contrast detection , 1981, Vision Research.

[12]  Kurt Hornik,et al.  Neural networks and principal component analysis: Learning from examples without local minima , 1989, Neural Networks.

[13]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[14]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.