Optimisation Using Levenberg-Marquardt Algorithm of Neural Networks for Iris

This paper explores the optimisation technique of Damped Least Square Method also known as the Levenberg-Marquardt (LM) Algorithm for Iris recognition. The motive behind it is to show that even though there are many algorithms available which act as an alternative to the LM algorithm such as the simple gradient decent and other conjugate gradient methods be it the vanilla gradient decent or the Gauss Newton iteration, the LM algorithm outperforms these optimisation techniques due to the addressing of the problem by the algorithm as the Non-linear Least Square Minimisation. The results are promising and provide an insight into Iris recognition which are distinct pattern of individuals and are unique in case of every eye.

[1]  George A. F. Seber,et al.  Linear regression analysis , 1977 .

[2]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[3]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[4]  Ivica Kostanic,et al.  Principles of Neurocomputing for Science and Engineering , 2000 .

[5]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[6]  Josef Stoer,et al.  Numerische Mathematik 1 , 1989 .

[7]  J. Douglas Faires,et al.  Numerical Analysis , 1981 .

[8]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[9]  Sun-Yuan Kung,et al.  Principal Component Neural Networks: Theory and Applications , 1996 .

[10]  William W. Hsieh,et al.  Nonlinear principal component analysis by neural networks , 2001 .

[11]  Martin T. Hagan,et al.  Neural network design , 1995 .

[12]  J. Dennis,et al.  Derivative free analogues of the Levenberg-Marquardt and Gauss algorithms for nonlinear least squares approximation , 1971 .

[13]  Detlef Nauck,et al.  Foundations Of Neuro-Fuzzy Systems , 1997 .

[14]  R. Hecht-Nielsen,et al.  Theory of the Back Propagation Neural Network , 1989 .

[15]  D. Kleinbaum,et al.  Applied Regression Analysis and Multivariable Methods , 1999 .

[16]  Min Wu,et al.  Stability Analysis for Neural Networks With Time-Varying Interval Delay , 2007, IEEE Transactions on Neural Networks.

[17]  Dexin Zhang,et al.  Personal Identification Based on Iris Texture Analysis , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Hideo Tanaka,et al.  Fuzzy regression analysis using neural networks , 1992 .

[19]  Kurt Hornik,et al.  Neural networks and principal component analysis: Learning from examples without local minima , 1989, Neural Networks.

[20]  Hecht-Nielsen.  Theory of the backpropagation neural network , 1989 .

[21]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[22]  D. Kleinbaum,et al.  Applied regression analysis and other multivariable methods, 3rd ed. , 1998 .

[23]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[24]  J. Farrell,et al.  Qualitative analysis of neural networks , 1989 .