Pap-Smear Classification Using Efficient Second Order Neural Network Training Algorithms

In this paper we make use of two highly efficient second order neural network training algorithms, namely the LMAM (Levenberg-Marquardt with Adaptive Momentum) and OLMAM (OptimizedLevenberg-Marquardt with Adaptive Momentum), for the construction of an efficient pap-smear test classifier. The algorithms are methodologically similar, and are based on iterations of the form employed in the Levenberg-Marquardt (LM) method for non-linear least squares problems with the inclusion of an additional adaptive momentum term arising from the formulation of the training task as a constrained optimization problem. The classification results obtained from the application of the algorithms on a standard benchmark pap-smear data set reveal the power of the two methods to obtain excellent solutions in difficult classification problems whereas other standard computational intelligence techniques achieve inferior performances.

[1]  Dimitris A. Karras,et al.  An efficient constrained learning algorithm with momentum acceleration , 1995, Neural Networks.

[2]  Frédéric Gruau,et al.  On using syntactic constraints with genetic programming , 1996 .

[3]  John R. Koza,et al.  Genetic Programming II , 1992 .

[4]  Stavros J. Perantonis,et al.  Two highly efficient second-order algorithms for training feedforward networks , 2002, IEEE Trans. Neural Networks.

[5]  J. K. Kinnear,et al.  Advances in Genetic Programming , 1994 .

[6]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[7]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[8]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[9]  J. Ross Quinlan,et al.  Boosting First-Order Learning , 1996, ALT.

[10]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[11]  Georgios Dounias,et al.  Evolving rule-based systems in two medical domains using genetic programming , 2004, Artif. Intell. Medicine.

[12]  Leopold G. Koss,et al.  The Application of PAPNET to Diagnostic Cytology , 2000, Artificial Neural Networks in Biomedicine.

[13]  Witold Pedrycz,et al.  Handbook of fuzzy computation , 1998 .

[14]  Johannes Fürnkranz,et al.  Pruning Algorithms for Rule Learning , 1997, Machine Learning.

[15]  Robert Babuska,et al.  Fuzzy Modeling for Control , 1998 .

[16]  Geoffrey E. Hinton,et al.  Proceedings of the 1988 Connectionist Models Summer School , 1989 .

[17]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[18]  Roger Jang Jyh-Shing Neuro-fuzzy modeling for nonlinear dynamic system identification , 1998 .

[19]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[20]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[21]  Jorge Nocedal,et al.  Global Convergence Properties of Conjugate Gradient Methods for Optimization , 1992, SIAM J. Optim..

[22]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[23]  B. Matthews Comparison of the predicted and observed secondary structure of T4 phage lysozyme. , 1975, Biochimica et biophysica acta.

[24]  Stavros J. Perantonis,et al.  Levenberg-Marquardt algorithm with adaptive momentum for the efficient training of feedforward networks , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[25]  Paulo J. G. Lisboa,et al.  Artificial Neural Networks in Biomedicine , 2000, Perspectives in Neural Computing.