Phased searching with NEAT in a Time-Scaled Framework: Experiments on a computer-aided detection system for lung nodules

OBJECTIVE In the field of computer-aided detection (CAD) systems for lung nodules in computed tomography (CT) scans, many image features are presented and many artificial neural network (ANN) classifiers with various structural topologies are analyzed; frequently, the classifier topologies are selected by trial-and-error experiments. To avoid these trial and error approaches, we present a novel classifier that evolves ANNs using genetic algorithms, called "Phased Searching with NEAT in a Time or Generation-Scaled Framework", integrating feature selection with the classification task. METHODS AND MATERIALS We analyzed our method's performance on 360 CT scans from the public Lung Image Database Consortium database. We compare our method's performance with other more-established classifiers, namely regular NEAT, Feature-Deselective NEAT (FD-NEAT), fixed-topology ANNs, and support vector machines (SVMs) using ten-fold cross-validation experiments of all 360 scans. RESULTS The results show that the proposed "Phased Searching" method performs better and faster than regular NEAT, better than FD-NEAT, and achieves sensitivities at 3 and 4 false positives (FP) per scan that are comparable with the fixed-topology ANN and SVM classifiers, but with fewer input features. It achieves a detection sensitivity of 83.0±9.7% with an average of 4FP/scan, for nodules with a diameter greater than or equal to 3mm. It also evolves networks with shorter evolution times and with lower complexities than regular NEAT (p=0.026 and p<0.001, respectively). Analysis on the average and best network complexities evolved by regular NEAT and by our approach shows that our approach searches for good solutions in lower dimensional search spaces, and evolves networks without superfluous structure. CONCLUSIONS We have presented a novel approach that combines feature selection with the evolution of ANN topology and weights. Compared with the original threshold-based Phased Searching method of Green, our method requires fewer parameters and converges to the optimal network complexity required for the classification task at hand. The results of the ten-fold cross-validation experiments also show that our proposed CAD system for lung nodule detection performs well with respect to other methods in the literature.

[1]  Hiroshi Fujita,et al.  Fast lung nodule detection in chest CT images using cylindrical nodule-enhancement filter , 2012, International Journal of Computer Assisted Radiology and Surgery.

[2]  S. Armato,et al.  Massive training artificial neural network (MTANN) for reduction of false positives in computerized detection of lung nodules in low-dose computed tomography. , 2003, Medical physics.

[3]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[4]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[5]  Esa Alhoniemi,et al.  Self-organizing map in Matlab: the SOM Toolbox , 1999 .

[6]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[7]  Temesguen Messay,et al.  A new computationally efficient CAD system for pulmonary nodule detection in CT imagery , 2010, Medical Image Anal..

[8]  L. Darrell Whitley,et al.  Genetic Reinforcement Learning for Neurocontrol Problems , 2004, Machine Learning.

[9]  Sergio Bermejo,et al.  Oriented principal component analysis for large margin classifiers , 2001, Neural Networks.

[10]  Michael L. Littman,et al.  Dimension reduction and its application to model-based exploration in continuous spaces , 2010, Machine Learning.

[11]  Pat Langley,et al.  Oblivious Decision Trees and Abstract Cases , 1994 .

[12]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..

[13]  Heber MacMahon,et al.  The Lung Image Database Consortium (LIDC): ensuring the integrity of expert-defined "truth". , 2007, Academic radiology.

[14]  Bram van Ginneken,et al.  A large-scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification , 2009, Medical Image Anal..

[15]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[16]  Bart M. ter Haar Romeny,et al.  Front-End Vision and Multi-Scale Image Analysis , 2003, Computational Imaging and Vision.

[17]  Martin T. Hagan,et al.  Neural network design , 1995 .

[18]  Risto Miikkulainen,et al.  Efficient evolution of neural networks through complexification , 2004 .

[19]  Kenneth O. Stanley,et al.  On the Performance of Indirect Encoding Across the Continuum of Regularity , 2011, IEEE Transactions on Evolutionary Computation.

[20]  S. Armato,et al.  Computerized detection of pulmonary nodules on CT scans. , 1999, Radiographics : a review publication of the Radiological Society of North America, Inc.

[21]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[22]  Hiroshi Fujita,et al.  Automated detection of pulmonary nodules in helical CT images based on an improved template-matching technique , 2001, IEEE Transactions on Medical Imaging.

[23]  Risto Miikkulainen,et al.  Forming Neural Networks Through Efficient and Adaptive Coevolution , 1997, Evolutionary Computation.

[24]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[25]  Jan Cornelis,et al.  A novel computer-aided lung nodule detection system for CT images. , 2011, Medical physics.

[26]  Risto Miikkulainen,et al.  Evolving a Roving Eye for Go , 2004, GECCO.

[27]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[28]  Milan Sonka,et al.  Automated Detection of Small-Size Pulmonary Nodules Based on Helical CT Images , 2005, IPMI.

[29]  Francesc J. Ferri,et al.  Comparative study of techniques for large-scale feature selection* *This work was suported by a SERC grant GR/E 97549. The first author was also supported by a FPI grant from the Spanish MEC, PF92 73546684 , 1994 .

[30]  Dario Floreano,et al.  Neuroevolution: from architectures to learning , 2008, Evol. Intell..

[31]  Rudi Deklerck,et al.  Automated feature selection in neuroevolution , 2009, Evol. Intell..

[32]  Jamshid Dehmeshki,et al.  Shape-Based Computer-Aided Detection of Lung Nodules in Thoracic CT Images , 2009, IEEE Transactions on Biomedical Engineering.

[33]  Anil K. Jain,et al.  Algorithms for feature selection: An evaluation , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[34]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[35]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[36]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[37]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[38]  E. Hoffman,et al.  Lung image database consortium: developing a resource for the medical imaging research community. , 2004, Radiology.

[39]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[40]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[41]  Masashi Sugiyama,et al.  Feature Selection for Reinforcement Learning: Evaluating Implicit State-Reward Dependency via Conditional Mutual Information , 2010, ECML/PKDD.

[42]  Kenneth O. Stanley,et al.  Autonomous Evolution of Topographic Regularities in Artificial Neural Networks , 2010, Neural Computation.

[43]  Larry D. Pyeatt,et al.  A comparison between cellular encoding and direct encoding for genetic neural networks , 1996 .

[44]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.

[45]  Peter J. Bentley,et al.  Analysing the Evolvability of Neural Network Agents Through Structural Mutations , 2005, ECAL.

[46]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[47]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[48]  Kenneth O. Stanley,et al.  A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks , 2009, Artificial Life.

[49]  Inman Harvey,et al.  Incremental evolution of neural network architectures for adaptive behavior , 1993, ESANN.

[50]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  David B. Skalak,et al.  Prototype and Feature Selection by Sampling and Random Mutation Hill Climbing Algorithms , 1994, ICML.

[52]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[53]  Lei Yu,et al.  Sample aware embedded feature selection for reinforcement learning , 2012, GECCO '12.

[54]  Piergiorgio Cerello,et al.  A novel multithreshold method for nodule detection in lung CT. , 2009, Medical physics.

[55]  Berkman Sahiner,et al.  The effect of nodule segmentation on the accuracy of computerized lung nodule detection on CT scans: comparison on a data set annotated by multiple radiologists , 2007, SPIE Medical Imaging.

[56]  Risto Miikkulainen,et al.  Automatic feature selection in neuroevolution , 2005, GECCO '05.

[57]  Risto Miikkulainen,et al.  Solving Non-Markovian Control Tasks with Neuro-Evolution , 1999, IJCAI.

[58]  James V. Miller,et al.  An Analysis of Early Studies Released by the Lung Imaging Database Consortium (LIDC) , 2006, MICCAI.

[59]  Ilaria Gori,et al.  Pleural nodule identification in low-dose and thin-slice lung computed tomography , 2009, Comput. Biol. Medicine.

[60]  P. Cooperberg,et al.  Computer-aided detection in screening CT for pulmonary nodules. , 2006, AJR. American journal of roentgenology.