Active learning of Hybrid Extreme Rotation Forests for CTA image segmentation

This paper proposes a Hybrid Extreme Rotation Forest (HERF) classifier for segmentation of 3D Computed Tomography Angiography (CTA) following an Active Learning (AL) approach. The HERF is an ensemble of classifiers composed of Extreme Learning Machines (ELM) and Decision Trees. Training of the HERF includes optimal rotation of random partitions of the feature set aimed to increase diversity. AL follows an strategy of optimal sample selection in order to minimize the number of data samples needed to obtain a required accuracy degree. AL is pertinent for interactive learning processes where a human operator is required to select training samples to enhance the classifier in an iterative process, therefore labeling samples for training may be a time consuming and expensive process. CTA image segmentation is one of such processes, due to the variability in CTA images which hinders the generalization of classifiers trained on one dataset to new datasets. Following an AL strategy, the human operator is presented with a visual selection of pixels whose labeling would be most informative for the classifier. After adding those labeled pixels to the training data, the classifier is retrained. This iteration is repeated until image segmentation quality meets the required level. The approach is applied to the segmentation of the thrombus in CTA data of Abdominal Aortic Aneurysm (AAA) patients, showing that the structures of interest in CTA volume can be accurately segmented after a few iterations using a small data sample.

[1]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[2]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[3]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Hung Keng Pung,et al.  Systemical convergence rate analysis of convex incremental feedforward neural networks , 2009, Neurocomputing.

[5]  Manuel Graña,et al.  Detection of type II endoleaks in abdominal aortic aneurysms after endovascular repair , 2011, Comput. Biol. Medicine.

[6]  Isabelle Bloch,et al.  A review of 3D vessel lumen segmentation techniques: Models, features and extraction schemes , 2009, Medical Image Anal..

[7]  H. Kaiser The varimax criterion for analytic rotation in factor analysis , 1958 .

[8]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[9]  J. Alison Noble,et al.  Improving the Classification Accuracy of the Classic RF Method by Intelligent Feature Selection and Weighted Voting of Trees with Application to Medical Image Segmentation , 2011, MLMI.

[10]  David A. Cohn,et al.  Improving generalization with active learning , 1994, Machine Learning.

[11]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[12]  Leo Joskowicz,et al.  AN iterative model-constrained graph-cut algorithm for Abdominal Aortic Aneurysm thrombus segmentation , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[14]  Chee Kheong Siew,et al.  Incremental extreme learning machine with fully complex hidden nodes , 2008, Neurocomputing.

[15]  Nan Liu,et al.  Voting based extreme learning machine , 2012, Inf. Sci..

[16]  Manuel Graña,et al.  Knowledge management in image-based analysis of blood vessel structures , 2010, Knowledge and Information Systems.

[17]  Punyaphol Horata,et al.  Robust extreme learning machine , 2013, Neurocomputing.

[18]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[19]  Olivier Clatz,et al.  Spatial Decision Forests for MS Lesion Segmentation in Multi-Channel MR Images , 2010, MICCAI.

[20]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[21]  William J. Emery,et al.  Using active learning to adapt remote sensing image classifiers , 2011 .

[22]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[23]  Guang-Bin Huang,et al.  Convex incremental extreme learning machine , 2007, Neurocomputing.