Investigation of the Role of Feature Selection and Weighted Voting in Random Forests for 3-D Volumetric Segmentation

This paper describes a novel 3-D segmentation technique posed within the Random Forests (RF) classification framework. Two improvements over the traditional RF framework are considered. Motivated by the high redundancy of feature selection in the traditional RF framework, the first contribution develops methods to improve voxel classification by selecting relatively “strong” features and neglecting “weak” ones. The second contribution involves weighting each tree in the forest during the testing stage, to provide an unbiased and more accurate decision than provided by the traditional RF. To demonstrate the improvement achieved by these enhancements, experimental validation is performed on adult brain MRI and 3-D fetal femoral ultrasound datasets. In a comparison of the new method with a traditional Random Forest, the new method showed a notable improvement in segmentation accuracy. We also compared the new method with other state-of-the-art techniques to place it in context of the current 3-D medical image segmentation literature.

[1]  Pierre-Emmanuel Jouve,et al.  Optimisation and Evaluation of Random Forests for Imbalanced Datasets , 2006, ISMIS.

[2]  Ben Glocker,et al.  Neighbourhood Approximation Forests , 2012, MICCAI.

[3]  Olivier Clatz,et al.  Spatial Decision Forests for MS Lesion Segmentation in Multi-Channel MR Images , 2010, MICCAI.

[4]  Jane Labadin,et al.  Feature selection based on mutual information , 2015, 2015 9th International Conference on IT in Asia (CITA).

[5]  Andrew Blake,et al.  Discriminative, Semantic Segmentation of Brain Tissue in MR Images , 2009, MICCAI.

[6]  Roberto Cipolla,et al.  Semantic texton forests for image categorization and segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[8]  Paul M. Thompson,et al.  Brain Anatomical Structure Segmentation by Hybrid Discriminative/Generative Models , 2008, IEEE Transactions on Medical Imaging.

[9]  Luc Van Gool,et al.  On-line Hough Forests , 2011, BMVC.

[10]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[11]  Antonio Criminisi,et al.  Fast Multiple Organ Detection and Localization in Whole-Body MR Dixon Sequences , 2011, MICCAI.

[12]  Luc Van Gool,et al.  Hough Forests for Object Detection, Tracking, and Action Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Vincent Lepetit,et al.  Keypoint recognition using randomized trees , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Dimitris N. Metaxas,et al.  Entangled Decision Forests and Their Application for Semantic Segmentation of CT Images , 2011, IPMI.

[15]  Antonio Criminisi,et al.  Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes , 2009 .

[16]  J. Ashburner,et al.  Multimodal Image Coregistration and Partitioning—A Unified Framework , 1997, NeuroImage.

[17]  Rich Caruana,et al.  An empirical comparison of supervised learning algorithms , 2006, ICML.

[18]  Jason H. Moore,et al.  Feature Selection using a Random Forests Classifier for the Integrated Analysis of Multiple Data Types , 2006, 2006 IEEE Symposium on Computational Intelligence and Bioinformatics and Computational Biology.

[19]  Wen-June Wang,et al.  Feature selection algorithm for classification of multispectral MR images using constrained energy minimization , 2010, 2010 10th International Conference on Hybrid Intelligent Systems.

[20]  Qi Tian,et al.  Feature Extraction and Selection for Image Retrieval , 2000 .

[21]  Yali Amit,et al.  Shape Quantization and Recognition with Randomized Trees , 1997, Neural Computation.

[22]  J. Alison Noble,et al.  Improving the Classification Accuracy of the Classic RF Method by Intelligent Feature Selection and Weighted Voting of Trees with Application to Medical Image Segmentation , 2011, MLMI.

[23]  Andrew Blake,et al.  Random Forest Classification for Automatic Delineation of Myocardium in Real-Time 3D Echocardiography , 2009, FIMH.

[24]  J. C. Fu,et al.  Image segmentation feature selection and pattern classification for mammographic microcalcifications. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[25]  Laurent D. Cohen,et al.  Automatic Detection and Segmentation of Kidneys in 3 D CT Images Using Random Forests , 2012 .

[26]  George C. Runger,et al.  Gene selection with guided regularized random forest , 2012, Pattern Recognit..

[27]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[28]  J. Alison Noble,et al.  Automatic detection of local fetal brain structures in ultrasound images , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[29]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[30]  C. Cooper,et al.  Growth and bone development. , 2008, Nestle Nutrition workshop series. Paediatric programme.

[31]  Bir Bhanu,et al.  Image retrieval with feature selection and relevance feedback , 2010, 2010 IEEE International Conference on Image Processing.

[32]  Antonio Criminisi,et al.  Regression Forests for Efficient Anatomy Detection and Localization in CT Studies , 2010, MCV.

[33]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Antonio Criminisi,et al.  A Discriminative-Generative Model for Detecting Intravenous Contrast in CT Images , 2011, MICCAI.

[35]  J. Carlin,et al.  Maternal vitamin D in pregnancy may influence not only offspring bone mass but other aspects of musculoskeletal health and adiposity. , 2008, Medical hypotheses.

[36]  Mladen Kolar,et al.  Feature Selection in High-Dimensional Classification , 2013, ICML.

[37]  Antonio Criminisi,et al.  Object Class Segmentation using Random Forests , 2008, BMVC.

[38]  Chao Chen,et al.  Using Random Forest to Learn Imbalanced Data , 2004 .

[39]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[40]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[41]  Witold R. Rudnicki,et al.  The All Relevant Feature Selection using Random Forest , 2011, ArXiv.

[42]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Olivier Clatz,et al.  Spatial decision forests for MS lesion segmentation in multi-channel magnetic resonance images , 2011, NeuroImage.

[44]  Ben Glocker,et al.  Decision Forests for Tissue-Specific Segmentation of High-Grade Gliomas in Multi-channel MR , 2012, MICCAI.

[45]  Keith M. Godfrey,et al.  The use of 3D ultrasound to investigate fetal bone development , 2009 .

[46]  Z Alfirevic,et al.  Practice guidelines for performance of the routine mid‐trimester fetal ultrasound scan , 2011, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[47]  C. Cooper,et al.  Maternal vitamin D status during pregnancy and child outcomes , 2008, European Journal of Clinical Nutrition.

[48]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[49]  Timothy F. Cootes,et al.  Automatic Location of Vertebrae on DXA Images Using Random Forest Regression , 2012, MICCAI.

[50]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[51]  Nicholas Ayache,et al.  Layered Spatio-temporal Forests for Left Ventricle Segmentation from 4D Cardiac MRI Data , 2011, STACOM.

[52]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[53]  Kashif Rajpoot,et al.  Local-phase based 3D boundary detection using monogenic signal and its application to real-time 3-D echocardiography images , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[54]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[55]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[56]  George C. Runger,et al.  Feature selection via regularized trees , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[58]  Gustavo Carneiro,et al.  Detection and Measurement of Fetal Anatomies from Ultrasound Images using a Constrained Probabilistic Boosting Tree , 2008, IEEE Transactions on Medical Imaging.

[59]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..