Groupwise Conditional Random Forests for Automatic Shape Classification and Contour Quality Assessment in Radiotherapy Planning

Radiation therapy is used to treat cancer patients around the world. High quality treatment plans maximally radiate the targets while minimally radiating healthy organs at risk. In order to judge plan quality and safety, segmentations of the targets and organs at risk are created, and the amount of radiation that will be delivered to each structure is estimated prior to treatment. If the targets or organs at risk are mislabelled, or the segmentations are of poor quality, the safety of the radiation doses will be erroneously reviewed and an unsafe plan could proceed. We propose a technique to automatically label groups of segmentations of different structures from a radiation therapy plan for the joint purposes of providing quality assurance and data mining. Given one or more segmentations and an associated image we seek to assign medically meaningful labels to each segmentation and report the confidence of that label. Our method uses random forests to learn joint distributions over the training features, and then exploits a set of learned potential group configurations to build a conditional random field (CRF) that ensures the assignment of labels is consistent across the group of segmentations. The CRF is then solved via a constrained assignment problem. We validate our method on 1574 plans, consisting of 17 579 segmentations, demonstrating an overall classification accuracy of 91.58%. Our results also demonstrate the stability of RF with respect to tree depth and the number of splitting variables in large data sets.

[1]  Matthew Turk,et al.  Shape classification through structured learning of matching measures , 2009, CVPR.

[2]  Sébastien Ourselin,et al.  A Multi-image Graph Cut Approach for Cardiac Image Segmentation and Uncertainty Estimation , 2011, STACOM.

[3]  Luc Van Gool,et al.  Real-time facial feature detection using conditional regression forests , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Russell H. Taylor,et al.  A Shape Relationship Descriptor for Radiation Therapy Planning , 2009, MICCAI.

[6]  Thomas Hofmann,et al.  Large Margin Methods for Structured and Interdependent Output Variables , 2005, J. Mach. Learn. Res..

[7]  Ullrich Köthe,et al.  On Oblique Random Forests , 2011, ECML/PKDD.

[8]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[9]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[10]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[11]  Ben Glocker,et al.  Joint Classification-Regression Forests for Spatially Structured Multi-object Segmentation , 2012, ECCV.

[12]  Simon K. Warfield,et al.  Estimation of Inferential Uncertainty in Assessing Expert Segmentation Performance from Staple , 2009, IPMI.

[13]  Guido Gerig,et al.  Multiscale medial shape-based analysis of image objects , 2003, Proc. IEEE.

[14]  Sasa Mutic,et al.  Eliminating inconsistencies in simulation and treatment planning orders in radiation therapy. , 2013, International journal of radiation oncology, biology, physics.

[15]  Derek Hoiem,et al.  Learning CRFs Using Graph Cuts , 2008, ECCV.

[16]  Ghassan Hamarneh,et al.  Probabilistic Multi-Shape Representation Using an Isometric Log-Ratio Mapping , 2010, MICCAI.

[17]  Ghassan Hamarneh,et al.  Convex multi-region probabilistic segmentation with shape prior in the isometric log-ratio transformation space , 2011, 2011 International Conference on Computer Vision.

[18]  Kaleem Siddiqi,et al.  Flux invariants for shape , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  Sasa Mutic,et al.  Standardizing naming conventions in radiation oncology. , 2012, International journal of radiation oncology, biology, physics.

[20]  Dean V. Neubauer,et al.  Acceptance Sampling in Quality Control , 1983 .

[21]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[22]  Remco C. Veltkamp,et al.  A Survey of Content Based 3D Shape Retrieval Methods , 2004, SMI.

[23]  Vladimir Kolmogorov,et al.  Minimizing Nonsubmodular Functions with Graph Cuts-A Review , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Antonio Criminisi,et al.  Fast Multiple Organ Detection and Localization in Whole-Body MR Dixon Sequences , 2011, MICCAI.

[25]  Russell H. Taylor,et al.  A Statistical Approach for Achievable Dose Querying in IMRT Planning , 2010, MICCAI.

[26]  J. Shotton,et al.  Decision Forests for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2011 .

[27]  P. Thomas Fletcher,et al.  Principal geodesic analysis for the study of nonlinear statistics of shape , 2004, IEEE Transactions on Medical Imaging.

[28]  Hui Zhang,et al.  Image segmentation evaluation: A survey of unsupervised methods , 2008, Comput. Vis. Image Underst..

[29]  Yang Wang,et al.  Discriminative Latent Models for Recognizing Contextual Group Activities , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Paul A. Yushkevich,et al.  Segmentation, registration, and measurement of shape variation via image object shape , 1999, IEEE Transactions on Medical Imaging.

[31]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Antonio Criminisi,et al.  Regression Forests for Efficient Anatomy Detection and Localization in CT Studies , 2010, MCV.

[33]  Daniel L. Rubin,et al.  A Comprehensive Descriptor of Shape: Method and Application to Content-Based Retrieval of Similar Appearing Lesions in Medical Images , 2012, Journal of Digital Imaging.

[34]  Horst Bischof,et al.  Localization of 3D Anatomical Structures Using Random Forests and Discrete Optimization , 2010, MCV.

[35]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[36]  S. Osher,et al.  Geometric Level Set Methods in Imaging, Vision, and Graphics , 2011, Springer New York.

[37]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Min Sun,et al.  Conditional regression forests for human pose estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[41]  Jitendra Malik,et al.  Efficient shape matching using shape contexts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  J. Sethian Level set methods : evolving interfaces in geometry, fluid mechanics, computer vision, and materials science , 1996 .

[43]  Laurent D. Cohen,et al.  Automatic Detection and Segmentation of Kidneys in 3D CT Images Using Random Forests , 2012, MICCAI.

[44]  Mehryar Mohri,et al.  Confidence Intervals for the Area Under the ROC Curve , 2004, NIPS.

[45]  Gökhan BakIr,et al.  Predicting Structured Data , 2008 .

[46]  Laurent D. Cohen,et al.  Automatic Detection and Segmentation of Kidneys in 3 D CT Images Using Random Forests , 2012 .

[47]  J. Antolak The Physics of Radiation Therapy , 2015 .

[48]  Timo Kohlberger,et al.  Evaluating Segmentation Error without Ground Truth , 2012, MICCAI.