Introducing Geometry in Active Learning for Image Segmentation

We propose an Active Learning approach to training a segmentation classifier that exploits geometric priors to streamline the annotation process in 3D image volumes. To this end, we use these priors not only to select voxels most in need of annotation but to guarantee that they lie on 2D planar patch, which makes it much easier to annotate than if they were randomly distributed in the volume. A simplified version of this approach is effective in natural 2D images. We evaluated our approach on Electron Microscopy and Magnetic Resonance image volumes, as well as on natural images. Comparing our approach against several accepted baselines demonstrates a marked performance increase.

[1]  Raphael Sznitman,et al.  Active Testing for Face Detection and Localization , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Nikolaos Papanikolopoulos,et al.  Multi-class active learning for image classification , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Pascal Fua,et al.  Fast Object Detection with Entropy-Driven Evaluation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Timothy X. Brown,et al.  Reinforcement Learning for Call Admission Control and Routing under Quality of Service Constraints in Multimedia Networks , 2002, Machine Learning.

[5]  Benjamin Schmid,et al.  A high-level 3D visualization API for Java and ImageJ , 2010, BMC Bioinformatics.

[6]  William A. Gale,et al.  A sequential algorithm for training text classifiers , 1994, SIGIR '94.

[7]  Vincent Lepetit,et al.  Supervised Feature Learning for Curvilinear Structure Segmentation , 2013, MICCAI.

[8]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[10]  Fredrik Olsson,et al.  A literature survey of active machine learning in the context of natural language processing , 2009 .

[11]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[12]  Mark Craven,et al.  Multiple-Instance Active Learning , 2007, NIPS.

[13]  Zhuowen Tu,et al.  Combining Generative and Discriminative Models for Semantic Segmentation of CT Scans via Active Learning , 2011, IPMI.

[14]  Pascal Fua,et al.  Supervoxel-Based Segmentation of Mitochondria in EM Image Stacks With Learned Shape Features , 2012, IEEE Transactions on Medical Imaging.

[15]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[16]  Yong Zhang,et al.  A Global Spatial Similarity Optimization Scheme to Track Large Numbers of Dendritic Spines in Time-Lapse Confocal Microscopy , 2011, IEEE Transactions on Medical Imaging.

[17]  Allen Y. Yang,et al.  A Convex Optimization Framework for Active Learning , 2013, 2013 IEEE International Conference on Computer Vision.

[18]  Rong Jin,et al.  Batch mode active learning and its application to medical image classification , 2006, ICML.

[19]  Arnold W. M. Smeulders,et al.  Interaction in the segmentation of medical images: A survey , 2001, Medical Image Anal..

[20]  Manuel Graña,et al.  Abdominal CTA image analisys through active learning and decision random forests: Aplication to AAA segmentation , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[21]  Lars Linsen,et al.  Uncertainty estimation and visualization in probabilistic segmentation , 2014, Comput. Graph..

[22]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[23]  Nelly Gordillo,et al.  State of the art survey on MRI brain tumor segmentation. , 2013, Magnetic resonance imaging.

[24]  Joachim M. Buhmann,et al.  Active learning for semantic segmentation with expected change , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  ZissermanAndrew,et al.  The Pascal Visual Object Classes Challenge , 2015 .

[26]  Ullrich Köthe,et al.  Segmentation of SBFSEM Volume Data of Neural Tissue by Hierarchical Classification , 2008, DAGM-Symposium.

[27]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[28]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[29]  Trevor Darrell,et al.  Active Learning with Gaussian Processes for Object Categorization , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  Burr Settles,et al.  From Theories to Queries: Active Learning in Practice , 2011 .

[31]  Ghassan Hamarneh,et al.  Active Learning for Interactive 3D Image Segmentation , 2011, MICCAI.

[32]  L. Asz.  Random Walks on Graphs: a Survey , 2022 .

[33]  Naftali Tishby,et al.  Query by Committee Made Real , 2005, NIPS.

[34]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[35]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Gang Hua,et al.  A Joint Gaussian Process Model for Active Visual Recognition with Expertise Estimation in Crowdsourcing , 2013, International Journal of Computer Vision.