Focused Learning and Proofreading for Delineation of Curvilinear Structures

Many state-of-the-art delineation methods rely on supervised machine learning algorithms. As a result, they require manually annotated training data, which is tedious to obtain. Furthermore, even minor classification errors may significantly affect the topology of the final result. In this paper we propose a unified approach to address both of these problems by taking into account the influence of a potential misclassification on the resulting delineation. In an Active Learning context, we find parts of linear structures that should be annotated first in order to train an effective classifier. In a proofreading context, we similarly find regions of the resulting reconstruction that should be verified in priority to obtain a nearly-perfect result. In both cases, by focusing the attention of the human expert on the potential classification mistakes, which are the most critical parts of the delineation, we reduce the amount of annotation effort. We demonstrate the effectiveness of our approach on a variety of datasets that comprise both biomedical and aerial imagery.

[1]  William A. Gale,et al.  A sequential algorithm for training text classifiers , 1994, SIGIR '94.

[2]  Nikolaos Papanikolopoulos,et al.  Multi-class active learning for image classification , 2009, CVPR.

[3]  Julio Chapeton,et al.  Active learning of neuron morphology for accurate automated tracing of neurites , 2014, Front. Neuroanat..

[4]  Peter F. Neher,et al.  A Machine Learning Based Approach to Fiber Tractography Using Classifier Voting , 2015, MICCAI.

[5]  Badrinath Roysam,et al.  The FARSIGHT Trace Editor: An Open Source Tool for 3-D Inspection and Efficient Pattern Analysis Aided Editing of Automated Neuronal Reconstructions , 2011, Neuroinformatics.

[6]  Eugene W. Myers,et al.  Automatic 3D neuron tracing using all-path pruning , 2011, Bioinform..

[7]  Kristen Grauman,et al.  Large-scale live active learning: Training object detectors with crawled data and crowds , 2011, CVPR.

[8]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Pascal Fua,et al.  Reconstructing Curvilinear Networks Using Path Classifiers and Integer Programming , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Joachim Denzler,et al.  Selecting Influential Examples: Active Learning with Expected Model Output Changes , 2014, ECCV.

[11]  Rich Caruana,et al.  Obtaining Calibrated Probabilities from Boosting , 2005, UAI.

[12]  Joachim M. Buhmann,et al.  Active learning for semantic segmentation with expected change , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jan Dirk Wegner,et al.  Mind the Gap: Modeling Local and Global Context in (Road) Networks , 2014, GCPR.

[14]  Pascal Fua,et al.  Automated Delineation of Dendritic Networks in Noisy Image Stacks , 2008, ECCV.

[15]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[16]  Shaohua Kevin Zhou,et al.  Hierarchical Discriminative Framework for Detecting Tubular Structures in 3D Images , 2013, IPMI.

[17]  Mandy Eberhart,et al.  Decision Forests For Computer Vision And Medical Image Analysis , 2016 .

[18]  Eugene W. Myers,et al.  Proof-editing is the Bottleneck Of 3D Neuron Reconstruction: The Problem and Solutions , 2011, Neuroinformatics.

[19]  Mark Craven,et al.  An Analysis of Active Learning Strategies for Sequence Labeling Tasks , 2008, EMNLP.

[20]  Jan Kautz,et al.  Hierarchical Subquery Evaluation for Active Learning on a Graph , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[22]  Ioannis A. Kakadiaris,et al.  Automatic Morphological Reconstruction of Neurons from Multiphoton and Confocal Microscopy Images Using 3D Tubular Models , 2015, Neuroinformatics.

[23]  Bernt Schiele,et al.  RALF: A reinforced active learning formulation for object class recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Konrad Schindler,et al.  Road networks as collections of minimum cost paths , 2015 .

[25]  Pascal Fua,et al.  Introducing Geometry in Active Learning for Image Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  Hans-Christian Hege,et al.  The Filament Editor: An Interactive Software Environment for Visualization, Proof-Editing and Analysis of 3D Neuron Morphology , 2013, Neuroinformatics.

[27]  Trevor Darrell,et al.  Active Learning with Gaussian Processes for Object Categorization , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[28]  Pietro Perona,et al.  Entropy-based active learning for object recognition , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[29]  Takeo Kanade,et al.  Active sample selection and correction propagation on a gradually-augmented graph , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).