Active Learning and Proofreading for Delineation of Curvilinear Structures

Many state-of-the-art delineation methods rely on supervised machine learning algorithms. As a result, they require manually annotated training data, which is tedious to obtain. Furthermore, even minor classification errors may significantly affect the topology of the final result. In this paper we propose a generic approach to addressing both of these problems by taking into account the influence of a potential misclassification on the resulting delineation. In an Active Learning context, we identify parts of linear structures that should be annotated first in order to train a classifier effectively. In a proofreading context, we similarly find regions of the resulting reconstruction that should be verified in priority to obtain a nearly-perfect result. In both cases, by focusing the attention of the human expert on potential classification mistakes which are the most critical parts of the delineation, we reduce the amount of required supervision. We demonstrate the effectiveness of our approach on microscopy images depicting blood vessels and neurons.

[1]  Ioannis A. Kakadiaris,et al.  Automatic Morphological Reconstruction of Neurons from Multiphoton and Confocal Microscopy Images Using 3D Tubular Models , 2015, Neuroinformatics.

[2]  Joachim Denzler,et al.  Selecting Influential Examples: Active Learning with Expected Model Output Changes , 2014, ECCV.

[3]  Eugene W. Myers,et al.  Automatic 3D neuron tracing using all-path pruning , 2011, Bioinform..

[4]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[5]  Max W. K. Law,et al.  Three Dimensional Curvilinear Structure Detection Using Optimally Oriented Flux , 2008, ECCV.

[6]  Jan Dirk Wegner,et al.  Mind the Gap: Modeling Local and Global Context in (Road) Networks , 2014, GCPR.

[7]  Pascal Fua,et al.  Detecting Irregular Curvilinear Structures in Gray Scale and Color Imagery Using Multi-directional Oriented Flux , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  Vincent Lepetit,et al.  Supervised Feature Learning for Curvilinear Structure Segmentation , 2013, MICCAI.

[9]  Pascal Fua,et al.  Active Learning for Delineation of Curvilinear Structures , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Pascal Fua,et al.  Reconstructing Curvilinear Networks Using Path Classifiers and Integer Programming , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Peter F. Neher,et al.  A Machine Learning Based Approach to Fiber Tractography Using Classifier Voting , 2015, MICCAI.

[12]  Wayne A. Gordon,et al.  Genetic Data Sharing and Privacy , 2014, Neuroinformatics.

[13]  Vincent Lepetit,et al.  Multiscale Centerline Detection , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Shaohua Kevin Zhou,et al.  Hierarchical Discriminative Framework for Detecting Tubular Structures in 3D Images , 2013, IPMI.

[15]  Eugene W. Myers,et al.  Proof-editing is the Bottleneck Of 3D Neuron Reconstruction: The Problem and Solutions , 2011, Neuroinformatics.

[16]  Pascal Fua,et al.  Automated Delineation of Dendritic Networks in Noisy Image Stacks , 2008, ECCV.

[17]  Hans-Christian Hege,et al.  The Filament Editor: An Interactive Software Environment for Visualization, Proof-Editing and Analysis of 3D Neuron Morphology , 2013, Neuroinformatics.

[18]  Christian Blum,et al.  A matheuristic for the minimum weight rooted arborescence problem , 2015, J. Heuristics.