IntellEditS: Intelligent Learning-Based Editor of Segmentations

Automatic segmentation techniques, despite demonstrating excellent overall accuracy, can often produce inaccuracies in local regions. As a result, correcting segmentations remains an important task that is often laborious, especially when done manually for 3D datasets. This work presents a powerful tool called Intelligent Learning-Based Editor of Segmentations (IntellEditS) that minimizes user effort and further improves segmentation accuracy. The tool partners interactive learning with an energy-minimization approach to editing. Based on interactive user input, a discriminative classifier is trained and applied to the edited 3D region to produce soft voxel labeling. The labels are integrated into a novel energy functional along with the existing segmentation and image data. Unlike the state of the art, IntellEditS is designed to correct segmentation results represented not only as masks but also as meshes. In addition, IntellEditS accepts intuitive boundary-based user interactions. The versatility and performance of IntellEditS are demonstrated on both MRI and CT datasets consisting of varied anatomical structures and resolutions.

[1]  Yoonsuck Choe,et al.  An Interactive Editing Framework for Electron Microscopy Image Segmentation , 2011, ISVC.

[2]  Ghassan Hamarneh,et al.  Active Learning for Interactive 3D Image Segmentation , 2011, MICCAI.

[3]  Shaohua Kevin Zhou,et al.  Fast boosting trees for classification, pose detection, and boundary detection on a GPU , 2011, CVPR 2011 WORKSHOPS.

[4]  Heinz-Otto Peitgen,et al.  3D contour based local manual correction of tumor segmentations in CT scans , 2009, Medical Imaging.

[5]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[6]  Zhuowen Tu,et al.  Probabilistic boosting-tree: learning discriminative models for classification, recognition, and clustering , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Martin Styner,et al.  Comparison and Evaluation of Methods for Liver Segmentation From CT Datasets , 2009, IEEE Transactions on Medical Imaging.

[8]  Wenxian Yang,et al.  User-Friendly Interactive Image Segmentation Through Unified Combinatorial User Inputs , 2010, IEEE Transactions on Image Processing.

[9]  Mo Chen,et al.  Progressive Cut: An Image Cutout Algorithm that Models User Intentions , 2007, IEEE MultiMedia.

[10]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Gareth Funka-Lea,et al.  An Energy Minimization Approach to the Data Driven Editing of Presegmented Images/Volumes , 2006, MICCAI.

[12]  Horst Bischof,et al.  Interactive Texture Segmentation using Random Forests and Total Variation , 2009, BMVC.

[13]  B. S. Manjunath,et al.  Interactive graph cut segmentation of touching neuronal structures from electron micrographs , 2010, 2010 IEEE International Conference on Image Processing.

[14]  Siwei Luo,et al.  CO3 for ultra-fast and accurate interactive segmentation , 2010, ACM Multimedia.

[15]  Generating Signed Distance Fields From Triangle Meshes , 2022 .

[16]  Horst Bischof,et al.  Liver Segmentation in CT Data: A Segmentation Refinement Approach , 2007 .

[17]  Lasse Riis Østergaard,et al.  Active Surface Approach for Extraction of the Human Cerebral Cortex from MRI , 2006, MICCAI.

[18]  Mark Jenkinson,et al.  Non-local Shape Descriptor: A New Similarity Metric for Deformable Multi-modal Registration , 2011, MICCAI.

[19]  Ghassan Hamarneh,et al.  3D live-wire-based semi-automatic segmentation of medical images , 2005, SPIE Medical Imaging.

[20]  Yan Kang,et al.  Interactive 3D editing tools for image segmentation , 2004, Medical Image Anal..