FISICO: Fast Image SegmentatIon COrrection

Background and Purpose In clinical diagnosis, medical image segmentation plays a key role in the analysis of pathological regions. Despite advances in automatic and semi-automatic segmentation techniques, time-effective correction tools are commonly needed to improve segmentation results. Therefore, these tools must provide faster corrections with a lower number of interactions, and a user-independent solution to reduce the time frame between image acquisition and diagnosis. Methods We present a new interactive method for correcting image segmentations. Our method provides 3D shape corrections through 2D interactions. This approach enables an intuitive and natural corrections of 3D segmentation results. The developed method has been implemented into a software tool and has been evaluated for the task of lumbar muscle and knee joint segmentations from MR images. Results Experimental results show that full segmentation corrections could be performed within an average correction time of 5.5±3.3 minutes and an average of 56.5±33.1 user interactions, while maintaining the quality of the final segmentation result within an average Dice coefficient of 0.92±0.02 for both anatomies. In addition, for users with different levels of expertise, our method yields a correction time and number of interaction decrease from 38±19.2 minutes to 6.4±4.3 minutes, and 339±157.1 to 67.7±39.6 interactions, respectively.

[1]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[2]  P. Sivakumar,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES , 2016 .

[3]  Jan Egger,et al.  Refinement-Cut: User-Guided Segmentation Algorithm for Translational Science , 2014, Scientific Reports.

[4]  Stefan Braunewell,et al.  Sketch-based Image-independent Editing of 3D Tumor Segmentations using Variational Interpolation , 2012, VCBM.

[5]  Lutz-Peter Nolte,et al.  Allograft Selection for Transepiphyseal Tumor Resection Around the Knee Using Three-Dimensional Surface Registration , 2011, Annals of Biomedical Engineering.

[6]  Dinesh D. Patil,et al.  Medical Image Segmentation: A Review , 2013 .

[7]  G. Morrell,et al.  Intramuscular Adipose Tissue, Sarcopenia, and Mobility Function in Older Individuals , 2012, Journal of aging research.

[8]  Leo Joskowicz,et al.  Image Segmentation Errors Correction by Mesh Segmentation and Deformation , 2013, MICCAI.

[9]  Hans Meine,et al.  On the evaluation of segmentation editing tools , 2014, Journal of medical imaging.

[10]  Uncertainty-Aware Guided Volume Segmentation , 2010, IEEE Transactions on Visualization and Computer Graphics.

[11]  John F. Hughes,et al.  Direct manipulation of free-form deformations , 1992, SIGGRAPH.

[12]  Holger Timinger,et al.  Integration of Interactive Corrections to Model-Based Segmentation Algorithms , 2003, Bildverarbeitung für die Medizin.

[13]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[14]  A. Chhabra,et al.  Quantification of muscle fat in patients with low back pain: comparison of multi-echo MR imaging with single-voxel MR spectroscopy. , 2013, Radiology.

[15]  Andrew Blake,et al.  GeoS: Geodesic Image Segmentation , 2008, ECCV.

[16]  Tobias Schwarz,et al.  Interactive surface correction for 3D shape based segmentation , 2008, SPIE Medical Imaging.

[17]  Takashi Ijiri,et al.  Bilateral Hermite Radial Basis Functions for Contour‐based Volume Segmentation , 2013, Comput. Graph. Forum.

[18]  H. Zaidi,et al.  Quantitative Analysis in Nuclear Medicine Imaging , 2007, Journal of Nuclear Medicine.

[19]  Ghassan Hamarneh,et al.  Spotlight: Automated Confidence-Based User Guidance for Increasing Efficiency in Interactive 3D Image Segmentation , 2010, MCV.

[20]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[21]  A. Ardeshir Goshtasby,et al.  A Computer-Aided Design System for Revision of Segmentation Errors , 2005, MICCAI.

[22]  Nils Reimers,et al.  Optimisation of orthopaedic implant design using statistical shape space analysis based on level sets , 2010, Medical Image Anal..

[23]  Stephen J. Ferguson,et al.  Correction tool for Active Shape Model based lumbar muscle segmentation , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  Jasjit S. Suri,et al.  Comprar Multi Modality State-of-the-Art Medical Image Segmentation and Registration Methodologies | El-Baz, A.S. | 9781441982032 | Springer , 2011 .

[25]  Denis Friboulet,et al.  Real-time 3D interactive segmentation of echocardiographic data through user-based deformation of B-spline explicit active surfaces , 2014, Comput. Medical Imaging Graph..

[26]  João Manuel R. S. Tavares,et al.  A Review on the Current Segmentation Algorithms for Medical Images , 2009, IMAGAPP.

[27]  Tim Cootes,et al.  An Introduction to Active Shape Models , 2000 .

[28]  M. Sundaresan,et al.  Survey of image segmentation algorithms on ultrasound medical images , 2013, 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering.

[29]  William J. Schroeder,et al.  The Visualization Toolkit , 2005, The Visualization Handbook.

[30]  Nicholas Ayache,et al.  Medical Image Analysis: Progress over Two Decades and the Challenges Ahead , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  A. El-Baz.  Multi Modality State-of-the-Art Medical Image Segmentation and Registration Methodologies: Volume 1 , 2016 .

[32]  Luis Ibáñez,et al.  The ITK Software Guide , 2005 .

[33]  Mauricio Reyes,et al.  Automatic Scan Planning for Magnetic Resonance Imaging of the Knee Joint , 2012, Annals of Biomedical Engineering.

[34]  Nassir Navab,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2013 , 2013, Lecture Notes in Computer Science.

[35]  Dieter Schmalstieg,et al.  Interactive editing of segmented volumetric datasets in a hybrid 2D/3D virtual environment , 2006, VRST '06.

[36]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[37]  Takashi Ijiri,et al.  Contour‐based Interface for Refining Volume Segmentation , 2010, Comput. Graph. Forum.

[38]  Jan Hendrik Moltz,et al.  Sketch‐Based Editing Tools for Tumour Segmentation in 3D Medical Images , 2013, Comput. Graph. Forum.

[39]  Olivier Ecabert,et al.  Optimizing boundary detection via Simulated Search with applications to multi-modal heart segmentation , 2010, Medical Image Anal..

[40]  O. Ecabert,et al.  Feature optimization via simulated search for model-based heart segmentation , 2005 .

[41]  Georgios Sakas,et al.  FIST: Fast Interactive Segmentation of Tumors , 2011, Abdominal Imaging.

[42]  Ronald M. Summers,et al.  Fast Correction Method for Abdominal Multi-Organ Segmentation Using 2 D / 3 D Free Form Deformation and Posterior Shape Models , 2015 .

[43]  Gareth Funka-Lea,et al.  An Energy Minimization Approach to the Data Driven Editing of Presegmented Images/Volumes , 2006, MICCAI.

[44]  B. Thomas,et al.  Usability Evaluation In Industry , 1996 .

[45]  Luca Viganò,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2015, IWSEC 2015.