Interaction in the segmentation of medical images: A survey

Segmentation of the object of interest is a difficult step in the analysis of digital images. Fully automatic methods sometimes fail, producing incorrect results and requiring the intervention of a human operator. This is often true in medical applications, where image segmentation is particularly difficult due to restrictions imposed by image acquisition, pathology and biological variation. In this paper we present an early review of the largely unknown territory of human-computer interaction in image segmentation. The purpose is to identify patterns in the use of interaction and to develop qualitative criteria to evaluate interactive segmentation methods. We discuss existing interactive methods with respect to the following aspects: the type of information provided by the user, how this information affects the computational part, and the purpose of interaction in the segmentation process. The discussion is based on the potential impact of each strategy on the accuracy, repeatability and interaction efficiency. Among others, these are important aspects to characterise and understand the implications of interaction to the results generated by an interactive segmentation method. This survey is focused on medical imaging, however similar patterns are expected to hold for other applications as well.

[1]  Jocelyne Troccaz,et al.  Isolating Moving Anatomy in Ultrasound Without Anatomical Knowledge: Application to Computer-Assisted Pericardial Punctures , 1998, MICCAI.

[2]  Marcel Worring,et al.  Design considerations for interactive segmentation , 1997 .

[3]  Fernando Bello,et al.  Measuring Global and Local Spatial Correspondence Using Information Theory , 1998, MICCAI.

[4]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[5]  J F Brinkley.  A flexible, generic model for anatomic shape: application to interactive two-dimensional medical image segmentation and matching. , 1993, Computers and biomedical research, an international journal.

[6]  Carla E. Brodley,et al.  ASSERT: A Physician-in-the-Loop Content-Based Retrieval System for HRCT Image Databases , 1999, Comput. Vis. Image Underst..

[7]  William A. Yasnoff,et al.  Error measures for scene segmentation , 1977, Pattern Recognit..

[8]  Stephen M. Pizer,et al.  A Multiresolution Hierarchical Approach to Image Segmentation Based on Intensity Extrema , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  William A. Barrett,et al.  Fast, Accurate, and Reproducible Live-Wire Boundary Extraction , 1996, VBC.

[11]  Lemonia Ragia,et al.  ON THE PERFORMANCE OF SEMI-AUTOMATIC BUILDING EXTRACTION , 1998 .

[12]  Sabine Moisan,et al.  Managing complex processing of medical image sequences by program supervision techniques , 1997, Medical Imaging.

[13]  Arnold W. M. Smeulders,et al.  Simulating Graphics for Performance Analysis Purposes by Combining Real World Background and Synthetic Foreground Data , 1997, GREC.

[14]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[15]  Thomas Ertl,et al.  Fast and Interactive 3D-Segmentation of Medical Volume Data , 1998 .

[16]  Arnold W. M. Smeulders,et al.  Color Invariant Snakes , 1998, BMVC.

[17]  G. Herman,et al.  3D Imaging In Medicine , 1991 .

[18]  Jan Sijbers,et al.  Volume quantization of the mouse cerebellum by semiautomatic 3D segmentation of magnetic resonance images , 1996, Medical Imaging.

[19]  D. Louis Collins,et al.  ANIMAL+INSECT: Improved Cortical Structure Segmentation , 1999, IPMI.

[20]  Jean Sequeira,et al.  Matching Free-form Primitives with 3D Medical Data to Represent Organs and Anatomical Structures , 1990 .

[21]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[22]  Yu Xiaohan,et al.  Interactive surface segmentation for medical images , 1996, Proceedings of Third International Conference on Signal Processing (ICSP'96).

[23]  Konstantinos Konstantinides,et al.  The Khoros software development environment for image and signal processing , 1994, IEEE Trans. Image Process..

[24]  David N. Kennedy,et al.  Automated Segmentation of Brain Exterior in MR Images Driven by Empirical Procedures and Anatomical Knowledge , 1997, IPMI.

[25]  Hanif M. Ladak,et al.  Development and evaluation of a semiautomatic 3D segmentation technique of the carotid arteries from 3D ultrasound images , 1999, Medical Imaging.

[26]  Yongmin Kim,et al.  Interactive segmentation of brain tumors in MR images using 3D region growing , 1993 .

[27]  Silvia Delgado Olabarriaga,et al.  Human-Computer Interaction for the Segmentation of Medical Images , 1999 .

[28]  John M. Gauch,et al.  Image segmentation and analysis via multiscale gradient watershed hierarchies , 1999, IEEE Trans. Image Process..

[29]  Arnold W. M. Smeulders,et al.  Piecewise DM:a locally controllable deformable model , 1999 .

[30]  Franco Fontana,et al.  Multiseed interactive segmentation for 3D visualization using different perspective angles for histological structures , 1993 .

[31]  Jayaram K. Udupa,et al.  Interactive segmentation and boundary surface formation for 3-D digital images , 1982, Comput. Graph. Image Process..

[32]  Arnold W. M. Smeulders,et al.  Setting the Mind for Intelligent Interactive Segmentation: Overview, Requirements, and Framework , 1997, IPMI.

[33]  Guido Gerig,et al.  A user-guided tool for efficient segmentation of medical image data , 1997, CVRMed.

[34]  Stephen M. Pizer,et al.  Toward Interactive Object Definition in 3D Scalar Images , 1990 .

[35]  William E. Higgins,et al.  Graphical user interface system for 3D medical image analysis , 1994, Medical Imaging.

[36]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[37]  P J Elliott,et al.  Interactive region and volume growing for segmenting volumes in MR and CT images. , 1994, Medical informatics = Medecine et informatique.

[38]  Thomas S. Huang,et al.  Image processing , 1971 .

[39]  Supun Samarasekera,et al.  Multiple sclerosis lesion quantification using fuzzy-connectedness principles , 1997, IEEE Transactions on Medical Imaging.

[40]  David H. Eberly,et al.  Interacting with image hierarchies for fast and accurate object segmentation , 1994, Medical Imaging.

[41]  Peter J. Elliott,et al.  Interactive Image Segmentation for Radiation Treatment Planning , 1992, IBM Syst. J..

[42]  Andrew H. Gee,et al.  Volume Measurement in Sequential Freehand 3-D Ultrasound , 1999, IPMI.

[43]  Milan Sonka,et al.  Ovarian ultrasound image analysis: follicle segmentation , 1998, IEEE Transactions on Medical Imaging.

[44]  Tricia Walker,et al.  Computer science , 1996, English for academic purposes series.

[45]  David H. Laidlaw,et al.  The application visualization system: a computational environment for scientific visualization , 1989, IEEE Computer Graphics and Applications.

[46]  Stephen M. Pizer,et al.  Ridge flow models for image segmentation , 1994, Medical Imaging.

[47]  Colin Studholme,et al.  Hierarchical Segmentation Satisfying Constraints , 1994, BMVC.

[48]  Wolfgang Straßer,et al.  3-D segmentation of medical structures by integration of raycasting with anatomic knowledge , 1995, Comput. Graph..

[49]  William A. Barrett,et al.  Interactive Segmentation with Intelligent Scissors , 1998, Graph. Model. Image Process..

[50]  Arnold W. M. Smeulders,et al.  An Intelligent Interactive Segmentation Method for the Joint Space in Osteoarthritic Ankles , 1999, IPMI.

[51]  Russ B. Altman,et al.  Shape-based models for interactive segmentation of medical images , 1995, Medical Imaging.

[52]  Max A. Viergever,et al.  A methodology for the validation of image segmentation methods , 1992, [1992] Proceedings Fifth Annual IEEE Symposium on Computer-Based Medical Systems.

[53]  Riccardo Poli,et al.  Genetic algorithm-based interactive segmentation of 3D medical images , 1999, Image Vis. Comput..

[54]  A Neumann,et al.  Statistical shape model based segmentation of medical images. , 1998, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[55]  Michael Gleicher,et al.  This document was created with FrameMaker 4.0.4 Image Snapping , 2022 .

[56]  William E. Higgins,et al.  Semiautomatic construction of 3D medical image-segmentation processes , 1994, Other Conferences.

[57]  Takashi Matsuyama.  Expert systems for image processing: Knowledge-based composition of image analysis processes , 1989, Comput. Vis. Graph. Image Process..

[58]  H.S. Stiehl.  3D image understanding in radiology , 1990, IEEE Engineering in Medicine and Biology Magazine.

[59]  James S. Duncan,et al.  Medical Image Analysis , 1999, IEEE Pulse.

[60]  A W Smeulders,et al.  The homing cursor: a tool for three-dimensional chromosome analysis. , 1993, Cytometry.

[61]  W. A. Hanson,et al.  Interactive 3D segmentation of MRI and CT volumes using morphological operations. , 1992, Journal of computer assisted tomography.

[62]  Yongmin Kim,et al.  Methodology for evaluation of image segmentation algorithms on medical images , 1996, Medical Imaging.