Fuzzy connectedness and image segmentation

Image segmentation-the process of defining objects in images-remains the most challenging problem in image processing despite decades of research. Many general methodologies have been proposed to date to tackle this problem. An emerging framework that has shown considerable promise recently is that of fuzzy connectedness. Images are by nature fuzzy. Object regions manifest themselves in images with a heterogeneity of image intensities owing to the inherent object material heterogeneity, and artifacts such as blurring, noise and background variation introduced by the imaging device. In spite of this gradation of intensities, knowledgeable observers can perceive object regions as a gestalt. The fuzzy connectedness framework aims at capturing this notion via a fuzzy topological notion called fuzzy connectedness which defines how the image elements hang together spatially in spite of their gradation of intensities. In defining objects in a given image, the strength of connectedness between every pair of image elements is considered, which in turn is determined by considering all possible connecting paths between the pair. In spite of a high combinatorial complexity, theoretical advances in fuzzy connectedness have made it possible to delineate objects via dynamic programming at close to interactive speeds on modern PCs. This paper gives a tutorial review of the fuzzy connectedness framework delineating the various advances that have been made. These are illustrated with several medical applications in the areas of Multiple Sclerosis of the brain, magnetic resonance (MR) and computer tomographic (CT) angiography, brain tumor, mammography, upper airway disorders in children, and colonography.

[1]  Clutterbuck.  Lectures on Diseases of the Nervous System , 1827, Buffalo Medical and Surgical Journal.

[2]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[3]  Richard L. Grimsdale,et al.  A system for the automatic recognition of patterns , 1959 .

[4]  Azriel Rosenfeld,et al.  Connectivity in Digital Pictures , 1970, JACM.

[5]  James C. Bezdek,et al.  Fuzzy mathematics in pattern classification , 1973 .

[6]  J. Wolfe.  Breast parenchymal patterns and their changes with age. , 1976, Radiology.

[7]  J. Wolfe.  Breast patterns as an index of risk for developing breast cancer. , 1976, AJR. American journal of roentgenology.

[8]  A. Bonaert.  Introduction to the theory of Fuzzy subsets , 1977, Proceedings of the IEEE.

[9]  A. Kaufman,et al.  Introduction to the Theory of Fuzzy Subsets. , 1977 .

[10]  Azriel Rosenfeld,et al.  Fuzzy Digital Topology , 1979, Inf. Control..

[11]  J. Kurtzke,et al.  Geographic distribution of multiple sclerosis: An update with special reference to Europe and the Mediterranean region , 1980, Acta neurologica Scandinavica.

[12]  Gabor T. Herman,et al.  The theory, design, implementation and evaluation of a three-dimensional surface detection algorithm , 1980, SIGGRAPH '80.

[13]  Azriel Rosenfeld,et al.  Three-Dimensional Digital Topology , 1981, Inf. Control..

[14]  Anil K. Jain,et al.  A Clustering Performance Measure Based on Fuzzy Set Decomposition , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Sargur N. Srihari,et al.  Boundary Detection in Multidimensions , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  J. Kurtzke.  Rating neurologic impairment in multiple sclerosis , 1983, Neurology.

[17]  Azriel Rosenfeld,et al.  The fuzzy geometry of image subsets , 1984, Pattern Recognit. Lett..

[18]  Azriel Rosenfeld,et al.  Digital topology: Introduction and survey , 1989, Comput. Vis. Graph. Image Process..

[19]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[20]  N. Boyd,et al.  The risk of breast cancer associated with mammographic parenchymal patterns: a meta-analysis of the published literature to examine the effect of method of classification. , 1992, Cancer detection and prevention.

[21]  Jayaram K. Udupa,et al.  Shell rendering , 1993, IEEE Computer Graphics and Applications.

[22]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[23]  Supun Samarasekera,et al.  Fuzzy connectedness and object definition , 1995, Medical Imaging.

[24]  A I Pack,et al.  Upper airway and soft tissue anatomy in normal subjects and patients with sleep-disordered breathing. Significance of the lateral pharyngeal walls. , 1995, American journal of respiratory and critical care medicine.

[25]  Silvana G. Dellepiane,et al.  Extraction of intensity connectedness for image processing , 1995, Pattern Recognit. Lett..

[26]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[27]  Supun Samarasekera,et al.  Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 1996, CVGIP Graph. Model. Image Process..

[28]  Silvana G. Dellepiane,et al.  Nonlinear image labeling for multivalued segmentation , 1996, IEEE Trans. Image Process..

[29]  Narendra Ahuja,et al.  Multiscale image segmentation by integrated edge and region detection , 1997, IEEE Trans. Image Process..

[30]  Supun Samarasekera,et al.  Multiple sclerosis lesion quantification using fuzzy-connectedness principles , 1997, IEEE Transactions on Medical Imaging.

[31]  D. Hemmy,et al.  A Pentium Personal Computer‐Based Craniofacial Three‐Dimensional Imaging and Analysis System , 1997, The Journal of craniofacial surgery.

[32]  J. Udupa,et al.  A new computer-assisted method for the quantification of enhancing lesions in multiple sclerosis. , 1997, Journal of computer assisted tomography.

[33]  Jie Tian,et al.  Pentium PC-based craniofacial 3D imaging and analysis system , 1997, Medical Imaging.

[34]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[35]  Dimitris N. Metaxas,et al.  Automated 3D Segmentation Using Deformable Models and Fuzzy Affinity , 1997, IPMI.

[36]  Dimitris N. Metaxas,et al.  Image-based ventricular blood flow analysis , 1998 .

[37]  R. Dolan,et al.  MS-325: albumin-targeted contrast agent for MR angiography. , 1998, Radiology.

[38]  David H. Eberly,et al.  Zoom-Invariant Vision of Figural Shape: The Mathematics of Cores , 1996, Comput. Vis. Image Underst..

[39]  Jayaram K. Udupa,et al.  Fuzzy connected object definition in images with respect to co-objects , 1999, Medical Imaging.

[40]  Jayaram Udupa,et al.  Age of onset of depression and quantitative neuroanatomic measures: absence of specific correlates , 1999, Psychiatry Research: Neuroimaging.

[41]  J K Udupa,et al.  Differences between relapsing-remitting and chronic progressive multiple sclerosis as determined with quantitative MR imaging. , 1999, Radiology.

[42]  D. Vining.  Virtual colonoscopy. , 1999, Seminars in ultrasound, CT, and MR.

[43]  J K Udupa,et al.  Relapsing-remitting multiple sclerosis: longitudinal analysis of MR images--lack of correlation between changes in T2 lesion volume and clinical findings. , 1999, Radiology.

[44]  J K Udupa,et al.  Brain atrophy in relapsing-remitting multiple sclerosis and secondary progressive multiple sclerosis: longitudinal quantitative analysis. , 2000, Radiology.

[45]  W. Bilker,et al.  Atrophy and High Intensity Lesions , 2000, Neuropsychopharmacology.

[46]  J. Udupa,et al.  Iterative relative fuzzy connectedness and object definition: theory, algorithms, and applications in image segmentation , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[47]  Jayaram K. Udupa,et al.  Multiprotocol MR image segmentation in multiple sclerosis: experience with over 1000 studies , 2000, Medical Imaging: Image Processing.

[48]  Jayaram K. Udupa,et al.  Clutter-free volume rendering for magnetic resonance angiography using fuzzy connectedness , 2000, Int. J. Imaging Syst. Technol..

[49]  Jayaram K. Udupa,et al.  Scale-Based Fuzzy Connected Image Segmentation: Theory, Algorithms, and Validation , 2000, Comput. Vis. Image Underst..

[50]  Jayaram K. Udupa,et al.  Brain tumor segmentation in MRI by using the fuzzy connectedness method , 2001, SPIE Medical Imaging.

[51]  Dev P. Chakraborty,et al.  Breast tissue density quantification via digitized mammograms , 2001, IEEE Transactions on Medical Imaging.

[52]  Noël Bonnet,et al.  Two Methods for Semi-automatic Image Segmentation based on Fuzzy Connectedness and Watersheds , 2001, VIIP.

[53]  Bruno M. Carvalho,et al.  Multiseeded Segmentation Using Fuzzy Connectedness , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Jayaram K. Udupa,et al.  New automatic mode of visualizing the colon via Cine CT , 2001, SPIE Medical Imaging.

[55]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Jayaram K. Udupa,et al.  Automatic bone-free rendering of cerebral aneurysms via 3D CTA , 2001, SPIE Medical Imaging.

[57]  Dzung L. Pham,et al.  Spatial Models for Fuzzy Clustering , 2001, Comput. Vis. Image Underst..

[58]  Jayaram K. Udupa,et al.  Artery-vein separation via MRA-An image processing approach , 2001, IEEE Transactions on Medical Imaging.

[59]  Jayaram K. Udupa,et al.  Relative Fuzzy Connectedness among Multiple Objects: Theory, Algorithms, and Applications in Image Segmentation , 2001, Comput. Vis. Image Underst..

[60]  Jayaram K. Udupa,et al.  Multiprotocol MR Image Segmentation in Multiple Sclerosis , 2001 .

[61]  Jayaram K. Udupa,et al.  Fuzzy Connected Object Delineation: Axiomatic Path Strength Definition and the Case of Multiple Seeds , 2001, Comput. Vis. Image Underst..

[62]  Max A. Viergever,et al.  Objective and reproducible segmentation and quantification of tuberous sclerosis lesions in FLAIR brain MR images , 2001, SPIE Medical Imaging.

[63]  Jayaram K. Udupa,et al.  Protocol-independent brain MRI segmentation method , 2002, SPIE Medical Imaging.

[64]  Andrew F. Laine,et al.  Adaptive speed term based on homogeneity for level-set segmentation , 2002, SPIE Medical Imaging.

[65]  Jayaram K. Udupa,et al.  Fuzzy-connected 3D image segmentation at interactive speeds , 2000, Graph. Model..

[66]  Ponnada A Narayana,et al.  Automatic delineation of Gd enhancements on magnetic resonance images in multiple sclerosis. , 2002, Medical physics.

[67]  J. Udupa,et al.  Three-dimensional Bone-free Rendering of the Cerebral Circulation by Use of Computed Tomographic Angiography and Fuzzy Connectedness , 2002, Neurosurgery.

[68]  Raanan Arens,et al.  Linear dimensions of the upper airway structure during development: assessment by magnetic resonance imaging. , 2002, American journal of respiratory and critical care medicine.

[69]  Andrew F. Laine,et al.  Improving statistics for hybrid segmentation of high-resolution multichannel images , 2002, SPIE Medical Imaging.

[70]  J. Udupa,et al.  Estimation of tumor volume with fuzzy-connectedness segmentation of MR images. , 2002, AJNR. American journal of neuroradiology.

[71]  Jayaram K. Udupa,et al.  Methodology for evaluating image-segmentation algorithms , 2002, SPIE Medical Imaging.

[72]  Raanan Arens,et al.  System for upper airway segmentation and measurement with MR imaging and fuzzy connectedness. , 2003, Academic radiology.

[73]  Jayaram K. Udupa,et al.  Relative Fuzzy Connectedness and Object Definition: Theory, Algorithms, and Applications in Image Segmentation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..