Nonlinear scale-space analysis in image processing

The objective of this work is to develop and analyze robust and fast image segmentation algorithms. They must be robust to pervasive, large-amplitude noise, which cannot be well characterized in terms of probabilistic distributions. This is because the applications of interest include synthetic aperture radar (SAR) segmentation in which speckle noise is a well-known problem that has defeated many algorithms. The methods must also be robust to blur, because many imaging techniques result in smoothed images. For example, SAR image formation has a natural blur associated with it, due to the finite aperture used in forming the image. We introduce a family of first-order multi-dimensional ordinary differential equations with discontinuous right-hand sides and demonstrate their applicability to segmenting both scalar-valued and vector-valued images, as well as images taking values on a circle. An equation belonging to this family is an inverse diffusion everywhere except at local extrema, where some stabilization is introduced. For this reason, we call these equations “stabilized inverse diffusion equations” (“SIDEs”). Existence and uniqueness of solutions, as well as stability, are proven for SIDEs. A SIDE in one spatial dimension may be interpreted as a limiting case of a semi-discretized Perona-Malik equation [49,50], which, in turn, was proposed in order to overcome certain shortcomings of Gaussian scale spaces [72]. These existing techniques are reviewed in a background chapter. SIDEs are then described and experimentally shown to suppress noise while sharpening edges present in the input image. Their application to the detection of abrupt changes in 1-D signals is also demonstrated. It is shown that a version of the SIDEs optimally solves certain change detection problems. Its relations to the Mumford-Shah functional [44] and to linear programming are discussed. Theoretical performance analysis is carried out, and a fast implementation of the algorithm is described. (Copies available exclusively from MIT Libraries, Rm. 14-0551, Cambridge, MA 02139-4307. Ph. 617-253-5668; Fax 617-253-1690.)

[1]  Ali H. Sayed,et al.  Linear Estimation in Krein Spaces - Part I: Theory , 1996 .

[2]  G. Wyszecki,et al.  Color Science Concepts and Methods , 1982 .

[3]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[4]  Jeffrey H. Shapiro,et al.  Maximum-likelihood multiresolution laser radar range imaging , 1997, IEEE Trans. Image Process..

[5]  Refractor Vision , 2000, The Lancet.

[6]  Ken D. Sauer,et al.  A local update strategy for iterative reconstruction from projections , 1993, IEEE Trans. Signal Process..

[7]  Babak Hassibiy,et al.  Linear Estimation in Krein Spaces -part Ii: Applications , 1996 .

[8]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[9]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[10]  A. Booth Numerical Methods , 1957, Nature.

[11]  S. Panchapakesan,et al.  Inference about the Change-Point in a Sequence of Random Variables: A Selection Approach , 1988 .

[12]  R. Kettig,et al.  Classification of Multispectral Image Data by Extraction and Classification of Homogeneous Objects , 1976, IEEE Transactions on Geoscience Electronics.

[13]  J. Morel,et al.  A multiscale algorithm for image segmentation by variational method , 1994 .

[14]  Ken D. Sauer,et al.  Bayesian estimation of transmission tomograms using segmentation based optimization , 1992 .

[15]  C. Burckhardt Speckle in ultrasound B-mode scans , 1978, IEEE Transactions on Sonics and Ultrasonics.

[16]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[17]  Yoram Bresler,et al.  Theoretical analysis of multispectral image segmentation criteria , 1999, IEEE Trans. Image Process..

[18]  Åke Björck,et al.  Numerical Methods , 1995, Handbook of Marine Craft Hydrodynamics and Motion Control.

[19]  S. Resnick Adventures in stochastic processes , 1992 .

[20]  M. Wertheimer Laws of organization in perceptual forms. , 1938 .

[21]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Pramod P. Khargonekar,et al.  FILTERING AND SMOOTHING IN AN H" SETTING , 1991 .

[23]  J. Weickert Nonlinear diffusion scale-spaces: From the continuous to the discrete setting , 1996 .

[24]  Berthold K. P. Horn Robot vision , 1986, MIT electrical engineering and computer science series.

[25]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[26]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[27]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  R. F. Wagner,et al.  Statistics of Speckle in Ultrasound B-Scans , 1983, IEEE Transactions on Sonics and Ultrasonics.

[29]  C.-C. Jay Kuo,et al.  TECHNIQUES IN TEXTURE ANALYSIS , 1998 .

[30]  Guillermo Sapiro,et al.  From active contours to anisotropic diffusion: connections between basic PDE's in image processing , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[31]  Song-Chun Zhu,et al.  Prior Learning and Gibbs Reaction-Diffusion , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  T. Kailath,et al.  Linear estimation in Krein spaces. II. Applications , 1996, IEEE Trans. Autom. Control..

[33]  L. Rudin,et al.  Feature-oriented image enhancement using shock filters , 1990 .

[34]  Donald Geman,et al.  Constrained Restoration and the Recovery of Discontinuities , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[36]  David V. Hinkley,et al.  Inference about the change-point in a sequence of binomial variables , 1970 .

[37]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[38]  C R Dyer,et al.  Techniques for a structural analysis of dermatoscopic imagery. , 1998, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[39]  Aleksej F. Filippov,et al.  Differential Equations with Discontinuous Righthand Sides , 1988, Mathematics and Its Applications.

[40]  Aggelos K. Katsaggelos,et al.  Hybrid image segmentation using watersheds and fast region merging , 1998, IEEE Trans. Image Process..

[41]  Wayne L. Winston,et al.  Introduction to mathematical programming , 1991 .

[42]  Douglas L. Jones,et al.  Line and boundary detection in speckle images , 1998, IEEE Trans. Image Process..

[43]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[44]  Theodosios Pavlidis,et al.  Segmentation of pictures and maps through functional approximation , 1972, Comput. Graph. Image Process..

[45]  Hamid Krim,et al.  A stochastic diffusion approach to signal denoising , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[46]  Satyanad Kichenassamy,et al.  The Perona-Malik Paradox , 1997, SIAM J. Appl. Math..

[47]  W. Clem Karl,et al.  Multiscale segmentation and anomaly enhancement of SAR imagery , 1997, IEEE Trans. Image Process..

[48]  Rekha Govil,et al.  Neural Networks in Signal Processing , 2000 .

[49]  Claude L. Fennema,et al.  Scene Analysis Using Regions , 1970, Artif. Intell..

[50]  S. Mallat A wavelet tour of signal processing , 1998 .

[51]  Gabor T. Herman,et al.  Image reconstruction from projections : the fundamentals of computerized tomography , 1980 .

[52]  Guillermo Sapiro,et al.  Anisotropic smoothing of posterior probabilities , 1997, Proceedings of International Conference on Image Processing.

[53]  Guillermo Sapiro,et al.  Creating connected representations of cortical gray matter for functional MRI visualization , 1997, IEEE Transactions on Medical Imaging.

[54]  P. Schmid Segmentation of digitized dermatoscopic images by two-dimensional color clustering , 1999, IEEE Transactions on Medical Imaging.

[55]  J. Goodman Statistical Properties of Laser Speckle Patterns , 1963 .

[56]  Guillermo Sapiro,et al.  Robust anisotropic diffusion , 1998, IEEE Trans. Image Process..

[57]  U. Shaked,et al.  H,-OPTIMAL ESTIMATION: A TUTORIAL , 1992 .

[58]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Alan S. Willsky,et al.  A nonlinear diffusion equation as a fast and optimal solver of edge detection problems , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[60]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[61]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[62]  Pietro Perona Orientation diffusions , 1998, IEEE Trans. Image Process..

[63]  M. Stella Atkins,et al.  Fully automatic segmentation of the brain in MRI , 1998, IEEE Transactions on Medical Imaging.

[64]  Rama Chellappa,et al.  Probe-based automatic target recognition in infrared imagery , 1997, IEEE Trans. Image Process..

[65]  Daniel P. Huttenlocher,et al.  Image segmentation using local variation , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[66]  Jean-Michel Morel,et al.  Variational methods in image segmentation , 1995 .

[67]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[68]  Vadim I. Utkin,et al.  Sliding Modes in Control and Optimization , 1992, Communications and Control Engineering Series.