Weberized Mumford-Shah Model with Bose-Einstein Photon Noise

AbstractHuman vision works equally well in a large dynamic range of light intensities, from only a few photons to typical midday sunlight. Contributing to such remarkable flexibility is a famous law in perceptual (both visual and aural) psychology and psychophysics known as Weber's Law. The current paper develops a new segmentation model based on the integration of Weber's Law and the celebrated Mumford-Shah segmentation model (Comm. Pure Appl. Math., vol. 42, pp. 577-685, 1989). Explained in detail are issues concerning why the classical Mumford-Shah model lacks light adaptivity, and why its "weberized" version can more faithfully reflect human vision's superior segmentation capability in a variety of illuminance conditions from dawn to dusk. It is also argued that the popular Gaussian noise model is physically inappropriate for the weberization procedure. As a result, the intrinsic thermal noise of photon ensembles is introduced based on Bose and Einstein's distributions in quantum statistics, which turns out to be compatible with weberization both analytically and computationally. The current paper focuses on both the theory and computation of the weberized Mumford-Shah model with Bose-Einstein noise. In particular, Ambrosio-Tortorelli's Γ-convergence approximation theory is adapted (Boll. Un. Mat. Ital. B, vol. 6, pp. 105-123, 1992), and stable numerical algorithms are developed for the associated pair of nonlinear Euler-Lagrange PDEs.

[1]  Ernst Heinrich Weber,et al.  De pulsu, resorptione, auditu et tactu. Annotationes anatomicae et physiologicae , 1834 .

[2]  W. Fleming,et al.  An integral formula for total gradient variation , 1960 .

[3]  J. Milnor.  Topology from the differentiable viewpoint , 1965 .

[4]  E. Giusti.  Minimal surfaces and functions of bounded variation , 1977 .

[5]  S. Orszag,et al.  Advanced Mathematical Methods For Scientists And Engineers , 1979 .

[6]  Ulf Grenander,et al.  Lectures in pattern theory , 1978 .

[7]  R. Normann,et al.  The effects of background illumination on the photoresponses of red and green cones. , 1979, The Journal of physiology.

[8]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  D. Tranchina,et al.  Retinal light adaptation—evidence for a feedback mechanism , 1984, Nature.

[10]  C. Enroth-Cugell,et al.  Chapter 9 Visual adaptation and retinal gain controls , 1984 .

[11]  Jürg T. Marti.  Introduction to Sobolev spaces and finite element solution of elliptic boundary value problems , 1986 .

[12]  D. Chandler,et al.  Introduction To Modern Statistical Mechanics , 1987 .

[13]  D. Tranchina,et al.  Light adaptation in the turtle retina: embedding a parametric family of linear models in a single nonlinear model , 1988, Visual Neuroscience.

[14]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[15]  E. D. Giorgi,et al.  Existence theorem for a minimum problem with free discontinuity set , 1989 .

[16]  G. Fain,et al.  Calcium and the mechanism of light adaptation in vertebrate photoreceptors , 1990, Trends in Neurosciences.

[17]  P. Mcnaughton,et al.  Light response of vertebrate photoreceptors. , 1990, Physiological reviews.

[18]  T. Lamb,et al.  Cyclic GMP and calcium: The internal messengers of excitation and adaptation in vertebrate photoreceptors , 1990, Vision Research.

[19]  L. Ambrosio,et al.  Approximation of functional depending on jumps by elliptic functional via t-convergence , 1990 .

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[22]  Jean-Michel Morel,et al.  A variational method in image segmentation: Existence and approximation results , 1992 .

[23]  Stanley Osher,et al.  Total variation based image restoration with free local constraints , 1994, Proceedings of 1st International Conference on Image Processing.

[24]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[25]  Antonin Chambolle,et al.  Image Segmentation by Variational Methods: Mumford and Shah Functional and the Discrete Approximations , 1995, SIAM J. Appl. Math..

[26]  P. Lions,et al.  Image recovery via total variation minimization and related problems , 1997 .

[27]  James P. Keener,et al.  Mathematical physiology , 1998 .

[28]  Andrea Braides.  Approximation of Free-Discontinuity Problems , 1998 .

[29]  A. Chambolle.  FINITE-DIFFERENCES DISCRETIZATIONS OF THE MUMFORD-SHAH FUNCTIONAL , 1999 .

[30]  Anthony J. Yezzi,et al.  Curve evolution implementation of the Mumford-Shah functional for image segmentation, denoising, interpolation, and magnification , 2001, IEEE Trans. Image Process..

[31]  L. Vese,et al.  A level set algorithm for minimizing the Mumford-Shah functional in image processing , 2001, Proceedings IEEE Workshop on Variational and Level Set Methods in Computer Vision.

[32]  Tony F. Chan,et al.  Variational PDE models in image processing , 2002 .

[33]  Jianhong Shen,et al.  Inpainting and the Fundamental Problem of Image Processing , 2002 .

[34]  Jianhong Shen,et al.  Digital inpainting based on the Mumford–Shah–Euler image model , 2002, European Journal of Applied Mathematics.

[35]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[36]  T. Chan,et al.  On the role of the BV image model in image restoration , 2003 .

[37]  Tony F. Chan,et al.  Euler's Elastica and Curvature-Based Inpainting , 2003, SIAM J. Appl. Math..

[38]  Jianhong Shen,et al.  On the foundations of vision modeling: I. Weber’s law and Weberized TV restoration , 2003 .

[39]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[40]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[41]  Marion Kee,et al.  Analysis , 2004, Machine Translation.

[42]  T. Poggio,et al.  The Mathematics of Learning: Dealing with Data , 2005, 2005 International Conference on Neural Networks and Brain.

[43]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[44]  G. Alberti,et al.  A Note on the Theory of SBV Functions , 2007 .