Edge-preserving multiscale image decomposition based on local extrema

We propose a new model for detail that inherently captures oscillations, a key property that distinguishes textures from individual edges. Inspired by techniques in empirical data analysis and morphological image analysis, we use the local extrema of the input image to extract information about oscillations: We define detail as oscillations between local minima and maxima. Building on the key observation that the spatial scale of oscillations are characterized by the density of local extrema, we develop an algorithm for decomposing images into multiple scales of superposed oscillations. Current edge-preserving image decompositions assume image detail to be low contrast variation. Consequently they apply filters that extract features with increasing contrast as successive layers of detail. As a result, they are unable to distinguish between high-contrast, fine-scale features and edges of similar contrast that are to be preserved. We compare our results with existing edge-preserving image decomposition algorithms and demonstrate exciting applications that are made possible by our new notion of detail.

[1]  Silong Peng,et al.  Boundary Processing of bidimensional EMD using texture synthesis , 2005, IEEE Signal Processing Letters.

[2]  J. Serra,et al.  An overview of morphological filtering , 1992 .

[3]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[4]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Jean Claude Nunes,et al.  Texture analysis based on the bidimensional empirical mode decomposition with gray-level co-occurrence models , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[6]  Jack Tumblin,et al.  The Trilateral Filter for High Contrast Images and Meshes , 2003, Rendering Techniques.

[7]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[8]  Lihua Yang,et al.  The study of the intermittency test filtering character of Hilbert-Huang transform , 2005, Math. Comput. Simul..

[9]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, ACM Trans. Graph..

[10]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[11]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, ACM Trans. Graph..

[12]  Reginald L. Lagendijk,et al.  Regularized iterative image restoration with ringing reduction , 1988, IEEE Trans. Acoust. Speech Signal Process..

[13]  Szymon Rusinkiewicz,et al.  Multiscale shape and detail enhancement from multi-light image collections , 2007, ACM Trans. Graph..

[14]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[15]  Dani Lischinski,et al.  Colorization using optimization , 2004, ACM Trans. Graph..

[16]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, ACM Trans. Graph..

[17]  Donald P. Greenberg,et al.  Multiscale Model of Adaptation, Spatial Vision and Color Appearance , 1999, Color Imaging Conference.

[18]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[19]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[20]  Christophe Damerval,et al.  A fast algorithm for bidimensional EMD , 2005, IEEE Signal Processing Letters.

[21]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.