Edge-preserving multiscale image decomposition based on local extrema

We propose a new model for detail that inherently captures oscillations, a key property that distinguishes textures from individual edges. Inspired by techniques in empirical data analysis and morphological image analysis, we use the local extrema of the input image to extract information about oscillations: We define detail as oscillations between local minima and maxima. Building on the key observation that the spatial scale of oscillations are characterized by the density of local extrema, we develop an algorithm for decomposing images into multiple scales of superposed oscillations. Current edge-preserving image decompositions assume image detail to be low contrast variation. Consequently they apply filters that extract features with increasing contrast as successive layers of detail. As a result, they are unable to distinguish between high-contrast, fine-scale features and edges of similar contrast that are to be preserved. We compare our results with existing edge-preserving image decomposition algorithms and demonstrate exciting applications that are made possible by our new notion of detail.

[1]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[2]  Reginald L. Lagendijk,et al.  Regularized iterative image restoration with ringing reduction , 1988, IEEE Trans. Acoust. Speech Signal Process..

[3]  J. Serra,et al.  An overview of morphological filtering , 1992 .

[4]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[5]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[6]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[7]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Donald P. Greenberg,et al.  Multiscale Model of Adaptation, Spatial Vision and Color Appearance , 1999, Color Imaging Conference.

[9]  Greg Turk,et al.  LCIS: a boundary hierarchy for detail-preserving contrast reduction , 1999, SIGGRAPH.

[10]  Frédo Durand,et al.  A gentle introduction to bilateral filtering and its applications , 2007, SIGGRAPH Courses.

[11]  F. Durand,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002, ACM Trans. Graph..

[12]  Jean Claude Nunes,et al.  Texture analysis based on the bidimensional empirical mode decomposition with gray-level co-occurrence models , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[13]  Dani Lischinski,et al.  Colorization using optimization , 2004, SIGGRAPH 2004.

[14]  Markku Renfors,et al.  Power efficient structure for conversion between arbitrary sampling rates , 2005, IEEE Signal Processing Letters.

[15]  Lihua Yang,et al.  The study of the intermittency test filtering character of Hilbert-Huang transform , 2005, Math. Comput. Simul..

[16]  Silong Peng,et al.  Boundary Processing of bidimensional EMD using texture synthesis , 2005, IEEE Signal Processing Letters.

[17]  Jack Tumblin,et al.  The trilateral filter for high contrast images and meshes , 2003, Rendering Techniques.

[18]  Christophe Damerval,et al.  A fast algorithm for bidimensional EMD , 2005, IEEE Signal Processing Letters.

[19]  Zeev Farbman,et al.  Interactive local adjustment of tonal values , 2006, SIGGRAPH 2006.

[20]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, SIGGRAPH 2006.

[21]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, SIGGRAPH 2007.

[22]  Maneesh Agrawala,et al.  Multiscale shape and detail enhancement from multi-light image collections , 2007, SIGGRAPH 2007.

[23]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.