Higher-Order Total Directional Variation. Part I: Imaging Applications

We introduce a new class of higher-order total directional variation regularizers. These regularizers extend the directional total variation for a constant direction \cite{directionaltv} to accommodate spatially-adaptive directions and higher-order derivatives. For the numerical solution of the resulting variational regularisation approach, we propose a primal-dual hybrid gradient approach whose details we report in the paper. We demonstrate that the proposed regulariser is able to preserve and enhance intrinsic anisotropic features in images by showing results for different imaging applications: image denoising, wavelet-based image zooming and reconstruction of surfaces from scattered height measurements.

[1]  Xavier Bresson,et al.  Adaptive Regularization With the Structure Tensor , 2015, IEEE Transactions on Image Processing.

[2]  Petros Maragos,et al.  Structure Tensor Total Variation , 2015, SIAM J. Imaging Sci..

[3]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[4]  S. Setzer,et al.  Infimal convolution regularizations with discrete ℓ1-type functionals , 2011 .

[5]  Mila Nikolova,et al.  Local Strong Homogeneity of a Regularized Estimator , 2000, SIAM J. Appl. Math..

[6]  Daniel J Müller,et al.  Atomic force microscopy: a nanoscopic window on the cell surface. , 2011, Trends in cell biology.

[7]  Joachim Weickert,et al.  Coherence-Enhancing Diffusion Filtering , 1999, International Journal of Computer Vision.

[8]  Marta M. Betcke,et al.  Multicontrast MRI Reconstruction with Structure-Guided Total Variation , 2015, SIAM J. Imaging Sci..

[9]  Yiqiu Dong,et al.  Multi-scale Total Variation with Automated Regularization Parameter Selection for Color Image Restoration , 2009, SSVM.

[10]  Xue-Cheng Tai,et al.  Augmented Lagrangian Method, Dual Methods, and Split Bregman Iteration for ROF, Vectorial TV, and High Order Models , 2010, SIAM J. Imaging Sci..

[11]  Tony F. Chan,et al.  High-Order Total Variation-Based Image Restoration , 2000, SIAM J. Sci. Comput..

[12]  Til Aach,et al.  Analysis of Superimposed Oriented Patterns , 2006, IEEE Transactions on Image Processing.

[13]  Rasmus Dalgas Kongskov,et al.  Directional total generalized variation regularization , 2017, BIT Numerical Mathematics.

[14]  Georg Schitter,et al.  High-Speed Atomic Force Microscopy , 2006, Science.

[15]  Andrew P. Witkin,et al.  Analyzing Oriented Patterns , 1985, IJCAI.

[16]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[17]  Kristian Bredies,et al.  A TGV Regularized Wavelet Based Zooming Model , 2013, SSVM.

[18]  Ilker Bayram,et al.  Directional Total Variation , 2012, IEEE Signal Processing Letters.

[19]  Yuanquan Wang,et al.  Edge adaptive directional total variation , 2013 .

[20]  Talal Rahman,et al.  Sparse-Data Based 3D Surface Reconstruction for Cartoon and Map , 2016 .

[21]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[22]  Guillermo Sapiro,et al.  Filling-in by joint interpolation of vector fields and gray levels , 2001, IEEE Trans. Image Process..

[23]  J. Meinguet.  Surface Spline Interpolation: Basic Theory and Computational Aspects , 1984 .

[24]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[25]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  Carola-Bibiane Schönlieb,et al.  Anisotropic Third-Order Regularization for Sparse Digital Elevation Models , 2013, SSVM.

[28]  M. J. Rost,et al.  Scanning probe microscopy at video-rate , 2008 .

[29]  Yann Gousseau,et al.  Interpolation of digital elevation models using AMLE and related methods , 2002, IEEE Trans. Geosci. Remote. Sens..

[30]  Benjamin Berkels,et al.  Cartoon Extraction Based on Anisotropic Image Classification Vision , Modeling , and Visualization Proceedings , 2006 .

[31]  P. Lions,et al.  Axioms and fundamental equations of image processing , 1993 .

[32]  Thomas Arildsen,et al.  Structure assisted compressed sensing reconstruction of undersampled AFM images. , 2017, Ultramicroscopy.

[33]  A. Chambolle,et al.  An introduction to Total Variation for Image Analysis , 2009 .

[34]  Rachid Deriche,et al.  Vector-valued image regularization with PDEs: a common framework for different applications , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Tony F. Chan,et al.  A fourth order dual method for staircase reduction in texture extraction and image restoration problems , 2010, 2010 IEEE International Conference on Image Processing.

[36]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[37]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[38]  L. Evans,et al.  C1,α regularity for infinity harmonic functions in two dimensions , 2008 .

[39]  M. Grasmair,et al.  Anisotropic Total Variation Filtering , 2010 .

[40]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[41]  Antonin Chambolle,et al.  An introduction to continuous optimization for imaging , 2016, Acta Numerica.

[42]  Gabriele Steidl,et al.  Anisotropic Smoothing Using Double Orientations , 2009, SSVM.

[43]  Carola-Bibiane Schönlieb,et al.  A Combined First and Second Order Variational Approach for Image Reconstruction , 2012, Journal of Mathematical Imaging and Vision.

[44]  G. Steidl,et al.  Variational Methods with Higher–Order Derivatives in Image Processing , 2007 .

[45]  Ron Kimmel,et al.  Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images , 2000, International Journal of Computer Vision.

[46]  Christoph Schnörr,et al.  A class of quasi-variational inequalities for adaptive image denoising and decomposition , 2012, Computational Optimization and Applications.

[47]  Carola-Bibiane Schonlieb,et al.  Higher-Order Total Directional Variation. Part II: Analysis , 2018 .

[48]  Antonin Chambolle,et al.  The Discontinuity Set of Solutions of the TV Denoising Problem and Some Extensions , 2007, Multiscale Model. Simul..

[49]  Guillermo Sapiro,et al.  Anisotropic diffusion of multivalued images with applications to color filtering , 1996, IEEE Trans. Image Process..