Color Affine Subspace Pursuit for Color Artifact Removal

This paper proposes color affine subspace pursuit (CASSP) for color artifact removal. Local patches in natural color images tend to exhibit a line distribution, so-called a color line. According to this characteristic, a convex-optimization-based image recovery with a local color nuclear norm (LCNN) has conventionally been introduced to promote the color line property of local patches and succeeded in removing color artifacts. It is, however, often the case that a local patch does not form a line distribution, but a union of affine subspaces (UoAS), e.g., a patch consisting of two different colors. In such regions, the LCNN often results in color fading or color smearing. This paper promotes the UoAS property, i.e., the color line or plane distribution for each affine subspace in local patches by using CASSP. Our cost function for the CASSP consists of the LCNN for each centered color distribution cluster. Experimental results show that the CASSP improves both numerical reconstruction error and subjective visual quality, compared with the LCNN.

[1]  Michael Elad,et al.  Trainlets: Dictionary Learning in High Dimensions , 2016, IEEE Transactions on Signal Processing.

[2]  Shunsuke Ono,et al.  A Convex Regularizer for Reducing Color Artifact in Color Image Recovery , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Daniel Cremers,et al.  The Natural Vectorial Total Variation Which Arises from Geometric Measure Theory , 2012, SIAM J. Imaging Sci..

[4]  I. M. Otivation Playing with Duality: An Overview of Recent Primal-Dual Approaches for Solving Large-Scale Optimization Problems , 2018 .

[5]  Stanley Osher,et al.  Nonlocal Structure Tensor Functionals for Image Regularization , 2015, IEEE Transactions on Computational Imaging.

[6]  P. L. Combettes,et al.  A proximal decomposition method for solving convex variational inverse problems , 2008, 0807.2617.

[7]  Raymond H. Chan,et al.  An Efficient Two-Phase ${\rm L}^{1}$-TV Method for Restoring Blurred Images with Impulse Noise , 2010, IEEE Transactions on Image Processing.

[8]  Nelly Pustelnik,et al.  A Nonlocal Structure Tensor-Based Approach for Multicomponent Image Recovery Problems , 2014, IEEE Transactions on Image Processing.

[9]  José M. Bioucas-Dias,et al.  An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems , 2009, IEEE Transactions on Image Processing.

[10]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Karl Kunisch,et al.  Total Generalized Variation , 2010, SIAM J. Imaging Sci..

[12]  Shunsuke Ono,et al.  Vectorial total variation based on arranged structure tensor for multichannel image restoration , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Karen O. Egiazarian,et al.  BM3D Frames and Variational Image Deblurring , 2011, IEEE Transactions on Image Processing.

[14]  Bang Công Vu,et al.  A splitting algorithm for dual monotone inclusions involving cocoercive operators , 2011, Advances in Computational Mathematics.

[15]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[16]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[17]  Shunsuke Ono,et al.  Decorrelated Vectorial Total Variation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[19]  Nelly Pustelnik,et al.  Parallel Proximal Algorithm for Image Restoration Using Hybrid Regularization , 2009, IEEE Transactions on Image Processing.

[20]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[21]  Ilker Bayram,et al.  Directional Total Variation , 2012, IEEE Signal Processing Letters.

[22]  T. Chan,et al.  Fast dual minimization of the vectorial total variation norm and applications to color image processing , 2008 .

[23]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[24]  Shunsuke Ono,et al.  Color-Line Regularization for Color Artifact Removal , 2016, IEEE Transactions on Computational Imaging.