A color super-resolution with multiple nonsmooth constraints by hybrid steepest descent method

An efficient scheme is presented to the color super-resolution problem for recovery of a color high-resolution image with knowledge of multiple Bayer filtered low-resolution images. To recover a visually natural high-resolution image, we restrict fairly smooth initial candidates to all images satisfying all bounds imposed on the several nonsmooth convex color total variations as well as a non-smooth convex inter cross correlation measure among color channels. In the proposed scheme, the data-fidelity is optimized in a systematic way, over all initial candidates, with the hybrid steepest descent method for quasi-nonexpansive mappings [Yamada & Ogura 2004], by minimizing successively an weighted average of pure mean square errors between the low-resolution transforms of the high-resolution estimate and the multiple low-resolution images. Numerical examples show that the proposed scheme recovers visually natural high resolution images by resolving the tradeoff between noise suppression and edge preservation of the recovered image while keeping fair inter channel cross correlation among color channels.

[1]  Patrick L. Combettes,et al.  Image restoration subject to a total variation constraint , 2004, IEEE Transactions on Image Processing.

[2]  Isao Yamada,et al.  Computation of symmetric positive definite Toeplitz matrices by the hybrid steepest descent method , 2003, Signal Process..

[3]  Isao Yamada,et al.  Efficient Fast Stereo Acoustic Echo Cancellation Based on Pairwise Optimal Weight Realization Technique , 2006, EURASIP J. Adv. Signal Process..

[4]  Yukawa Masahiro,et al.  Efficient robust adaptive beamforming by the Adaptive Projected Subgradient Method -- A set-theoretic time-varying approach over multiple a priori constraints , 2005 .

[5]  Isao Yamada,et al.  An efficient robust adaptive filtering algorithm based on parallel subgradient projection techniques , 2002, IEEE Trans. Signal Process..

[6]  Heinz H. Bauschke,et al.  A Weak-to-Strong Convergence Principle for Fejé-Monotone Methods in Hilbert Spaces , 2001, Math. Oper. Res..

[7]  I. Yamada,et al.  Adaptive Projected Subgradient Method for Asymptotic Minimization of Sequence of Nonnegative Convex Functions , 2005 .

[8]  N. K. Bose,et al.  Algebraic phase unwrapping and zero distribution of polynomial for continuous-time systems , 2002 .

[9]  Tony F. Chan,et al.  Total Variation Denoising and Enhancement of Color Images Based on the CB and HSV Color Models , 2001, J. Vis. Commun. Image Represent..

[10]  Isao Yamada,et al.  Efficient Blind MAI Suppression in DS/CDMA Systems by Embedded Constraint Parallel Projection Techniques , 2005, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[11]  I. Yamada,et al.  Pairwise Optimal Weight Realization—Acceleration Technique for Set-Theoretic Adaptive Parallel Subgradient Projection Algorithm , 2006, IEEE Transactions on Signal Processing.

[12]  Isao Yamada,et al.  An Efficient Distributed Power Control for Infeasible Downlink Scenarios - Global-Local Fixed-Point-Approximation Technique , 2006, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[13]  Isao Yamada,et al.  Set-theoretic DS/CDMA receivers for fading channels by adaptive projected subgradient method , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[14]  Min-Cheol Hong,et al.  An iterative weighted regularized algorithm for improving the resolution of video sequences , 1997, Proceedings of International Conference on Image Processing.

[15]  Isao Yamada,et al.  Adaptive Beamforming by Constrained Parallel Projection in the Presence of Spatially-Correlated Interferences , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[16]  Isao Yamada,et al.  Robust Capon Beamforming by the Adaptive Projected Subgradient Method , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[17]  Isao Yamada,et al.  High-resolution DOA estimation by algebraic phase unwrapping algorithm , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[18]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[19]  Isao Yamada,et al.  Steady-State Performance of Constrained Normalized Adaptive Filters for CDMA Systems , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[20]  Isao Yamada,et al.  Counting the Numbers of DOAs in Specified Ranges by Algebraic Phase Unwrapping Algorithms , 2005 .

[21]  Yücel Altunbasak,et al.  Color plane interpolation using alternating projections , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[22]  Nirmal K. Bose,et al.  Mathematical analysis of super-resolution methodology , 2003, IEEE Signal Process. Mag..

[23]  Isao Yamada,et al.  An iterative MPEG super-resolution with an outer approximation of framewise quantization constraint , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[24]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[25]  I. Yamada.  A numerically robust hybrid steepest descent method for the convexly constrained generalized inverse problems , 2002 .

[26]  I. Yamada,et al.  Hybrid Steepest Descent Method for Variational Inequality Problem over the Fixed Point Set of Certain Quasi-nonexpansive Mappings , 2005 .

[27]  Isao Yamada,et al.  A fast blind multiple access interference reduction in DS/CDMA systems by adaptive projected subgradient method , 2004, 2004 12th European Signal Processing Conference.

[28]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[29]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[30]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[31]  I. Yamada.  The Hybrid Steepest Descent Method for the Variational Inequality Problem over the Intersection of Fixed Point Sets of Nonexpansive Mappings , 2001 .

[32]  Isao Yamada,et al.  An Efficient Heuristic Approach to the Infeasible Downlink Power Control Problem , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[33]  Michael Elad,et al.  Multiframe demosaicing and super-resolution from undersampled color images , 2004, IS&T/SPIE Electronic Imaging.

[34]  Isao Yamada,et al.  Algebraic multidimensional phase unwrapping and zero distribution of complex polynomials-characterization of multivariate stable polynomials , 1998, IEEE Trans. Signal Process..