Transim: Transfer Image Local Statistics Across EOTFS for HDR Image Applications

Despite the popularity of high dynamic range (HDR) technology in recent years, various algorithms for image and video applications are still designed and optimized for traditional standard dynamic range (SDR) data. Directly applying SDR-optimized algorithms to HDR images and video will result in significant artifacts or coding deficiency. In this work, we present a novel preprocessing method, dubbed TransIm, which transfers local statistics for the images from the desired domain (e.g. SDR) to the current domain (e.g., HDR), while maintaining its current visual presence. It is achieved by controlling the less perceivable “noise” that is orthogonal to the sparsifiable image content, using a unitary sparsifying transform. Numerical results show that the proposed TransIm can effectively transfer local patch variance from Gamma domain to Perceptual Quantizer (PQ) domain for HDR videos. We also demonstrate that the TransIm outputs are more robust to distortions and artifacts in seam carving applications.

[1]  Patrick Le Callet,et al.  High Dynamic Range Video - From Acquisition, to Display and Applications , 2016 .

[2]  Yoram Bresler,et al.  $\ell_{0}$ Sparsifying Transform Learning With Efficient Optimal Updates and Convergence Guarantees , 2015, IEEE Transactions on Signal Processing.

[3]  Yoram Bresler,et al.  Structured Overcomplete Sparsifying Transform Learning with Convergence Guarantees and Applications , 2015, International Journal of Computer Vision.

[4]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[5]  Natasha Gelfand,et al.  A survey of image retargeting techniques , 2010, Optical Engineering + Applications.

[6]  Lei Zheng,et al.  Image Noise Level Estimation by Principal Component Analysis , 2013, IEEE Transactions on Image Processing.

[7]  Scott Miller,et al.  Perceptual Signal Coding for More Efficient Usage of Bit Codes , 2012 .

[8]  Yoram Bresler,et al.  Online sparsifying transform learning for signal processing , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[9]  Yoram Bresler,et al.  Online Sparsifying Transform Learning— Part I: Algorithms , 2015, IEEE Journal of Selected Topics in Signal Processing.

[10]  Yoram Bresler,et al.  Video denoising by online 3D sparsifying transform learning , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[11]  Shiqian Wu,et al.  Noise reduced high dynamic range tone mapping using information content weights , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Junichi Nakamura,et al.  Image Sensors and Signal Processing for Digital Still Cameras , 2005 .

[13]  Yanjun Li,et al.  When sparsity meets low-rankness: Transform learning with non-local low-rank constraint for image restoration , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Andreas Schilling,et al.  Creating cinematic wide gamut HDR-video for the evaluation of tone mapping operators and HDR-displays , 2014 .

[15]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[16]  Standard for Characterization of Image Sensors and Cameras Release 3 . 1 , 2010 .

[17]  Yan Lin,et al.  A DWT-DFT composite watermarking scheme robust to both affine transform and JPEG compression , 2003, IEEE Trans. Circuits Syst. Video Technol..

[18]  Yoram Bresler,et al.  Learning overcomplete sparsifying transforms with block cosparsity , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[19]  Xinhao Liu,et al.  Noise level estimation using weak textured patches of a single noisy image , 2012, 2012 19th IEEE International Conference on Image Processing.

[20]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[21]  C. Andrew Segall,et al.  High quality HDR video compression using HEVC main 10 profile , 2016, 2016 Picture Coding Symposium (PCS).

[22]  Yoram Bresler,et al.  Learning flipping and rotation invariant sparsifying transforms , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[23]  Guan-Ming Su,et al.  Impact Analysis of Baseband Quantizer on Coding Efficiency for HDR Video , 2016, IEEE Signal Processing Letters.