Bit-Depth Enhancement via Convolutional Neural Network

Nowadays, many monitors are able to display high dynamic range (HDR) images with high bit-depth for each quantized pixel, but most of the existing image and video contents are of low bit-depth. Therefore, bit-depth enhancement (BE) plays a key role in displaying a low bit-depth image in a high bit-depth monitor. Convolutional Neural Networks (CNNs) and Deep Learning (DL) have recently demonstrated impressive performance in generating realistic high-quality synthetic images, semi-supervised classification, and have been extended for video abstraction and so on. But CNNs or any other deep learning algorithm has not yet been applied to expand image bit-depth so far. In this paper, to fill the gap, we propose a novel algorithm to recover the high bit-depth images via deep convolutional neural network. By training the parameters of the neural networks, the model could learn to recover gradual transition areas and avoid the false contour artifacts, which are commonly seen with traditional bit-depth enhancement algorithms. The experimental results show that our proposed method achieves competitive performance compared with existing bit-depth enhancement methods in terms of PSNR and SSIM with greatly suppressed false contours.

[1]  Robert Ulichney,et al.  Pixel bit-depth increase by bit replication , 1998, Electronic Imaging.

[2]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  Oscar C. Au,et al.  Bit-depth expansion using Minimum Risk Based Classification , 2012, 2012 Visual Communications and Image Processing.

[6]  Oscar C. Au,et al.  Image Bit-Depth Enhancement via Maximum A Posteriori Estimation of AC Signal , 2016, IEEE Transactions on Image Processing.

[7]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Miaofeng Liu,et al.  Image inpainting and super-resolution using non-local recursive deep convolutional network with skip connections , 2017, International Conference on Digital Image Processing.

[10]  Lu Fang,et al.  From 2D Extrapolation to 1D Interpolation: Content Adaptive Image Bit-Depth Expansion , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[11]  Shang-Hong Lai,et al.  Depth image super-resolution via multi-frame registration and deep learning , 2016, 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[12]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  S. Tsogkas,et al.  Deep Learning for Semantic Part Segmentation with High-Level Guidance , 2015 .

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Oscar C. Au,et al.  Bit-depth expansion by adaptive filter , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[16]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[17]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[18]  Ji Wan,et al.  Deep Learning for Content-Based Image Retrieval: A Comprehensive Study , 2014, ACM Multimedia.

[19]  Oscar C. Au,et al.  Bit-depth expansion by contour region reconstruction , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[20]  Xiaogang Wang,et al.  Multi-source Deep Learning for Human Pose Estimation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.