NTIRE 2019 Challenge on Real Image Denoising: Methods and Results

This paper reviews the NTIRE 2019 challenge on real image denoising with focus on the proposed methods and their results. The challenge has two tracks for quantitatively evaluating image denoising performance in (1) the Bayer-pattern raw-RGB and (2) the standard RGB (sRGB) color spaces. The tracks had 216 and 220 registered participants, respectively. A total of 15 teams, proposing 17 methods, competed in the final phase of the challenge. The proposed methods by the 15 teams represent the current state-of-the-art performance in image denoising targeting real noisy images.

Dong-Wook Kim | Lei Zhang | Fahad Shahbaz Khan | Michael S. Brown | Radu Timofte | Zhiwei Xiong | Deyu Meng | Ling Shao | Thomas S. Huang | Yang Wang | Gregory Shakhnarovich | Jue Wang | Sung-Jea Ko | Dongwon Park | Seung-Won Jung | Chuan Wang | Se Young Chun | Pengliang Tang | Tomoki Yoshida | Syed Waqas Zamir | Wenyi Tang | Norimichi Ukita | Haoqiang Fan | Chi-Hao Wu | Kai Zhang | Yue Lu | Shaofan Cai | Wangmeng Zuo | Zhiguo Cao | Bumjun Park | Magauiya Zhussip | Chang Chen | Aditya Arora | Raimondo Schettini | Shakarim Soltanayev | Songhyun Yu | Simone Bianco | Seo-Won Ji | Qin Xu | Yuqian Zhou | Chi Li | Simone Zini | Hongwei Yong | Jiaming Liu | Yifan Ding | Yiyun Zhao | Kazutoshi Akita | Jechang Jeong | Yuchen Fan | Salman Khan | Yuzhi Wang | Jae Ryun Chung | Abdelrahman Abdelhamed | Ding Liu | Muhammad Haris | Sang-Won Lee | Dong-Pan Lim | Seung-Wook Kim | M. S. Brown | Thomas S. Huang | Gregory Shakhnarovich | F. Khan | Haoqiang Fan | Deyu Meng | R. Timofte | Ding Liu | K. Zhang | W. Zuo | Lei Zhang | Hongwei Yong | Zhiwei Xiong | C. Chen | Chi-Hao Wu | Yuzhi Wang | Jechang Jeong | S. Bianco | R. Schettini | Jiaming Liu | Yifan Ding | Wenyi Tang | Aditya Arora | N. Ukita | Simone Zini | Tomoki Yoshida | S. Chun | Songhyun Yu | Shakarim Soltanayev | Salman Hameed Khan | A. Abdelhamed | Dongwon Park | Yuqian Zhou | Yuchen Fan | Sung-Jea Ko | Muhammad Haris | Jue Wang | Magauiya Zhussip | Kazutoshi Akita | Dong-Wook Kim | Pengliang Tang | ZHIGUO CAO | Yang Wang | Chi Li | Yiyun Zhao | T. Huang | Seung‐Won Jung | Ling Shao | Seung-Wook Kim | Bumjun Park | Jae‐Ryun Chung | Qin Xu | Chuan Wang | Shaofan Cai | Dongpan Lim | Seo-Won Ji | Sang-Won Lee | Yue Lu

[1]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[2]  Yun Fu,et al.  Residual Dense Network for Image Restoration , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Danail Stoyanov,et al.  OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis , 2018, Lecture Notes in Computer Science.

[4]  Lei Zhang,et al.  Waterloo Exploration Database: New Challenges for Image Quality Assessment Models , 2017, IEEE Transactions on Image Processing.

[5]  Yun Fu,et al.  Image Super-Resolution Using Very Deep Residual Channel Attention Networks , 2018, ECCV.

[6]  Eirikur Agustsson,et al.  NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Jia Xu,et al.  Fast Image Processing with Fully-Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[8]  Thomas S. Huang,et al.  Wide-activated Deep Residual Networks based Restoration for BPG-compressed Images , 2018, CVPR Workshops.

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[11]  Gregory Shakhnarovich,et al.  Deep Back-Projection Networks for Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Richard Szeliski,et al.  Automatic Estimation and Removal of Noise from a Single Image , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Wangmeng Zuo,et al.  Learning Deep CNN Denoiser Prior for Image Restoration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[15]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[16]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Raimondo Schettini,et al.  Deep Residual Autoencoder for Blind Universal JPEG Restoration , 2019, IEEE Access.

[18]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[20]  Kede Ma,et al.  Waterloo Exploration Database: New Challenges for Image Quality Assessment Models. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[21]  Ning Xu,et al.  Wide Activation for Efficient and Accurate Image Super-Resolution , 2018, ArXiv.

[22]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Michael S. Brown,et al.  A Software Platform for Manipulating the Camera Imaging Pipeline , 2016, ECCV.

[24]  Jechang Jeong,et al.  Densely Connected Hierarchical Network for Image Denoising , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[25]  Luc Van Gool,et al.  NTIRE 2018 Challenge on Single Image Super-Resolution: Methods and Results , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[26]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[27]  Serge J. Belongie,et al.  Residual Networks Behave Like Ensembles of Relatively Shallow Networks , 2016, NIPS.

[28]  Jonathan T. Barron,et al.  Unprocessing Images for Learned Raw Denoising , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[30]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]  Dong-Wook Kim,et al.  GRDN:Grouped Residual Dense Network for Real Image Denoising and GAN-Based Real-World Noise Modeling , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  Jechang Jeong,et al.  Deep Iterative Down-Up CNN for Image Denoising , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[33]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Stephen Lin,et al.  A High-Quality Denoising Dataset for Smartphone Cameras , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Qin Xu,et al.  Learning Raw Image Denoising With Bayer Pattern Unification and Bayer Preserving Augmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[36]  Luc Van Gool,et al.  Seven Ways to Improve Example-Based Single Image Super Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Noel E. O'Connor,et al.  A Deep Residual Architecture for Skin Lesion Segmentation , 2018, OR 2.0/CARE/CLIP/ISIC@MICCAI.

[38]  Jian Yang,et al.  MemNet: A Persistent Memory Network for Image Restoration , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[39]  Zhiwei Xiong,et al.  Deep Boosting for Image Denoising , 2018, ECCV.

[40]  Kyung-Ah Sohn,et al.  Fast, Accurate, and, Lightweight Super-Resolution with Cascading Residual Network , 2018, ECCV.

[41]  Matthias Zwicker,et al.  Dual-domain image denoising , 2013, 2013 IEEE International Conference on Image Processing.

[42]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[43]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[44]  Radu Timofte,et al.  A Brief Review of Image Denoising Algorithms and Beyond , 2019, Inpainting and Denoising Challenges.

[45]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[46]  Stefan Roth,et al.  Benchmarking Denoising Algorithms with Real Photographs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.