NTIRE 2021 NonHomogeneous Dehazing Challenge Report

This work reviews the results of the NTIRE 2021 Challenge on Non-Homogeneous Dehazing. The proposed techniques and their results have been evaluated on a novel dataset that extends the NH-Haze datset. It consists of additional 35 pairs of real haze free and nonhomogeneous hazy images recorded outdoor. The nonhomogeneous haze has been introduced in the outdoor scenes by using a a professional setup that imitates the real conditions of haze scenes. 327 participants registered in the challenge and 23 teams competed in the final testing phase. The proposed solutions gauge the state-of-the-art in image dehazing.

Ling Shao | Fahad Shahbaz Khan | Radu Timofte | Xiaochun Cao | Keyan Wang | Jun-Cheng Chen | Vishal Monga | Codruta O. Ancuti | Cosmin Ancuti | Florin-Alexandru Vasluianu | Syed Waqas Zamir | Jichang Guo | Vishal M. Chudasama | Chongyi Li | Wenqi Ren | Munawar Hayat | Chenghua Li | Akshay Dudhane | Zilong Huang | Tiantong Guo | Aditya Arora | Vishal Chudasama | Kalpesh Prajapati | Kishor Upla | Shuigeng Zhou | Zhipeng Luo | Lihua Han | Cong Leng | Xiaotong Luo | Kalpesh P. Prajapati | Zhenyu Xu | Joseph Zacharias | Heena Patel | Jun Chen | Qingchao Su | Salman Khan | Yiran Fu | Xuetong Niu | Quanxing Zha | Tao Wang | Jing Liu | Chang-Sung Sung | Huan Liu | Minyi Zhao | Xinjian Zhang | Yankun Yu | Jian Cheng | Tianyi Chen | Lehan Yang | Kele Xu | Chippy M. Manu | Eunsung Jo | Chen Gao | Jiahui Fu | Wentao Jiang | Si Liu | Yudong Wang | Anjali Sarvaiya | Yiqun Chen | Minghan Fu | Jerome Chang | Xiyao Wang | Yi Xu | Qixin Yan | Sida Zheng | Haichuan Zhang | Wenjin Yang | Jin Lin | Guowen Huang | Shuxin Chen | Yanyun Qu | Pengliang Sun | Junjun Zheng | Xiaotong Ruan | Yunfeng Wang | Jiang Yang | Sai Wang | Jun Luo | Zhuoran Zheng | Jae-Young Sim Geethu | M M Akhil K A Sreeni | K G Jeena | Chippy M Manu | Zexi Huang | Baofeng Zhang | Yiwen Zhang | Jindong Li | Mianjie Chen | Quan Xiao | Yanting Huang | Kiran Raja Raghavendra | Ramachandra Christoph Busch | Hongyuan Jing | Haoqiang Wu | Zhiwei Zhu | Hejun Lv | F. Khan | Xiaochun Cao | R. Timofte | Tiantong Guo | V. Monga | Zilong Huang | Wenqi Ren | Chongyi Li | Cong Leng | Munawar Hayat | Jian Cheng | Xiaotong Luo | Zhipeng Luo | Aditya Arora | Jichang Guo | Zhiwei Zhu | Jun-Cheng Chen | C. Ancuti | C. Ancuti | K. Upla | Lihua Han | Shuigeng Zhou | Keyan Wang | Akshay Dudhane | Yanting Huang | Quan-Ping Xiao | Haichuan Zhang | Pengliang Sun | Qingchao Su | Yunfeng Wang | K. Jeena | J. Zacharias | Tao Wang | Zhenyu Xu | Haoqian Wu | Jun Chen | Tianyi Chen | Salman Khan | Minyi Zhao | Jindong Li | Chenghua Li | Chen Gao | Zhu Zheng | Sida Zheng | Jiahui Fu | Huan Liu | Qixin Yan | Yiqun Chen | J. Geethu | Jing Liu | Xinjian Zhang | Florin-Alexandru Vasluianu | Yiwen Zhang | Zexi Huang | Heena Patel | Anjali Sarvaiya | Lehan Yang | Bao-ling Zhang | Eunsung Jo | Yankun Yu | Xiyao Wang | Sibo Liu | R. C. Busch | Ling Shao | Yudong Wang | Wentao Jiang | Xuetong Niu | Jun-Bin Luo | Yan Qu | Sai Wang | Yi Xu | Jerome Chang | Shuxin Chen | K. Raghavendra | Ming-Zhe Fu | Wenjin Yang | Jin Lin | Guowen Huang | Ke Xu | Junjun Zheng | Xiao-ling Ruan | Jiang Yang | Chang-Sung Sung | M. M. A. K. A. Sreeni | Mianjie Chen | Hongyuan Jing | Yiran Fu | Quanxing Zha | Hejun Lv

[1]  Radu Timofte,et al.  O-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Outdoor Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Anna Wang,et al.  AIPNet: Image-to-Image Single Image Dehazing With Atmospheric Illumination Prior , 2019, IEEE Transactions on Image Processing.

[3]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Gang Hua,et al.  Gated Context Aggregation Network for Image Dehazing and Deraining , 2018, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[5]  Radu Timofte,et al.  NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Images , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Rongrong Ji,et al.  Salience-Guided Cascaded Suppression Network for Person Re-Identification , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Robby T. Tan,et al.  Visibility in bad weather from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Jing Liu,et al.  Knowledge Transfer Dehazing Network for NonHomogeneous Dehazing , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Sourya Dipta Das,et al.  Fast Deep Multi-patch Hierarchical Network for Nonhomogeneous Image Dehazing , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[10]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[11]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[12]  Kai Zhao,et al.  Res2Net: A New Multi-Scale Backbone Architecture , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[14]  Vishal M. Patel,et al.  Multi-scale Single Image Dehazing Using Perceptual Pyramid Deep Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[16]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[17]  Andrew Gordon Wilson,et al.  Averaging Weights Leads to Wider Optima and Better Generalization , 2018, UAI.

[18]  Yun Fu,et al.  Image Super-Resolution Using Very Deep Residual Channel Attention Networks , 2018, ECCV.

[19]  Christophe De Vleeschouwer,et al.  D-HAZY: A dataset to evaluate quantitatively dehazing algorithms , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[20]  Radu Timofte,et al.  NTIRE 2021 Challenge on Video Super-Resolution , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[22]  Radu Timofte,et al.  Dense-Haze: A Benchmark for Image Dehazing with Dense-Haze and Haze-Free Images , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[23]  Hongdong Li,et al.  Deep Stacked Hierarchical Multi-Patch Network for Image Deblurring , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Mohinder Malhotra.  Single Image Haze Removal Using Dark Channel Prior , 2016 .

[25]  Chen Zhu,et al.  Adaptive Densely Connected Single Image Super-Resolution , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  Radu Timofte,et al.  I-HAZE: a dehazing benchmark with real hazy and haze-free indoor images , 2018, ACIVS.

[28]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[29]  Cosmin Ancuti,et al.  A Fast Semi-inverse Approach to Detect and Remove the Haze from a Single Image , 2010, ACCV.

[30]  Radu Timofte,et al.  NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Results , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[31]  Jean-Philippe Tarel,et al.  Vision Enhancement in Homogeneous and Heterogeneous Fog , 2012, IEEE Intelligent Transportation Systems Magazine.

[32]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[33]  Jun Chen,et al.  GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[34]  Ling Shao,et al.  Multi-Stage Progressive Image Restoration , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Radu Timofte,et al.  NTIRE 2018 Challenge on Image Dehazing: Methods and Results , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[36]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Liang Lin,et al.  Multi-level Wavelet-CNN for Image Restoration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[39]  Xiaodong Xie,et al.  FFA-Net: Feature Fusion Attention Network for Single Image Dehazing , 2019, AAAI.

[40]  Ko Nishino,et al.  Factorizing Scene Albedo and Depth from a Single Foggy Image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[41]  Zhi Zhang,et al.  Bag of Tricks for Image Classification with Convolutional Neural Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Jenq-Neng Hwang,et al.  NTIRE 2021 Multi-modal Aerial View Object Classification Challenge , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[43]  Radu Timofte,et al.  NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Results , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[44]  Radu Timofte,et al.  NTIRE 2021 Depth Guided Image Relighting Challenge , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[45]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[46]  Fahad Shahbaz Khan,et al.  NTIRE 2021 Challenge for Defocus Deblurring Using Dual-pixel Images: Methods and Results , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[47]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[48]  Zhuowen Tu,et al.  Deeply-Supervised Nets , 2014, AISTATS.

[49]  Xinbo Gao,et al.  Single Image Dehazing With Depth-Aware Non-Local Total Variation Regularization , 2018, IEEE Transactions on Image Processing.

[50]  Radu Timofte,et al.  NTIRE 2021 Challenge on Perceptual Image Quality Assessment , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[51]  Radu Timofte,et al.  NTIRE 2021 Challenge on Image Deblurring , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[52]  Radu Timofte,et al.  NTIRE 2021 Challenge on Quality Enhancement of Compressed Video: Methods and Results , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[53]  Vishal Monga,et al.  NonLocal Channel Attention for NonHomogeneous Image Dehazing , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[54]  Alexei A. Efros,et al.  The Unreasonable Effectiveness of Deep Features as a Perceptual Metric , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[55]  Lei Zhang,et al.  Learning Converged Propagations With Deep Prior Ensemble for Image Enhancement , 2018, IEEE Transactions on Image Processing.

[56]  Harshad Rai,et al.  Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks , 2018 .

[57]  Jing Liu,et al.  Trident Dehazing Network , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[58]  Ruigang Yang,et al.  Identity Preserving Face Completion for Large Ocular Region Occlusion , 2018, BMVC.

[59]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[60]  Kun Gao,et al.  NTIRE 2021 Learning the Super-Resolution Space Challenge , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[61]  Mateu Sbert,et al.  Color Channel Compensation (3C): A Fundamental Pre-Processing Step for Image Enhancement , 2019, IEEE Transactions on Image Processing.

[62]  Christophe De Vleeschouwer,et al.  Day and Night-Time Dehazing by Local Airlight Estimation , 2020, IEEE Transactions on Image Processing.

[63]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[64]  David Lopez-Paz,et al.  Optimizing the Latent Space of Generative Networks , 2017, ICML.