Enhancing Diversity of Defocus Blur Detectors via Cross-Ensemble Network

Defocus blur detection (DBD) is a fundamental yet challenging topic, since the homogeneous region is obscure and the transition from the focused area to the unfocused region is gradual. Recent DBD methods make progress through exploring deeper or wider networks with the expense of high memory and computation. In this paper, we propose a novel learning strategy by breaking DBD problem into multiple smaller defocus blur detectors and thus estimate errors can cancel out each other. Our focus is the diversity enhancement via cross-ensemble network. Specifically, we design an end-to-end network composed of two logical parts: feature extractor network (FENet) and defocus blur detector cross-ensemble network (DBD-CENet). FENet is constructed to extract low-level features. Then the features are fed into DBD-CENet containing two parallel-branches for learning two groups of defocus blur detectors. For each individual, we design cross-negative and self-negative correlations and an error function to enhance ensemble diversity and balance individual accuracy. Finally, the multiple defocus blur detectors are combined with a uniformly weighted average to obtain the final DBD map. Experimental results indicate the superiority of our method in terms of accuracy and speed when compared with several state-of-the-art methods.

[1]  Ponnuthurai N. Suganthan,et al.  Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article] , 2016, IEEE Computational Intelligence Magazine.

[2]  Qilong Wang,et al.  Towards Faster Training of Global Covariance Pooling Networks by Iterative Matrix Square Root Normalization , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Guoyan Zheng,et al.  Crowd Counting with Deep Negative Correlation Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Li Xu,et al.  Discriminative Blur Detection Features , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Yu Liu,et al.  Focus and Blurriness Measure Using Reorganized DCT Coefficients for an Autofocus Application , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Hui Ji,et al.  Estimating Defocus Blur via Rank of Local Patches , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[8]  Xin Yi,et al.  LBP-Based Segmentation of Defocus Blur , 2016, IEEE Transactions on Image Processing.

[9]  Lina J. Karam,et al.  Spatially-Varying Blur Detection Based on Multiscale Fused and Sorted Transform Coefficients of Gradient Magnitudes , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  P. J. Narayanan,et al.  Composite Focus Measure for High Quality Depth Maps , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  Cláudio Rosito Jung,et al.  Image retargeting based on spatially varying defocus blur map , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[13]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Xu Liu,et al.  DualNet: Learn Complementary Features for Image Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[16]  Juan José Rodríguez Diez,et al.  Rotation Forest: A New Classifier Ensemble Method , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  In-So Kweon,et al.  A Unified Approach of Multi-scale Deep and Hand-Crafted Features for Defocus Estimation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Xiaogang Wang,et al.  Context Encoding for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[19]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[20]  Huchuan Lu,et al.  Defocus Blur Detection via Multi-stream Bottom-Top-Bottom Fully Convolutional Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  José M. F. Moura,et al.  Learning to Understand Image Blur , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[22]  Huchuan Lu,et al.  Learning Dual Convolutional Neural Networks for Low-Level Vision , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Yurong Liu,et al.  A niching evolutionary algorithm with adaptive negative correlation learning for neural network ensemble , 2017, Neurocomputing.

[24]  Mingli Song,et al.  AllFocus: Patch-Based Video Out-of-Focus Blur Reconstruction , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Xin Yao,et al.  Ensemble learning via negative correlation , 1999, Neural Networks.

[26]  Jizhou Sun,et al.  Multiscale blur detection by learning discriminative deep features , 2018, Neurocomputing.

[27]  Peter Tiño,et al.  Managing Diversity in Regression Ensembles , 2005, J. Mach. Learn. Res..

[28]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Claudio Rosito Jung,et al.  Edge-Based Defocus Blur Estimation With Adaptive Scale Selection , 2018, IEEE Transactions on Image Processing.

[31]  Pichao Wang,et al.  A Spectral and Spatial Approach of Coarse-to-Fine Blurred Image Region Detection , 2016, IEEE Signal Processing Letters.