Domain Adaptation and Adaptive Information Fusion for Object Detection on Foggy Days

Foggy days pose many difficulties for outdoor camera surveillance systems. On foggy days, the optical attenuation and scattering effects of the medium significantly distort and degenerate the scene radiation, making it noisy and indistinguishable. Aiming to solve this problem, in this paper we propose a novel object detection method that has the ability to exploit the information in the color and depth domains. To prevent the error propagation problem, we clean the depth information before the training process and remove false samples from the database. A domain adaptation strategy is employed to adaptively fuse the decisions obtained in the color and depth domains. In the experiments, we evaluate the contribution of the depth information for object detection on foggy days. Moreover, the advantages of the multiple-domain adaptation strategy are experimentally demonstrated via comparison with other methods.

[1]  Xiaojiang Du,et al.  Security threats to mobile multimedia applications: Camera-based attacks on mobile phones , 2014, IEEE Communications Magazine.

[2]  Shengping Zhang,et al.  Dynamic background modeling and subtraction using spatio-temporal local binary patterns , 2008, 2008 15th IEEE International Conference on Image Processing.

[3]  Dani Lischinski,et al.  Deep photo: model-based photograph enhancement and viewing , 2008, SIGGRAPH Asia '08.

[4]  Gaofeng Meng,et al.  Efficient Image Dehazing with Boundary Constraint and Contextual Regularization , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  Wu Zhou,et al.  Three-dimensional positioning method for moving particles based on defocused imaging using single-lens dual-camera system , 2016 .

[6]  Somaya Al-Máadeed,et al.  Automatic Detection and Classification of Audio Events for Road Surveillance Applications , 2018, Sensors.

[7]  Michael S. Brown,et al.  Haze Visibility Enhancement: A Survey and Quantitative Benchmarking , 2016, Comput. Vis. Image Underst..

[8]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[9]  Zhiyong Lu,et al.  Far-field outdoor experimental demonstration of down-looking synthetic aperture ladar , 2017 .

[10]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[11]  Deqing Sun,et al.  Blind Image Deblurring Using Dark Channel Prior , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Korris Fu-Lai Chung,et al.  Kernel Density Estimation, Kernel Methods, and Fast Learning in Large Data Sets , 2014, IEEE Transactions on Cybernetics.

[13]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[14]  Tao Ma,et al.  An Evaluation of Skylight Polarization Patterns for Navigation , 2015, Sensors.

[15]  Jian Liang,et al.  Polarimetric dehazing method for dense haze removal based on distribution analysis of angle of polarization. , 2015, Optics express.

[16]  Yoav Y Schechner,et al.  Polarization-based vision through haze. , 2008, Applied optics.

[17]  Xin Wang,et al.  Spatiotemporal difference-of-Gaussians filters for robust infrared small target tracking in various complex scenes , 2015 .

[18]  蔡小舒,et al.  Three-dimensional positioning method for moving particles based on defocused imaging using single-lens dual-camera system , 2016 .

[19]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[20]  Dingbo Chen,et al.  Ultra-compact broadband polarization beam splitter with strong expansibility , 2018 .

[21]  Feng Yu,et al.  Image and video dehazing using view-based cluster segmentation , 2016, 2016 Visual Communications and Image Processing (VCIP).

[22]  Ko Nishino,et al.  Bayesian Defogging , 2012, International Journal of Computer Vision.

[23]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[25]  Ling Shao,et al.  A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior , 2015, IEEE Transactions on Image Processing.

[26]  Boris Murmann,et al.  Toward Always-On Mobile Object Detection: Energy Versus Performance Tradeoffs for Embedded HOG Feature Extraction , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Ivor W. Tsang,et al.  Learning With Augmented Features for Supervised and Semi-Supervised Heterogeneous Domain Adaptation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Xin Li,et al.  Simultaneous Video Stabilization and Moving Object Detection in Turbulence , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Chanho Lee,et al.  Robust Lane Detection and Tracking for Real-Time Applications , 2018, IEEE Transactions on Intelligent Transportation Systems.

[30]  Guanghui Ren,et al.  Single Image Dehazing Algorithm Based on Sky Region Segmentation , 2013 .

[31]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Dacheng Tao,et al.  Real-Time Video Dehazing Based on Spatio-Temporal MRF , 2016, PCM.

[33]  Qi Tian,et al.  Haze removal method for natural restoration of images with sky , 2018, Neurocomputing.

[34]  Jindong Tan,et al.  Recognition of Car Makes and Models From a Single Traffic-Camera Image , 2015, IEEE Transactions on Intelligent Transportation Systems.

[35]  Ke Lu,et al.  Single image dehazing with a physical model and dark channel prior , 2015, Neurocomputing.

[36]  Jérôme Gilles,et al.  Detection of moving objects through turbulent media. Decomposition of Oscillatory vs Non-Oscillatory spatio-temporal vector fields , 2018, Image Vis. Comput..

[37]  Yoav Y. Schechner,et al.  Blind Haze Separation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[38]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.