Smart and real-time image dehazing on mobile devices

Haze is one of the common factors that degrades the visual quality of the images and videos. This diminishes contrast and reduces visual efficiency. The ALS (Atmospheric light scattering) model which has two unknowns to be estimated from the scene: atmospheric light and transmission map, is commonly used for dehazing. The process of modelling the atmospheric light scattering is complex and estimation of scattering is time consuming. This condition makes dehazing in real-time difficult. In this work, a new approach is employed for dehazing in real time which reads the orientation sensor of mobile device and compares the amount of rotation with a pre-specified threshold. The system decides whether to recalculate the atmospheric light or not. When the amount of rotation is little means there are only subtle changes to the scene, it uses the pre-estimated atmospheric light. Therefore, the system does not need to recalculate it at each time instant and this approach accelerates the overall dehazing process. 0.07 s fps (frame per second) per frame processing time (~ 15 fps) is handled for 360p imagery. Frame processing time results show that our approach is superior to the state-of-the-art real-time dehazing implementations on mobile operating systems.

[1]  Victor H. Diaz-Ramirez,et al.  Real-time haze removal in monocular images using locally adaptive processing , 2017, Journal of Real-Time Image Processing.

[2]  Javier Vazquez-Corral,et al.  Enhanced Variational Image Dehazing , 2015, SIAM J. Imaging Sci..

[3]  K K Tan,et al.  Physics-based approach to color image enhancement in poor visibility conditions. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Faliang Chang,et al.  A Fast Single-Image Dehazing Method Based on a Physical Model and Gray Projection , 2018, IEEE Access.

[5]  Dani Lischinski,et al.  Deep photo: model-based photograph enhancement and viewing , 2008, SIGGRAPH 2008.

[6]  Raanan Fattal.  Single image dehazing , 2008, SIGGRAPH 2008.

[7]  Chuan Dong,et al.  DSP-based image real-time dehazing optimization for improved dark-channel prior algorithm , 2019, Journal of Real-Time Image Processing.

[8]  Yuefeng Ji,et al.  Single image dehazing based on fast wavelet transform with weighted image fusion , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[9]  Damodar Reddy Edla,et al.  Parameter-free fuzzy histogram equalisation with illumination preserving characteristics dedicated for contrast enhancement of magnetic resonance images , 2020, Appl. Soft Comput..

[10]  Javier Vazquez-Corral,et al.  A fast image dehazing method that does not introduce color artifacts , 2018, Journal of Real-Time Image Processing.

[11]  Hanseok Ko,et al.  Single image dehazing with image entropy and information fidelity , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[12]  Dacheng Tao,et al.  DehazeNet: An End-to-End System for Single Image Haze Removal , 2016, IEEE Transactions on Image Processing.

[13]  Qingwei Gao,et al.  Retinex-Like Method for Image Enhancement in Poor Visibility Conditions , 2011 .

[14]  Victor H. Diaz-Ramirez,et al.  Real-time image dehazing using genetic programming , 2019, Optical Engineering + Applications.

[15]  Manchun Li,et al.  A self-adaptive homomorphic filter method for removing thin cloud , 2011, 2011 19th International Conference on Geoinformatics.

[16]  Shuai Fang,et al.  Image dehazing using polarization effects of objects and airlight. , 2014, Optics express.

[17]  Zhihan Lv,et al.  A real-time image dehazing method considering dark channel and statistics features , 2017, Journal of Real-Time Image Processing.

[18]  Ali Kashif Bashir,et al.  Real-time image dehazing by superpixels segmentation and guidance filter , 2020, Journal of Real-Time Image Processing.

[19]  Cheng Zhang,et al.  An effective fusion defogging approach for single sea fog image , 2016, Neurocomputing.

[20]  Truong Q. Nguyen,et al.  Example based depth from fog , 2013, 2013 IEEE International Conference on Image Processing.

[21]  Jun Zhang,et al.  A GPU-accelerated real-time single image de-hazing method using pixel-level optimal de-hazing criterion , 2012, Journal of Real-Time Image Processing.

[22]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[23]  Ketan Tang,et al.  Investigating Haze-Relevant Features in a Learning Framework for Image Dehazing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Codruta O. Ancuti,et al.  Single Image Dehazing by Multi-Scale Fusion , 2013, IEEE Transactions on Image Processing.

[25]  Damodar Reddy Edla,et al.  Analysis of controversies in the formulation and evaluation of restoration algorithms for MR Images , 2019, Expert Syst. Appl..

[26]  Chang-Su Kim,et al.  Single image dehazing based on contrast enhancement , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Huazhu Fu,et al.  A Cascaded Convolutional Neural Network for Single Image Dehazing , 2018, IEEE Access.

[28]  Di Wu,et al.  Image Dehazing Based on (CMTnet) Cascaded Multi-scale Convolutional Neural Networks and Efficient Light Estimation Algorithm , 2020, Applied Sciences.

[29]  Hui Fan,et al.  Image Dehazing Using Residual-Based Deep CNN , 2018, IEEE Access.

[30]  Justin Joseph,et al.  An objective method to identify optimum clip-limit and histogram specification of contrast limited adaptive histogram equalization for MR images , 2017 .

[31]  Yue Meng,et al.  Single Image Dehazing on Mobile Device Based on GPU Rendering Technology , 2015, J. Robotics Netw. Artif. Life.

[32]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Muna F. Al-Sammaraie.  Contrast enhancement of roads images with foggy scenes based on histogram equalization , 2015, 2015 10th International Conference on Computer Science & Education (ICCSE).

[34]  Justin Joseph,et al.  A fully customized enhancement scheme for controlling brightness error and contrast in magnetic resonance images , 2018, Biomed. Signal Process. Control..

[35]  Zixing Cai,et al.  Fusion Strategy for Single Image Dehazing , 2013 .

[36]  P. G. Kuppusamy,et al.  A customized nonlocal restoration schemes with adaptive strength of smoothening for magnetic resonance images , 2019, Biomed. Signal Process. Control..

[37]  Ziyou Xiong,et al.  Real-time content adaptive contrast enhancement for see-through fog and rain , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[38]  Xiaohui Yuan,et al.  Recent advances in image dehazing , 2017, IEEE/CAA Journal of Automatica Sinica.

[39]  Huixin Zhou,et al.  GPU fast restoration of non-uniform illumination images , 2020, Journal of Real-Time Image Processing.

[40]  Hassan Dawood,et al.  Single Image Dehazing using CNN , 2018, IIKI.