Enhancement of weather degraded video sequences using wavelet fusion

Under bad weather conditions, the contrast and colors of videos are degraded and it is imperative to include mechanisms that overcome weather effects from video sequences in order to make vision systems more reliable. Unfortunately it turns out that effects of weather cannot be overcome by simple image processing techniques. There are only few works and some existing methods in literature for enhancement of weather degraded video sequences. A novel approach is proposed in this paper that is used to enhance degraded video sequences. It enhances visibility of the frames and also maintains the color fidelity. First a background image is estimated for the video sequence. The enhancement method is then separately applied on this background image and on the estimated motion pixels. The enhancement method consists of three phases. The first phase estimates a global correction parameter and the second phase computes an approximate degradation measure. In the final phase a novel wavelet fusion method is used to obtain the enhanced frame. Performance analysis is carried out with the help of a contrast improvement index and sharpness measure. The method has been tested using real time video sequences and is found to give good results.

[1]  Giovanni Ramponi,et al.  Image enhancement via adaptive unsharp masking , 2000, IEEE Trans. Image Process..

[2]  Robert D. Nowak,et al.  Majorization–Minimization Algorithms for Wavelet-Based Image Restoration , 2007, IEEE Transactions on Image Processing.

[3]  Scott T. Acton,et al.  Chapter 10 – Basic Linear Filtering with Application to Image Enhancement , 2009 .

[4]  John P. Oakley,et al.  Improving image quality in poor visibility conditions using a physical model for contrast degradation , 1998, IEEE Trans. Image Process..

[5]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[6]  Paul Scheunders,et al.  A multivalued image wavelet representation based on multiscale fundamental forms , 2002, IEEE Trans. Image Process..

[7]  Robert D. Nowak,et al.  An EM algorithm for wavelet-based image restoration , 2003, IEEE Trans. Image Process..

[8]  Robert D. Nowak,et al.  Wavelet-based image estimation: an empirical Bayes approach using Jeffrey's noninformative prior , 2001, IEEE Trans. Image Process..

[9]  J. Alex Stark,et al.  Adaptive image contrast enhancement using generalizations of histogram equalization , 2000, IEEE Trans. Image Process..

[10]  Christopher C. Yang,et al.  High-Resolution Histogram Modification of Color Images , 1995, CVGIP Graph. Model. Image Process..

[11]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[13]  N. Pettersson,et al.  Visibility Enhancement for Roads with Foggy or Hazy Scenes , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[14]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[15]  M. Wilscy,et al.  A Novel Wavelet Fusion Method for Contrast Correction and Visibility Enhancement of Color Images , 2022 .

[16]  H. V. Hulst Light Scattering by Small Particles , 1957 .

[17]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[18]  Richard R. Brooks,et al.  Atmospheric attenuation reduction through multisensor fusion , 1998, Defense, Security, and Sensing.

[19]  Mário A. T. Figueiredo,et al.  Wavelet-Based Image Estimation : An Empirical Bayes Approach Using Jeffreys ’ Noninformative Prior , 2001 .

[20]  Eric Paul Krotkov,et al.  Active Computer Vision by Cooperative Focus and Stereo , 1989, Springer Series in Perception Engineering.

[21]  Zia-ur Rahman,et al.  Retinex processing for automatic image enhancement , 2002, IS&T/SPIE Electronic Imaging.

[22]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[23]  Fabio Caparrelli,et al.  Vision-based closed-loop control of mobile microrobots for microhandling tasks , 2001, Optics East.

[24]  Yiğithan Dedeoğlu,et al.  Moving object detection, tracking and classification for smart video surveillance , 2004 .

[25]  John P. Oakley,et al.  Correction of Simple Contrast Loss in Color Images , 2007, IEEE Transactions on Image Processing.