Feature extraction for classification of different weather conditions

Classification of different weather conditions provides a first step support for outdoor scene modeling, which is a core component in many different applications of outdoor video analysis and computer vision. Features derived from intrinsic properties of the visual effects of different weather conditions contribute to successful classification. In this paper, features representing both the autocorrelation of pixel-wise intensities over time and the max directional length of rain streaks or snowflakes are proposed. Based on the autocorrelation of each pixel’s intensities over time, two temporal features are used for coarse classification of weather conditions according to their visual effects. On the other hand, features are extracted for fine classification of video clips with rain and snow. The classification results on 249 video clips associated with different weather conditions indicate the effectiveness of the extracted features, by using C-SVM as the classifier.

[1]  Shree K. Nayar,et al.  When does a camera see rain? , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  K Garg,et al.  DETECTION AND REMOVAL OF RAIN FROM VIDEOS IN COMPUTER VISION AND PATTERN RECOGNITION , 2004 .

[3]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[5]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[6]  M. Kalaiselvi Geetha,et al.  Video Classification and Shot Detection for Video Retrieval Applications , 2009 .

[7]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[8]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[9]  Hao Li,et al.  Rain Removal in Video by Combining Temporal and Chromatic Properties , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[10]  Z. Q. John Lu,et al.  Nonlinear Time Series: Nonparametric and Parametric Methods , 2004, Technometrics.

[11]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Jin Keun Seo,et al.  Environmentally Robust Motion Detection for Video Surveillance , 2010, IEEE Transactions on Image Processing.

[13]  Shree K. Nayar,et al.  Detection and removal of rain from videos , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[14]  MANABU GOUKO,et al.  An Action Generation Model by Using Time Series Prediction and its Application to Robot Navigation , 2009, Int. J. Neural Syst..

[15]  Lifeng Sun,et al.  A Novel Event-Oriented Segment-of-Interest Discovery Method for Surveillance Video , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[16]  Jianqing Fan,et al.  Nonlinear Time Series : Nonparametric and Parametric Methods , 2005 .

[17]  Irene Y. H. Gu,et al.  Robust Visual Object Tracking Using Multi-Mode Anisotropic Mean Shift and Particle Filters , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Qi Tian,et al.  Statistical modeling of complex backgrounds for foreground object detection , 2004, IEEE Transactions on Image Processing.

[19]  Takeo Kanade,et al.  Spatio-Temporal Frequency Analysis for Removing Rain and Snow from Videos , 2007 .

[20]  Baochang Zhang,et al.  Kernel Similarity Modeling of Texture Pattern Flow for Motion Detection in Complex Background , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Shree K. Nayar,et al.  Vision and Rain , 2007, International Journal of Computer Vision.