Weather Classification: A new multi-class dataset, data augmentation approach and comprehensive evaluations of Convolutional Neural Networks

Weather conditions often disrupt the proper functioning of transportation systems. Present systems either deploy an array of sensors or use an in-vehicle camera to predict weather conditions. These solutions have resulted in incremental cost and limited scope. To ensure smooth operation of all transportation services in all-weather conditions, a reliable detection system is necessary to classify weather in wild. The challenges involved in solving this problem is that weather conditions are diverse in nature and there is an absence of discriminate features among various weather conditions. The existing works to solve this problem have been scene specific and have targeted classification of two categories of weather. In this paper, we have created a new open source dataset consisting of images depicting three classes of weather i.e rain, snow and fog called RFS Dataset. A novel algorithm has also been proposed which has used super pixel delimiting masks as a form of data augmentation, leading to reasonable results with respect to ten Convolutional Neural Network architectures.

[1]  Leszek Rutkowski,et al.  Flexible Neuro-Fuzzy Systems: Structures, Learning and Performance Evaluation—L. Rutkowski (Boston, MA: Kluwer Academic Publishers, 2004, ISBN: 1-402-08042-5) Reviewed by A. E. Gaweda , 2006, IEEE Transactions on Neural Networks.

[2]  J. Andrey,et al.  Weather as a Chronic Hazard for Road Transportation in Canadian Cities , 2003 .

[3]  Li Zhuo,et al.  Extreme Weather Recognition Using Convolutional Neural Networks , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[4]  Cewu Lu,et al.  RSCM: Region Selection and Concurrency Model for Multi-Class Weather Recognition , 2017, IEEE Transactions on Image Processing.

[5]  Slobodan Ilic,et al.  Classification of images in fog and fog-free scenes for use in vehicles , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[6]  Rachid Belaroussi,et al.  Convergence of a Traffic Signs-Based Fog Density Model , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[7]  F. Moosmann,et al.  Classification of weather situations on single color images , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Reid A. Bryson,et al.  AN INVESTIGATION OF THE POTENTIAL OF COMPONENT ANALYSIS FOR WEATHER CLASSIFICATION , 1966 .

[11]  Ales Leonardis,et al.  Detection of Human Rights Violations in Images: Can Convolutional Neural Networks Help? , 2017, VISIGRAPP.

[12]  Cewu Lu,et al.  Two-Class Weather Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  M·帕夫利克 Method For Fog Detection , 2012 .

[14]  Zheng Zhang,et al.  Multi-class weather classification on single images , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[15]  Jeffrey A. Nystuen,et al.  Weather Classification Using Passive Acoustic Drifters , 1997 .

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[18]  I. Ide,et al.  Rainy weather recognition from in-vehicle camera images for driver assistance , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[19]  Nicolas Gimonet,et al.  Detecting Unfocused Raindrops: In-Vehicle Multipurpose Cameras , 2014, IEEE Robotics & Automation Magazine.

[20]  Ahmed M. Elgammal,et al.  Weather classification with deep convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[21]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[22]  P Rama,et al.  Effects of weather-controlled variable speed limits on injury accidents , 2004 .

[23]  R. Schnur,et al.  A case study of statistical downscaling in Australia using weather classification by recursive partitioning , 1998 .