Extreme Weather Recognition Using Convolutional Neural Networks

Extreme weather always brings potential risk to driving, which leads to people's life and property being put into great dangers. Therefore, the automatic recognition of extreme weather plays an important role in the application of the highway traffic condition warning, automobile auxiliary driving, climate analysis and so on. Generally, multiple sensors are adopted in traditional methods of automatic extreme weather recognition with artificial participation and low accuracy. A new extreme weather recognition method based on images by using computer vision manners has been proposed in this paper. Since the weather is affected by many factors, features that can accurately represent various weather characteristics are difficult to be extracted. Therefore, in this paper, convolutional neural networks (CNNs) are applied to settle this problem. Features of extreme weather and recognition models are generated from big data. Moreover, a large-scale extreme weather dataset, "WeatherDataset", has been collected, in which 16635 extreme weather images are divided into four classes (sunny, rainstorm, blizzard, and fog), and complex scenes are coverd. A recognition model for extreme weather is obtained through two steps: Pre-training and Fine Tuning. In Pre-training step, ILSVRC-2012 Dataset is trained to obtain the model of ILSVRC using GoogLeNet. A more accurate model for extreme weather recognition is obatined by further fine-tuning GoogLeNet on WeatherDataset. The experimental results show that the proposed method is able to achieve a high performance with the recognition accuracy rate of 94.5% and can meet the requirements of some real applications.

[1]  Shree K. Nayar,et al.  All the Images of an Outdoor Scene , 2002, ECCV.

[2]  P. Szolgay,et al.  Variational computing based segmentation methods for medical imaging by using CNN , 2010, 2010 12th International Workshop on Cellular Nanoscale Networks and their Applications (CNNA 2010).

[3]  Philip J. Sallis,et al.  Weather Detection in Vehicles by Means of Camera and LIDAR Systems , 2014, 2014 Sixth International Conference on Computational Intelligence, Communication Systems and Networks.

[4]  Qian Li,et al.  A method of weather recognition based on outdoor images , 2015, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[5]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[6]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[7]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[8]  Wen-Hsiao Peng,et al.  Discriminatively-learned global image representation using CNN as a local feature extractor for image retrieval , 2015, 2015 Visual Communications and Image Processing (VCIP).

[9]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Andrea Lagorio,et al.  Automatic Detection of Adverse Weather Conditions in Traffic Scenes , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[14]  Martin Vetterli,et al.  Howis the weather: Automatic inference from images , 2012, 2012 19th IEEE International Conference on Image Processing.