Snow Scene Segmentation Using CNN-Based Approach With Transfer Learning

Images from CCTV cameras can be used for analyzing disaster situations in a particular area. Snowfall is one of the weather conditions that could cause natural disasters in Japan. It is possible for a machine to detect snow and mark these areas in that image. There are existing convolutional neural network-based (CNN-based) frameworks that can achieve high accuracy in an object classification task. However, these frameworks cannot define or mark the affected area then display the result. To address this problem, this paper proposes a method to develop a model using CNN frameworks, with the transfer learning technique. We use transfer learning to reduce training time and computing resources while maintaining high performance in a snow detection task. For transfer learning, the pre-trained weights from the VGG19 dataset is used. In this work, we use images from CCTV cameras, which were obtained from a publicly accessible website in Japan. After evaluating the model we performed post-processing on the data to further reduce the error in the results. Our proposed method can achieve an average sensitivity of 80.90% and specificity 98.54% for snow detection in real-world images.

[1]  Savas Özkan,et al.  Cloud Detection from RGB Color Remote Sensing Images with Deep Pyramid Networks , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[2]  Jérémie Bossu,et al.  Rain or Snow Detection in Image Sequences Through Use of a Histogram of Orientation of Streaks , 2011, International Journal of Computer Vision.

[3]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[4]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  Bernt Schiele,et al.  Sliding-Windows for Rapid Object Class Localization: A Parallel Technique , 2008, DAGM-Symposium.

[6]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[7]  Gavriel Salomon,et al.  T RANSFER OF LEARNING , 1992 .