Swimming Pool Occupancy Analysis using Deep Learning on Low Quality Video

Automatically creating spatio-temporal occupancy analysis of public swimming pools is of great interest, both for administrators to optimize the use of these expensive facilities, and for users to schedule their activities outside peak hours. In this paper we apply current state-of-the-art deep learning methods within human detection on low quality swimming pool video. Furthermore, we propose a method for analyzing the spatio-temporal occupancy of a swimming pool. We show that it is possible to precisely detect swimmers in very challenging conditions by obtaining an AUC of 93.48 % from YOLOv2. An acceptable AUC of 79.29 % was obtained from Tiny-YOLO, which can be implemented on a low-cost embedded system capable of producing results in real-time on site. We expect that the performance of both networks can be improved with more training data.

[1]  K. L. Chan,et al.  Detection of swimmer using dense optical flow motion map and intensity information , 2012, Machine Vision and Applications.

[2]  Qi Tian,et al.  Local Motion Analysis and Its Application in Video based Swimming Style Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  Fei Lei,et al.  A Novel Camera-Based Drowning Detection Algorithm , 2015, IGTA.

[4]  Wen-Hui Chen,et al.  A framework for vision-based swimmer tracking , 2011, 2011 International Conference on Uncertainty Reasoning and Knowledge Engineering.

[5]  Sridha Sridharan,et al.  Swimmer Localization from a Moving Camera , 2013, 2013 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[6]  Mohan M. Trivedi,et al.  Vision for Looking at Traffic Lights: Issues, Survey, and Perspectives , 2016, IEEE Transactions on Intelligent Transportation Systems.

[7]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Jukka Heikkonen,et al.  Real-Time Swimmer Tracking on Sparse Camera Array , 2016, ICPRAM.

[9]  Wei-Yun Yau,et al.  DEWS: A Live Visual Surveillance System for Early Drowning Detection at Pool , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Wanqing Li,et al.  Human detection from images and videos: A survey , 2016, Pattern Recognit..

[11]  Yap-Peng Tan,et al.  A vision-based approach to early detection of drowning incidents in swimming pools , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Wei-Yun Yau,et al.  Robust human detection within a highly dynamic aquatic environment in real time , 2006, IEEE Transactions on Image Processing.

[14]  Dexmont Peña,et al.  Benchmarking of CNNs for Low-Cost , Low-Power Robotics Applications , 2010 .

[15]  Thomas B. Moeslund,et al.  Evaluating State-of-the-Art Object Detector on Challenging Traffic Light Data , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  Dan Zecha,et al.  Pose Estimation for Deriving Kinematic Parameters of Competitive Swimmers , 2017 .

[17]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[18]  Lei Fei,et al.  Drowning Detection Based on Background Subtraction , 2009, 2009 International Conference on Embedded Software and Systems.

[19]  Wei-Yun Yau,et al.  Novel region-based modeling for human detection within highly dynamic aquatic environment , 2004, CVPR 2004.

[20]  Wei-Yun Yau,et al.  Novel region-based modeling for human detection within highly dynamic aquatic environment , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[21]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[22]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Zhen He,et al.  Continuous Video to Simple Signals for Swimming Stroke Detection with Convolutional Neural Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[24]  Sridha Sridharan,et al.  Understanding and analyzing a large collection of archived swimming videos , 2014, IEEE Winter Conference on Applications of Computer Vision.