Robust human detection within a highly dynamic aquatic environment in real time

This paper presents a real-time foreground detection method for monitoring swimming activities at an outdoor swimming pool. Robust performance and high accuracy of detecting objects-of-interest are two central issues of concern. Therefore, in this paper, a considerable amount of attention has been placed on the following aspects: 1) to establish a better method of modeling aquatic background, which exhibits dynamic characteristics with random spatial movements, and 2) to establish a method of enhancing the visibility of the foreground by removing specular reflection at nighttime. First, the development of a new background modeling method is reported. In the proposed approach, the background is modeled as a composition of homogeneous blob movements. With an implementation of a spatial searching process, the proposed method shows capability in associating and distinguishing movements caused by the background. Hence, this contributes to better performance in foreground detection. On the issue of enhancing the visibility of the foreground, a decision-based filtering scheme is proposed as a preprocessing step. A defined concept term, fluctuation measure, is defined for classifying each pixel to be one of the predefined types. This has allowed suitable spatial or spatiotemporal filters to be applied accordingly for color the compensation step. All of these developments are evaluated by testing live on a busy Olympic-size outdoor public swimming pool. Both qualitative and quantitative evaluations are reported. This provides a comprehensive study of the system.

[1]  Wei-Yun Yau,et al.  An automatic drowning detection surveillance system for challenging outdoor pool environments , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Ioannis Pavlidis,et al.  Urban surveillance systems: from the laboratory to the commercial world , 2001, Proc. IEEE.

[3]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Jitendra Malik,et al.  Towards robust automatic traffic scene analysis in real-time , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[5]  K. Takizawa,et al.  Video camera system using liquid-crystal polarizing filter to reduce reflected light , 1998 .

[6]  M. J. Cattle,et al.  The use of digital CCTV in an airport car-park application , 1995, Proceedings The Institute of Electrical and Electronics Engineers. 29th Annual 1995 International Carnahan Conference on Security Technology.

[7]  L. Davis,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002, Proc. IEEE.

[8]  Gian Luca Foresti A real-time system for video surveillance of unattended outdoor environments , 1998, IEEE Trans. Circuits Syst. Video Technol..

[9]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Takeo Kanade,et al.  Introduction to the Special Section on Video Surveillance , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Gian Luca Foresti,et al.  Monitoring motorway infrastructures for detection of dangerous events , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[12]  J Shamir,et al.  Polarization and statistical analysis of scenes containing a semireflector. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[15]  Jean-Marc Lavest,et al.  Multi-view reconstruction combining underwater and air sensors , 2002, Proceedings. International Conference on Image Processing.

[16]  D. Koller,et al.  Towards robust automatic traffic scene analysis in real-time , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[17]  Terrance E. Boult,et al.  Into the woods: visual surveillance of noncooperative and camouflaged targets in complex outdoor settings , 2001, Proc. IEEE.

[18]  S. Zaidman Vision on aviation surveillance systems , 2000, Record of the IEEE 2000 International Radar Conference [Cat. No. 00CH37037].

[19]  Hans-Hellmut Nagel,et al.  New likelihood test methods for change detection in image sequences , 1984, Comput. Vis. Graph. Image Process..

[20]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Hiroshi Murase,et al.  Surface Shape Reconstruction of a Nonrigid Transport Object Using Refraction and Motion , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[24]  Tieniu Tan,et al.  Recent developments in human motion analysis , 2003, Pattern Recognit..

[25]  U. Urfer,et al.  Integration of systems and services in central monitoring stations (CMS) , 1995, Proceedings The Institute of Electrical and Electronics Engineers. 29th Annual 1995 International Carnahan Conference on Security Technology.

[26]  Stuart J. Russell,et al.  Image Segmentation in Video Sequences: A Probabilistic Approach , 1997, UAI.

[27]  E.F. Lynn,et al.  The application of automatic surface lights to improve airport safety , 1993, IEEE Aerospace and Electronic Systems Magazine.

[28]  Shree K. Nayar,et al.  What does motion reveal about transparency? , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[29]  Wei-Yun Yau,et al.  A Video-Based Drowning Detection System , 2002, ECCV.

[30]  Yap-Peng Tan,et al.  A vision-based approach to early detection of drowning incidents in swimming pools , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Gian Luca Foresti,et al.  Special issue on video communications, processing, and understanding for third generation surveillance systems , 2001 .

[32]  Shyang Chang,et al.  Statistical change detection with moments under time-varying illumination , 1998, IEEE Trans. Image Process..

[33]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[34]  Katsushi Ikeuchi,et al.  Transparent surface modeling from a pair of polarization images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Wei-Yun Yau,et al.  Novel region-based modeling for human detection within highly dynamic aquatic environment , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..