Man overboard event detection from RGB and thermal imagery: possibilities and limitations

A man overboard is an emergency incident, in which fast detection is the most crucial factor, for the quickest and most efficient recovery of the victim. As such, efficient monitoring methodologies should be employed. A variety of sensors is available today, supporting a continuous monitoring process, regardless of environmental conditions; RGB and thermal are two commonly used sensors. At the same time, several algorithms and techniques have been tested and proved to be efficient in human detection and situation recognition tasks. However, to this day a coherent methodology for fall detection over multiple sensors on a large-scale deployment, complying with related ISO standards on extremely low false positive alerts, has not been implemented. In this paper, we investigate the possibilities as well as the limitations of man overboard vision-based systems' development based on RGB and thermal imagery.

[1]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  James W. Davis,et al.  A Two-Stage Template Approach to Person Detection in Thermal Imagery , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[3]  Jia Nan,et al.  Human face detection algorithm via Haar cascade classifier combined with three additional classifiers , 2017, 2017 13th IEEE International Conference on Electronic Measurement & Instruments (ICEMI).

[4]  S.J. Krotosky,et al.  Face detection and head tracking using stereo and thermal infrared cameras for "smart" airbags: a comparative analysis , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[5]  Hans-Peter Kriegel,et al.  DBSCAN Revisited, Revisited , 2017, ACM Trans. Database Syst..

[6]  Miao Yu,et al.  A Posture Recognition-Based Fall Detection System for Monitoring an Elderly Person in a Smart Home Environment , 2012, IEEE Transactions on Information Technology in Biomedicine.

[7]  Tania Stathaki,et al.  Human Detection from Ground Truth Cameras through Combined Use of Histogram of Oriented Gradients and Body Part Models , 2016, VISIGRAPP.

[8]  Jiri Mekyska,et al.  Face segmentation: A comparison between visible and thermal images , 2010, 44th Annual 2010 IEEE International Carnahan Conference on Security Technology.

[9]  Nikolaos Doulamis,et al.  Stacked Autoencoders for Outlier Detection in Over-the-Horizon Radar Signals , 2017, Comput. Intell. Neurosci..

[10]  Malin Larsson,et al.  Man Overboard detecting systems based on wireless technology , 2018 .

[11]  Theodora A. Varvarigou,et al.  Enhanced human behavior recognition using HMM and evaluative rectification , 2010, ARTEMIS '10.

[12]  Zheng Liu,et al.  Pedestrian detection in thermal images using adaptive fuzzy C-means clustering and convolutional neural networks , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[13]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Thi Thi Zin,et al.  Robust Person Detection using Far Infrared Camera for Image Fusion , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[16]  Hüseyin Ekiz,et al.  Design and implementation of a man-overboard emergency discovery system based on wireless sensor networks , 2016 .

[17]  Theodora A. Varvarigou,et al.  Efficient tracking using a robust motion estimation technique , 2012, Multimedia Tools and Applications.

[18]  Ramakant Nevatia,et al.  Pedestrian Detection in Infrared Images based on Local Shape Features , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Nikolaos Doulamis,et al.  Spatio-temporal summarization of dance choreographies , 2018, Comput. Graph..

[20]  Nikolaos F. Matsatsinis,et al.  3D measures exploitation for a monocular semi-supervised fall detection system , 2016, Multimedia Tools and Applications.

[21]  S. Hennin,et al.  Integrated Perimeter Security System , 2007, 2007 IEEE Conference on Technologies for Homeland Security.

[22]  Nikolaos Doulamis,et al.  Extraction of key postures from 3D human motion data for choreography summarization , 2017, 2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games).

[23]  Theodora A. Varvarigou,et al.  A top-down event-driven approach for concurrent activity recognition , 2012, Multimedia Tools and Applications.

[24]  Thomas B. Moeslund,et al.  Thermal cameras and applications: a survey , 2013, Machine Vision and Applications.

[25]  Martin Glavin,et al.  Detection of pedestrians in far-infrared automotive night vision using region-growing and clothing distortion compensation , 2010 .

[26]  Xia Liu,et al.  Pedestrian detection and tracking with night vision , 2005, IEEE Transactions on Intelligent Transportation Systems.

[27]  Larry S. Davis,et al.  Probabilistic template based pedestrian detection in infrared videos , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[28]  Tania Stathaki,et al.  Enhanced pedestrian detection using deep learning based semantic image segmentation , 2017, 2017 22nd International Conference on Digital Signal Processing (DSP).

[29]  Nikolaos Papadakis,et al.  Multimedia Analysis on User-Generated Content for Safety-Oriented Applications , 2019, Security Informatics and Law Enforcement.

[30]  Jeong-Sik Park,et al.  Performance Improvement of Human Detection Using Thermal Imaging Cameras Based on Mahalanobis Distance and Edge Orientation Histogram , 2013, ITCS.

[31]  Avi Ostfeld,et al.  Protecting Water Infrastructure From Cyber and Physical Threats: Using Multimodal Data Fusion and Adaptive Deep Learning to Monitor Critical Systems , 2019, IEEE Signal Processing Magazine.

[32]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[33]  James W. Davis,et al.  Robust detection of people in thermal imagery , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..