Are Object Detection Assessment Criteria Ready for Maritime Computer Vision?

Maritime vessels equipped with visible and infrared cameras can complement other conventional sensors for object detection. However, application of computer vision techniques in maritime domain received attention only recently. The maritime environment offers its own unique requirements and challenges. Assessment of the quality of detections is a fundamental need in computer vision. However, the conventional assessment metrics suitable for usual object detection are deficient in the maritime setting. Thus, a large body of related work in computer vision appears inapplicable to the maritime setting at the first sight. We discuss the problem of defining assessment metrics suitable for maritime computer vision. We consider new bottom edge proximity metrics as assessment metrics for maritime computer vision. These metrics indicate that existing computer vision approaches are indeed promising for maritime computer vision and can play a foundational role in the emerging field of maritime computer vision.

[1]  A. Lai,et al.  A fast and accurate scoreboard algorithm for estimating stationary backgrounds in an image sequence , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[2]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[3]  Lucia Maddalena,et al.  A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection , 2010, Neural Computing and Applications.

[4]  M. Levandowsky,et al.  Distance between Sets , 1971, Nature.

[5]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[6]  Deepu Rajan,et al.  Object Detection in a Maritime Environment: Performance Evaluation of Background Subtraction Methods , 2019, IEEE Transactions on Intelligent Transportation Systems.

[7]  A. Tversky.  Features of Similarity , 1977 .

[8]  D. Altman,et al.  Statistics Notes: Diagnostic tests 1: sensitivity and specificity , 1994 .

[9]  Dacheng Tao,et al.  Greedy Bilateral Sketch, Completion & Smoothing , 2013, AISTATS.

[10]  Lily Rachmawati,et al.  Exploiting AIS Data for Intelligent Maritime Navigation: A Comprehensive Survey From Data to Methodology , 2016, IEEE Transactions on Intelligent Transportation Systems.

[11]  Jieping Ye,et al.  Orthogonal Rank-One Matrix Pursuit for Low Rank Matrix Completion , 2014, SIAM J. Sci. Comput..

[12]  M. Sigari,et al.  Fuzzy Running Average and Fuzzy Background Subtraction: Concepts and Application , 2008 .

[13]  Michael Hintermüller,et al.  Robust Principal Component Pursuit via Inexact Alternating Minimization on Matrix Manifolds , 2015, Journal of Mathematical Imaging and Vision.

[14]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..

[15]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[16]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[17]  Guillaume-Alexandre Bilodeau,et al.  Improving background subtraction using Local Binary Similarity Patterns , 2014, IEEE Winter Conference on Applications of Computer Vision.

[18]  Thierry Bouwmans,et al.  A Fuzzy Background Modeling Approach for Motion Detection in Dynamic Backgrounds , 2012, MMSP 2012.

[19]  Hélène Laurent,et al.  Review and evaluation of commonly-implemented background subtraction algorithms , 2008, 2008 19th International Conference on Pattern Recognition.

[20]  Thierry Bouwmans,et al.  Background Modeling and Foreground Detection for Video Surveillance , 2014 .

[21]  Brendt Wohlberg,et al.  Fast principal component pursuit via alternating minimization , 2013, 2013 IEEE International Conference on Image Processing.

[22]  Jian Sun,et al.  Object Detection Networks on Convolutional Feature Maps , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Søren Hauberg,et al.  Grassmann Averages for Scalable Robust PCA , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Simone Calderara,et al.  Reliable background suppression for complex scenes , 2006, VSSN '06.

[25]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[26]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Moongu Jeon,et al.  A New Framework for Background Subtraction Using Multiple Cues , 2012, ACCV.

[28]  Bart Vandereycken,et al.  Low-Rank Matrix Completion by Riemannian Optimization , 2013, SIAM J. Optim..

[29]  Cordelia Schmid,et al.  Long-Term Temporal Convolutions for Action Recognition , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Shuicheng Yan,et al.  Active Subspace: Toward Scalable Low-Rank Learning , 2012, Neural Computation.

[31]  Thierry Chateau,et al.  Vehicle trajectories evaluation by static video sensors , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[32]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[34]  Zhao Kang,et al.  Robust PCA Via Nonconvex Rank Approximation , 2015, 2015 IEEE International Conference on Data Mining.

[35]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[36]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[37]  El-hadi Zahzah,et al.  LRSLibrary: Low-Rank and Sparse tools for Background Modeling and Subtraction in Videos , 2016 .

[38]  Antoine Manzanera,et al.  A new motion detection algorithm based on Sigma-Delta background estimation , 2007, Pattern Recognit. Lett..

[39]  Robert D. Nowak,et al.  Online identification and tracking of subspaces from highly incomplete information , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[40]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Lei Zhang,et al.  Robust Principal Component Analysis with Complex Noise , 2014, ICML.

[42]  Luca Iocchi,et al.  Argos - a Video Surveillance System for boat Traffic Monitoring in Venice , 2009, Int. J. Pattern Recognit. Artif. Intell..

[43]  George Trigeorgis,et al.  A Deep Matrix Factorization Method for Learning Attribute Representations , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[45]  F. Robert-Inacio,et al.  Multispectral Target Detection and Tracking for Seaport Video Surveillance , 2007 .

[46]  Narendra Ahuja,et al.  Robust Orthonormal Subspace Learning: Efficient Recovery of Corrupted Low-Rank Matrices , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Luca Iocchi,et al.  Independent multimodal background subtraction , 2012, CompIMAGE.

[48]  Jacob Eisenstein,et al.  Discriminative Improvements to Distributional Sentence Similarity , 2013, EMNLP.

[49]  Klamer Schutte,et al.  Automatic classification of ships from infrared (FLIR) images , 1999, Defense, Security, and Sensing.

[50]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[51]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.

[53]  Deepu Rajan,et al.  Video Processing From Electro-Optical Sensors for Object Detection and Tracking in a Maritime Environment: A Survey , 2016, IEEE Transactions on Intelligent Transportation Systems.

[54]  Guillaume-Alexandre Bilodeau,et al.  Flexible Background Subtraction with Self-Balanced Local Sensitivity , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[55]  Alfredo Cuzzocrea,et al.  Advanced pattern recognition from complex environments: a classification-based approach , 2017, Soft Computing.