Identifying anomalous objects in SAS imagery using uncertainty

Object detection in modalities such as synthetic aperture sonar (SAS) is affected by the difficulty of acquiring a large number of training samples. If object classes not present in the training dataset are detected during testing, they can be mis-classified as one of the training classes. This increases overall false alarm rate and affects operator reliability and trust in the detection algorithm. Previous work showed that classification algorithms are often overconfident in their predictions and hence cannot reliably flag image regions about which the algorithm is uncertain or which need further sampling or processing. This paper describes object detectors based on SVMs and Gaussian Processes for SAS imagery, followed by probabilistic calibration of detector confidence scores. The entropy or uncertainty of these scores is then used to identify low-confidence regions and indicate the presence of previously unseen or anomalous objects.

[1]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[2]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[3]  Calum G. Blair,et al.  Introspective classification for pedestrian detection , 2014, 2014 Sensor Signal Processing for Defence (SSPD).

[4]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[5]  Rudolph Triebel,et al.  Knowing when we don't know: Introspective classification for mission-critical decision making , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Hassan Ghassemian,et al.  Measurement of uncertainty by the entropy: application to the classification of MSS data , 2006 .

[7]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[8]  Regina A. Pomranky,et al.  The role of trust in automation reliance , 2003, Int. J. Hum. Comput. Stud..

[9]  Douglas A. Wiegmann,et al.  Automation Failures on Tasks Easily Performed by Operators Undermines Trust in Automated Aids , 2003 .

[10]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[11]  David J. Hand,et al.  Construction and Assessment of Classification Rules , 1997 .

[12]  Herbert K. H. Lee,et al.  Gaussian Processes , 2011, International Encyclopedia of Statistical Science.

[13]  Rudolph Triebel,et al.  Driven Learning for Driving: How Introspection Improves Semantic Mapping , 2016, ISRR.

[14]  David P. Williams,et al.  DETECTION RATE STATISTICS IN SYNTHETIC APERTURE SONAR IMAGES , 2009 .

[15]  David P. Williams Fast Target Detection in Synthetic Aperture Sonar Imagery: A New Algorithm and Large-Scale Performance Analysis , 2015, IEEE Journal of Oceanic Engineering.

[16]  Yvan Petillot,et al.  Reducing false alarms in automated target recognition using local sea-floor characteristics , 2014, 2014 Sensor Signal Processing for Defence (SSPD).

[17]  Rich Caruana,et al.  Predicting good probabilities with supervised learning , 2005, ICML.

[18]  Shaogang Gong,et al.  Detecting and discriminating behavioural anomalies , 2011, Pattern Recognit..