ADAC system design and its application to mine hunting using SAS imagery

This PhD thesis considers the problem of automatic detection and classification. On the one hand, a set of application independent design issues for classification is tackled. On the other hand, the specific application of underwater mine hunting using synthetic aperture sonar imagery is considered. A novel resampling method is proposed in order to solve two fundamental issues involved in the design of classification systems, namely, the selection of the classifier and the estimation of the optimal feature set dimensionality. The method estimates both the probability distribution of the misclassification rate (or any other figure of merit of the classification system) subject to the size of the feature set and the probability distribution of the optimal dimensionality given a misclassification rate. The latter allows for the estimation of confidence intervals for the optimal feature set size. Unlike previous methods, no assumption for the features distribution is required. Based on the probability distribution of the figure of merit, a quality assessment for classifier performance is proposed. By contrast with previous works, the proposed algorithm allows to compare different classifiers without bonds to a specific feature set. In addition, the problem of determining the optimal feature subset is considered. In this respect, novel extensions of the Sequential Forward Selection and Sequential Forward Floating Selection methods are proposed. It alleviates the limitations of the methods, yielding a better performance. A system for automatic detection and classification of underwater objects using synthetic aperture sonar imagery is developed within this design framework. It consists of three steps: detection, feature extraction and classification. In order to detect the objects in the sonar images, three segmentation algorithms are compared: iterative conditional modes, min-cut/max-flow and active contours. Novel initialization schemes addressing the application at hand are proposed, since they significantly influences the final result. An extensive set of features is extracted for each object, both geometrical and statistical. They are designed to remain invariant to changes in the object position and also in poor segmentation scenarios. The selection of the optimal feature subset is accomplished by the extended feature selection algorithms, only after the resampling method has determined the best out of four classifier candidates (k-nearest neighbor, Mahalanobis’, linear discriminant analysis and support vector machines). The proposed methods have been applied to two databases of real sonar images containing over 57,000 m2 of underwater images and 600 mines of different types.

[1]  Robert A. Schowengerdt,et al.  A detailed comparison of backpropagation neural network and maximum-likelihood classifiers for urban land use classification , 1995, IEEE Trans. Geosci. Remote. Sens..

[2]  Pavel Pudil,et al.  Are Better Feature Selection Methods Actually Better? - Discussion, Reasoning and Examples , 2008, HEALTHINF.

[3]  Haluk Derin,et al.  Modeling and Segmentation of Noisy and Textured Images Using Gibbs Random Fields , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  D.M. Lane,et al.  Superellipse fitting for the classification of mine-like shapes in side-scan sonar images , 2002, OCEANS '02 MTS/IEEE.

[5]  D. Massonnet,et al.  Imaging with Synthetic Aperture Radar , 2008 .

[6]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[7]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[8]  Jan M. Van Campenhout,et al.  On the Possible Orderings in the Measurement Selection Problem , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Laveen N. Kanal,et al.  Patterns in pattern recognition: 1968-1974 , 1974, IEEE Trans. Inf. Theory.

[10]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[11]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[12]  David A. Landgrebe,et al.  Prediction Of Optimal Number Of Features , 1990, 10th Annual International Symposium on Geoscience and Remote Sensing.

[13]  Riccardo Ortale,et al.  Similarity-based clustering of Web transactions , 2003, SAC '03.

[14]  I. Quidu,et al.  Mine classification based on raw sonar data: an approach combining Fourier descriptors, statistical models and genetic algorithms , 2000, OCEANS 2000 MTS/IEEE Conference and Exhibition. Conference Proceedings (Cat. No.00CH37158).

[15]  Gerald J. Dobeck,et al.  Automated detection and classification of sea mines in sonar imagery , 1997, Defense, Security, and Sensing.

[16]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  George Nagy,et al.  State of the art in pattern recognition , 1968 .

[18]  Thomas Villmann,et al.  Similarity-Based Clustering, Recent Developments and Biomedical Applications [outcome of a Dagstuhl Seminar] , 2009, Similarity-Based Clustering.

[19]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[20]  G. T. Uber,et al.  Side Scan Sonar Object Classification Algorithms , 1989, Proceedings of the 6th International Symposium on Unmanned Untethered Submersible Technology,.

[21]  Yvan Petillot,et al.  Adaptive fusion framework based on augmented reality training , 2008 .

[22]  David P. Williams,et al.  Multi-view target classification in synthetic aperture sonar imagery , 2009 .

[23]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[25]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..

[26]  Olga Veksler,et al.  Markov random fields with efficient approximations , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[27]  Jocelyn Chanussot,et al.  Fusion of Local Statistical Parameters for Buried Underwater Mine Detection in Sonar Imaging , 2008, EURASIP J. Adv. Signal Process..

[28]  Ulisses Braga-Neto,et al.  Impact of error estimation on feature selection , 2005, Pattern Recognit..

[29]  Abdelhak M. Zoubir,et al.  Target Discrimination and Classification in Through-the-Wall Radar Imaging , 2011, IEEE Transactions on Signal Processing.

[30]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[31]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[32]  S.W. Perry,et al.  Pulse-length-tolerant features and detectors for sector-scan sonar imagery , 2004, IEEE Journal of Oceanic Engineering.

[33]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[34]  Gerald J. Dobeck,et al.  Side-scan sonar imagery fusion for sea mine detection and classification in very shallow water , 2001, SPIE Defense + Commercial Sensing.

[35]  Wojciech Pieczynski,et al.  Parameter Estimation in Hidden Fuzzy Markov Random Fields and Image Segmentation , 1997, CVGIP Graph. Model. Image Process..

[36]  李幼升,et al.  Ph , 1989 .

[37]  Charles Kervrann,et al.  A hierarchical statistical framework for the segmentation of deformable objects in image sequences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[39]  Sanjoy Dasgupta,et al.  Adaptive Control Processes , 2010, Encyclopedia of Machine Learning and Data Mining.

[40]  Anil K. Jain,et al.  Bootstrap Techniques for Error Estimation , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  David P. Williams,et al.  DETECTION RATE STATISTICS IN SYNTHETIC APERTURE SONAR IMAGES , 2009 .

[42]  Michael T. Manry,et al.  Comparisons of a neural network and a nearest-neighbor classifier via the numeric handprint recognition problem , 1995, IEEE Trans. Neural Networks.

[43]  F. Spitzer Markov Random Fields and Gibbs Ensembles , 1971 .

[44]  Anil K. Jain,et al.  A Multichannel Approach to Fingerprint Classification , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[46]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  D. Andrews,et al.  A Three-Step Method for Choosing the Number of Bootstrap Repetitions , 2000 .

[48]  N. Diaz-Diaz,et al.  Feature selection based on bootstrapping , 2005, 2005 ICSC Congress on Computational Intelligence Methods and Applications.

[49]  Jocelyn Chanussot,et al.  Higher-Order Statistics for the Detection of Small Objects in a Noisy Background Application on Sonar Imaging , 2007, EURASIP J. Adv. Signal Process..

[50]  S. Daniel,et al.  Adaptation of a partial shape recognition approach , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[51]  David Hopkin,et al.  Multiaspect Classification of Sidescan Sonar Images: Four Different Approaches to Fusing Single-Aspect Information , 2010, IEEE Journal of Oceanic Engineering.

[52]  David M. Lane,et al.  A comparison of inter-frame feature measures for robust object classification in sector scan sonar image sequences , 1999 .

[53]  J. V. Ness On the Effects of Dimension in Discriminant Analysis for Unequal Covariance Populations , 1979 .

[54]  Patrick Pérez,et al.  Sonar image segmentation using an unsupervised hierarchical MRF model , 2000, IEEE Trans. Image Process..

[55]  Samantha Dugelay,et al.  Deep seafloor characterization with multibeam echosounders by image segmentation using angular acoustic variations , 1996, Optics & Photonics.

[56]  U. Grenander,et al.  Structural Image Restoration through Deformable Templates , 1991 .

[57]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[58]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Chien-Pai Han,et al.  Conditional confidence intervals for classification error rate , 2009, Comput. Stat. Data Anal..

[60]  Christophe Collet,et al.  Hierarchical MRF modeling for sonar picture segmentation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[61]  A. Cohen,et al.  Maximum Likelihood Estimation in the Weibull Distribution Based On Complete and On Censored Samples , 1965 .

[62]  M. Abramowitz,et al.  Handbook of Mathematical Functions With Formulas, Graphs and Mathematical Tables (National Bureau of Standards Applied Mathematics Series No. 55) , 1965 .

[63]  Christophe Chesnaud,et al.  Statistical Region Snake-Based Segmentation Adapted to Different Physical Noise Models , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  Kar-Ann Toh,et al.  An empirical comparison of nine pattern classifiers , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[65]  Agostino Di Ciaccio,et al.  Computational Statistics and Data Analysis Measuring the Prediction Error. a Comparison of Cross-validation, Bootstrap and Covariance Penalty Methods , 2022 .

[66]  Hanumant Singh,et al.  Quantitative seafloor characterization using a bathymetric sidescan sonar , 1994 .

[67]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[68]  David P. Williams,et al.  On sand ripple detection in synthetic aperture sonar imagery , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[69]  José G. Dias,et al.  A bootstrap-based aggregate classifier for model-based clustering , 2008, Comput. Stat..

[70]  Abdefihak M. Zoubir,et al.  Bootstrap Methods and Applications , 2007, IEEE Signal Processing Magazine.

[71]  J. Shao,et al.  The jackknife and bootstrap , 1996 .

[72]  Toshio Odanaka,et al.  ADAPTIVE CONTROL PROCESSES , 1990 .

[73]  Thomas Marill,et al.  On the effectiveness of receptors in recognition systems , 1963, IEEE Trans. Inf. Theory.

[74]  Patrick L. Odell,et al.  Estimating the probability of misclassification and variate selection , 1975, Pattern Recognit..

[75]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[76]  Philippe Blondel,et al.  The Handbook of Sidescan Sonar , 2009 .

[77]  J.-M. Boucher,et al.  Region-based and incidence angle dependent segmentation of seabed sonar images using a level set approach combined to local texture statistics , 2006, OCEANS 2006 - Asia Pacific.

[78]  C. Wiley Synthetic Aperture Radars , 1985, IEEE Transactions on Aerospace and Electronic Systems.

[79]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[80]  Scott Reed,et al.  An automatic approach to the detection and extraction of mine features in sidescan sonar , 2003 .

[81]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[82]  Yvan Petillot,et al.  Supervised target detection and classification by training on augmented reality data , 2007 .

[83]  M.P. Hayes,et al.  Synthetic Aperture Sonar: A Review of Current Status , 2009, IEEE Journal of Oceanic Engineering.

[84]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.

[85]  Jen-Lun Yuan,et al.  Bootstrapping nonparametric feature selection algorithms for mining small data sets , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[86]  A. Hetet,et al.  Scalar image processing filters for speckle reduction on synthetic aperture sonar images , 2002, OCEANS '02 MTS/IEEE.

[87]  S. G. Johnson,et al.  The application of automated recognition techniques to side-scan sonar imagery , 1994 .

[88]  Arthur Zimek,et al.  A Study of Hierarchical and Flat Classification of Proteins , 2010, IEEE/ACM Transactions on Computational Biology & Bioinformatics.

[89]  A. Isaksson,et al.  Cross-validation and bootstrapping are unreliable in small sample classification , 2008, Pattern Recognit. Lett..

[90]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[91]  Vittorio Murino,et al.  A Probabilistic Approach to the Coupled Reconstruction and Restoration of Underwater Acoustic Images , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[92]  I. Quidu,et al.  Mine classification using a hybrid set of descriptors , 2000, OCEANS 2000 MTS/IEEE Conference and Exhibition. Conference Proceedings (Cat. No.00CH37158).

[93]  S. Guillaudeux,et al.  Optimization of a sonar image processing chain: a fuzzy rules based expert system approach , 1996, OCEANS 96 MTS/IEEE Conference Proceedings. The Coastal Ocean - Prospects for the 21st Century.

[94]  Anil K. Jain,et al.  On the optimal number of features in the classification of multivariate Gaussian data , 1978, Pattern Recognit..

[95]  Timothy Masters Signal and Image Processing with Neural Networks: A C++ Sourcebook , 1994 .

[96]  E. Coiras,et al.  3D target shape from SAS images based on a deformable mesh , 2009 .

[97]  Yvan Petillot,et al.  Automated approach to classification of mine-like objects in sidescan sonar using highlight and shadow information , 2004 .

[98]  Vittorio Murino,et al.  Edge/region-based segmentation and reconstruction of underwater acoustic images by Markov random fields , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[99]  Murray H. Loew,et al.  Comparison of non-parametric methods for assessing classifier performance in terms of ROC parameters , 2004, 33rd Applied Imagery Pattern Recognition Workshop (AIPR'04).

[100]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[101]  Alan C. Bovik,et al.  Indexes for Three-Class Classification Performance Assessment—An Empirical Comparison , 2009, IEEE Transactions on Information Technology in Biomedicine.

[102]  M. Amate,et al.  Mean–Standard Deviation Representation of Sonar Images for Echo Detection: Application to SAS Images , 2007, IEEE Journal of Oceanic Engineering.

[103]  Patrick Pérez,et al.  Three-Class Markovian Segmentation of High-Resolution Sonar Images , 1999, Comput. Vis. Image Underst..

[104]  Patrick Pérez,et al.  Hybrid Genetic Optimization and Statistical Model-Based Approach for the Classification of Shadow Shapes in Sonar Imagery , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[105]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[106]  M. Lianantonakis,et al.  Sidescan sonar segmentation using active contours and level set methods , 2005, Europe Oceans 2005.

[107]  Gerald J. Dobeck Algorithm fusion for automated sea mine detection and classification , 2001, MTS/IEEE Oceans 2001. An Ocean Odyssey. Conference Proceedings (IEEE Cat. No.01CH37295).

[108]  Marc Pinto,et al.  Shallow water synthetic aperture sonar: an enabling technology for NATO MCM forces , 2007 .

[109]  F. Langner,et al.  Side scan sonar image resolution and automatic object detection, classification and identification , 2009, OCEANS 2009-EUROPE.

[110]  A. R. Castellano,et al.  Autonomous interpretation of side scan sonar returns , 1990, Symposium on Autonomous Underwater Vehicle Technology.

[111]  Sarunas Raudys,et al.  On Dimensionality, Sample Size, Classification Error, and Complexity of Classification Algorithm in Pattern Recognition , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[112]  C. M. Ciany,et al.  Performance of fusion algorithms for Computer Aided Detection and classification of bottom mines in the shallow water environment , 2002, OCEANS '02 MTS/IEEE.

[113]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[114]  Anil K. Jain,et al.  39 Dimensionality and sample size considerations in pattern recognition practice , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[115]  Juha Reunanen,et al.  Overfitting in Making Comparisons Between Variable Selection Methods , 2003, J. Mach. Learn. Res..

[116]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[117]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[118]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.