Performance prediction of vehicle detection algorithms

Performance prediction of computer vision algorithms is of increasing interest whenever robustness to illumination variations, shadows and different weather conditions has to be ensured. The statistical model which is presented in this contribution predicts the algorithm performance under the presence of noise, image clutter and perturbations and therefore provides an algorithm-specific measure of the underlying image quality. For the prediction of the detection performance logistic regression using covariates defined by the properties of the vehicle signatures is used. This approach provides an estimate of the probability of a single vehicle signature being detected by a given detection algorithm. To describe the relationship between background clutter and the false alarm rate of the algorithm a severity measure of the image background is presented. After the construction of the algorithm model, the probability of a vehicle signature being detected and the false alarm rate are estimated on new data. The model is evaluated and compared to the true algorithm performance.

[1]  E. Ziegel Generalized Linear Models , 2002, Technometrics.

[2]  Dieter Willersinn,et al.  Evaluation framework for ATR algorithms , 1999, Defense, Security, and Sensing.

[3]  Dieter Willersinn,et al.  Assessment of machine-assisted target detection , 1999, Defense, Security, and Sensing.

[4]  B. D. Guenther,et al.  Aided and automatic target recognition based upon sensory inputs from image forming systems , 1997 .

[5]  Elliot E. Entin,et al.  Optimizing Aided Target-Recognition Performance , 1996 .

[6]  Michael Lindenbaum,et al.  An Integrated Model for Evaluating the Amount of Data Required for Reliable Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Mohan M. Trivedi,et al.  Developing texture-based image clutter measures for object detection , 1992 .

[8]  Richard W. Conners,et al.  Developing a quantitative model of human preattentive vision , 1989, IEEE Trans. Syst. Man Cybern..

[9]  Gregory Hobson,et al.  A normalized clutter measure for images , 1988, Comput. Vis. Graph. Image Process..

[10]  Allen R. Hanson,et al.  Extracting Straight Lines , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Marshall Weathersby,et al.  Detection Performance in Clutter with Variable Resolution , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[12]  R. Haralick,et al.  A facet model for image data , 1981 .

[13]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[14]  Zheng Chen zchen,et al.  Literature Survey : Graph-based Clustering and its Application in Coreference Resolution , 2009 .

[15]  W. F. orstner Pros and Cons Against Performance Characterization of Vision Algorithms , 1996 .

[16]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..