DSIM: A DisSIMilarity-Based Image Clutter Metric for Targeting Performance

Previous image clutter metrics were proposed on the thought that clutter was just a perceptual effect, while we identify clutter as both perceptual and cognitive effects. Under this identification, we give a new definition of image clutter metric by analyzing the research results in the fields of visual psychology and psychophysics. According to the definition, we further put forward a DisSIMilarity (DSIM) based image clutter metric, which can also be taken as a kind of HVS-based signal-to-clutter ratio. The earlier image clutter metrics produced limited success in predicting targeting performance mainly since they did not consider brain cognitive characteristics. We develop a brain cognitive dissimilarity measure (BCDM) as a quantitative estimate of the selection weights which are allocated by brain attentional mechanism to affect visual selection processes. A human vision perceptual dissimilarity measure (VPDM), fully embodying vision perceptual properties, is first established between the target and clutter images, and then we utilize the BCDM between the two images as selection weights to pool the VPDM to be a clutter metric, which can be called DSIM metric. The metric is tested in Search_2 dataset provided by TNO Human Factors Research Institute of Netherlands. Error analysis and correlation tests demonstrate that the DSIM metric makes a more significant improvement than previously proposed metrics in predicting 62 observers' targeting performances including detection probability, false alarm probability and search time.

[1]  A. Toet.  Target Acquisition in Complex Scenes, Part A: Search and Conspicuity Models. , 1996 .

[2]  Yuanzhen Li,et al.  Feature congestion: a measure of display clutter , 2005, CHI.

[3]  H. K. HAltTLIn.  THE RESPONSE OF SINGLE OPTIC NERVE FIBERS OF THE VERTEBRATE EYE TO ILLUMINATION OF THE RETINA , 2004 .

[4]  Ronald G. Driggers,et al.  Current infrared target acquisition approach for military sensor design and wargaming , 2006, SPIE Defense + Commercial Sensing.

[5]  Mohan M. Trivedi,et al.  Developing texture-based image clutter measures for object detection , 1992 .

[6]  Stanley R. Rotman,et al.  Modeling human search and target acquisition performance: fixation-point analysis , 1994 .

[7]  Gil Tidhar,et al.  Influence of clutter on human target acquisition , 1993, Other Conferences.

[8]  Mohan M. Trivedi,et al.  Evaluation of image metrics for target discrimination using psychophysical experiments , 1996 .

[9]  Alexander Toet,et al.  Structural similarity determines search time and detection probability , 2010 .

[10]  Bir Bhanu,et al.  Automatic Target Recognition: State of the Art Survey , 1986, IEEE Transactions on Aerospace and Electronic Systems.

[11]  Jianqi Zhang,et al.  New metrics for clutter affecting human target acquisition , 2006 .

[12]  H. J. Muller,et al.  Visual search for singleton feature targets across dimensions: Stimulus- and expectancy-driven effects in dimensional weighting. , 2003, Journal of experimental psychology. Human perception and performance.

[13]  Peter Hästö,et al.  A new weighted metric , 2005 .

[14]  Mohan M. Trivedi,et al.  Quantitative characterization of image clutter: problem, progress, and promises , 1993, Defense, Security, and Sensing.

[15]  Marina Meila,et al.  Comparing Clusterings by the Variation of Information , 2003, COLT.

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  Yuanzhen Li,et al.  Measuring visual clutter. , 2007, Journal of vision.

[18]  Ulrich Ansorge,et al.  Top-down contingent attentional capture during feed-forward visual processing. , 2010, Acta psychologica.

[19]  Stanley R. Rotman,et al.  Evaluation of human detection performance of targets embedded in natural and enhanced infrared images using image metrics , 2000 .

[20]  Alexander Toet,et al.  Image dataset for testing search and detection models , 2001 .

[21]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[22]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[23]  Jianqi Zhang,et al.  Detection probability and detection time using clutter metrics , 2007 .

[24]  Zhou Wang,et al.  On the Mathematical Properties of the Structural Similarity Index , 2012, IEEE Transactions on Image Processing.

[25]  William R. Reynolds.  Toward quantifying infrared clutter , 1990, Defense, Security, and Sensing.

[26]  B. D. Guenther,et al.  Aided and automatic target recognition based upon sensory inputs from image forming systems , 1997 .

[27]  Zelin Shi,et al.  FD: A feature difference based image clutter metric for targeting performance , 2012 .

[28]  Robert Karsh,et al.  Target Acquisition in Cluttered Environments , 1992 .

[29]  Theo J. Doll,et al.  Target detection in urban clutter , 1989, IEEE Trans. Syst. Man Cybern..

[30]  J. Theeuwes.  Top-down and bottom-up control of visual selection. , 2010, Acta psychologica.

[31]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[32]  Stanley R. Rotman,et al.  Textural metrics for clutter affecting human target acquisition , 1996, Defense, Security, and Sensing.

[33]  Yehezkel Yeshurun,et al.  Context-free attentional operators: The generalized symmetry transform , 1995, International Journal of Computer Vision.

[34]  Eero P. Simoncelli,et al.  Random Cascades on Wavelet Trees and Their Use in Analyzing and Modeling Natural Images , 2001 .

[35]  Delian Liu,et al.  Modeling human false alarms using clutter metrics , 2007, International Symposium on Multispectral Image Processing and Pattern Recognition.

[36]  Gil Tidhar,et al.  New method of target acquisition in the presence of clutter , 1991, Defense, Security, and Sensing.

[37]  Joseph Krummenacher,et al.  Dimension-based attention modulates feed-forward visual processing. , 2010, Acta psychologica.

[38]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[39]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[40]  David L. Wilson.  Image-based contrast-to-clutter modeling of detection , 2001 .

[41]  David L. Wilson,et al.  Concepts for search and detection model improvements , 1997, Defense, Security, and Sensing.

[42]  Stanley R. Rotman,et al.  Textural metrics for clutter affecting human target acquisition , 1996 .

[43]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[44]  Alexander Toet,et al.  A high-resolution image data set for testing search and detection models , 1999 .

[45]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[46]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[47]  Honghua Chang,et al.  New metrics for clutter affecting human target acquisition , 2006, IEEE Transactions on Aerospace and Electronic Systems.

[48]  Peter Alexander Hst,et al.  A New Weighted Metric: the Relative Metric I , 2001 .

[49]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[50]  Grant R. Gerhart,et al.  Detection probability using relative clutter in infrared images , 1998 .

[51]  Gil Tidhar,et al.  Clutter metrics for target detection systems , 1991, 17th Convention of Electrical and Electronics Engineers in Israel.

[52]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[53]  Ronald G. Driggers,et al.  Search and detection modeling of military imaging systems , 2013 .

[54]  Barry D. Vaughan.  Soldier-in-the-Loop Target Acquisition Performance Prediction Through 2001: Integration of Perceptual and Cognitive Models , 2006 .

[55]  Peter A. Hasto.  A New Weighted Metric: the Relative Metric II , 2001 .

[56]  Marshall Weathersby,et al.  Detection Performance in Clutter with Variable Resolution , 1983, IEEE Transactions on Aerospace and Electronic Systems.