Predicting Detection Performance on Security X-Ray Images as a Function of Image Quality

Developing methods to predict how image quality affects the task performance is a topic of great interest in many applications. While such studies have been performed in the medical imaging community, little work has been reported in the security X-ray imaging literature. In this paper, we develop models that predict the effect of image quality on the detection of the improvised explosive device components by bomb technicians in images taken using portable X-ray systems. Using a newly developed NIST-LIVE X-Ray Task Performance Database, we created a set of objective algorithms that predict bomb technician detection performance based on the measures of image quality. Our basic measures are traditional image quality indicators (IQIs) and perceptually relevant natural scene statistics (NSS)-based measures that have been extensively used in visible light image quality prediction algorithms. We show that these measures are able to quantify the perceptual severity of degradations and can predict the performance of expert bomb technicians in identifying threats. Combining NSS- and IQI-based measures yields even better task performance prediction than either of these methods independently. We also developed a new suite of statistical task prediction models that we refer to as quality inspectors of X-ray images (QUIX); we believe this is the first NSS-based model for security X-ray images. We also show that QUIX can be used to reliably predict conventional IQI metric values on the distorted X-ray images.

[1]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[2]  Tadashi Matsushita,et al.  Design and performance of imaging-plate system for X-ray diffraction study , 1987 .

[3]  Alan C. Bovik,et al.  On the Natural Statistics of Chromatic Images , 2018, 2018 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI).

[4]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[5]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[6]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[7]  Yannick Berthoumieu,et al.  Multiscale skewed heavy tailed model for texture analysis , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[8]  H H Barrett,et al.  Objective assessment of image quality: effects of quantum noise and object variability. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[9]  Stefan Roth,et al.  Object Detection in Multi-view X-Ray Images , 2012, DAGM/OAGM Symposium.

[10]  Alan C. Bovik,et al.  RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment , 2012, IEEE Transactions on Image Processing.

[11]  Ross S. Eaton,et al.  Perceived X-ray image quality for baggage screening , 2015, 2015 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[12]  Wang Yi,et al.  Portable pulsed electronic digital X-ray imager , 1999 .

[13]  Prodromos Chatzispyroglou EVALUATING AND MODELLING THE PERFORMANCE OF A PORTABLE X-RAY IMAGING SYSTEM , 2016 .

[14]  David Mumford,et al.  Occlusion Models for Natural Images: A Statistical Study of a Scale-Invariant Dead Leaves Model , 2004, International Journal of Computer Vision.

[15]  K Doi,et al.  A comparison of physical image quality indices and observer performance in the radiographic detection of nylon beads. , 1984, Physics in medicine and biology.

[16]  Samuel W. Hasinoff,et al.  Photon, Poisson Noise , 2014, Computer Vision, A Reference Guide.

[17]  Shaun Helman,et al.  The impact of image based factors and training on threat detection performance in X-ray screening. , 2008 .

[18]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[19]  Kyle J. Myers,et al.  Incorporating Human Contrast Sensitivity in Model Observers for Detection Tasks , 2009, IEEE Transactions on Medical Imaging.

[20]  Wenhan Zhu,et al.  Terahertz Security Image Quality Assessment by No-reference Model Observers , 2017, IFTC.

[21]  P. Gill,et al.  Quasi-Newton Methods for Unconstrained Optimization , 1972 .

[22]  Praful Gupta,et al.  Generalized Gaussian scale mixtures: A model for wavelet coefficients of natural images , 2018, Signal Process. Image Commun..

[23]  Arthur F Kramer,et al.  Visual Skills in Airport-Security Screening , 2004, Psychological science.

[24]  Praful Gupta,et al.  Studying the Statistics of Natural X-ray Pictures , 2018 .

[25]  M. S. Keshner 1/f noise , 1982, Proceedings of the IEEE.

[26]  Alastair G. Gale,et al.  Is airport baggage inspection just another medical image? , 2000, Medical Imaging.

[27]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[28]  D. Ruderman The statistics of natural images , 1994 .

[29]  Eero P. Simoncelli,et al.  Natural image statistics and divisive normalization: Modeling nonlinearity and adaptation in cortical neurons , 2002 .

[30]  Xin He,et al.  Model Observers in Medical Imaging Research , 2013, Theranostics.

[31]  Constantine Caramanis,et al.  Second Order Natural Scene Statistics Model of Blind Image Quality Assessment , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  Constantine Caramanis,et al.  Towards a Closed Form Second-Order Natural Scene Statistics Model , 2018, IEEE Transactions on Image Processing.

[33]  Ehsan Samei,et al.  Does image quality matter? Impact of resolution and noise on mammographic task performance. , 2007, Medical physics.

[34]  Praful Gupta,et al.  Natural Scene Statistics for Noise Estimation , 2018, 2018 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI).

[35]  Kyle J Myers,et al.  Task-based measures of image quality and their relation to radiation dose and patient risk , 2015, Physics in medicine and biology.

[36]  H H Barrett,et al.  Addition of a channel mechanism to the ideal-observer model. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[37]  D. Tolhurst,et al.  Amplitude spectra of natural images. , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[38]  Alan C. Bovik,et al.  Feature maps driven no-reference image quality prediction of authentically distorted images , 2015, Electronic Imaging.

[39]  R. F. Wagner,et al.  Objective assessment of image quality. II. Fisher information, Fourier crosstalk, and figures of merit for task performance. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  Alan Conrad Bovik,et al.  Predicting the Quality of Fused Long Wave Infrared and Visible Light Images , 2017, IEEE Transactions on Image Processing.

[41]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[42]  Eero P. Simoncelli,et al.  Image denoising using mixtures of Gaussian scale mixtures , 2008, 2008 15th IEEE International Conference on Image Processing.

[43]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[44]  Nicholas G. Paulter,et al.  Tasking on Natural Statistics of Infrared Images , 2016, IEEE Transactions on Image Processing.

[45]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[46]  A Burgess,et al.  Image quality, the ideal observer, and human performance of radiologic decision tasks. , 1995, Academic radiology.

[47]  Craig K. Abbey,et al.  Observer efficiency in free-localization tasks with correlated noise , 2014, Front. Psychol..