Scene-and-Process-Dependent Spatial Image Quality Metrics

Spatial image quality metrics designed for camera systems generally employ the Modulation Transfer Function (MTF), the Noise Power Spectrum (NPS), and a visual contrast detection model. Prior art indicates that scene-dependent characteristics of non-linear, content-aware image processing are unaccounted for by MTFs and NPSs measured using traditional methods. We present two novel metrics: the log Noise Equivalent Quanta (log NEQ) and Visual log NEQ. They both employ scene-and-process-dependent MTF (SPD-MTF) and NPS (SPD-NPS) measures, which account for signal-transfer and noise scene-dependency, respectively. We also investigate implementing contrast detection and discrimination models that account for scene-dependent visual masking. Also, three leading camera metrics are revised that use the above scene-dependent measures. All metrics are validated by examining correlations with the perceived quality of images produced by simulated camera pipelines. Metric accuracy improved consistently when the SPD-MTFs and SPD-NPSs were implemented. The novel metrics outperformed existing metrics of the same genre.

[1]  Benjamin Tseng,et al.  Towards the Development of the IEEE P1858 CPIQ Standard – A Validation Study , 2017 .

[2]  Peter D. Burns,et al.  Texture MTF from images of natural scenes , 2017 .

[3]  Martin Vetterli,et al.  Demosaicking by Alternating Projections: Theory and Fast One-Step Implementation , 2010, IEEE Transactions on Image Processing.

[4]  G. Legge,et al.  Contrast discrimination in noise. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[5]  Elizabeth Allen,et al.  Image Quality Evaluation in Lossy Compressed Images , 2017 .

[6]  Peter G. Engeldrum,et al.  Psychometric Scaling: A Toolkit for Imaging Systems Development , 2000 .

[7]  Sophie Triantaphillidou,et al.  Spatial contrast sensitivity and discrimination in pictorial images , 2014, Electronic Imaging.

[8]  Alexandra Psarrou,et al.  Edge Detection Techniques for Quantifying Spatial Imaging System Performance and Image Quality , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Elaine W. Jin,et al.  Texture-based measurement of spatial frequency response using the dead leaves target: extensions, and application to real camera systems , 2010, Electronic Imaging.

[10]  BrianW. Keelan.  Imaging Applications of Noise Equivalent Quanta , 2016, IQSP.

[11]  D. Laming.  The measurement of sensation , 1997 .

[12]  Brian W. Keelan.  Objective and subjective measurement and modeling of image quality: a case study , 2010, Optical Engineering + Applications.

[13]  R. Shepard.  Metric structures in ordinal data , 1966 .

[14]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Sophie Triantaphillidou,et al.  Image Quality Loss and Compensation for Visually Impaired Observers , 2018 .

[16]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[17]  J. Movshon,et al.  Analysis of the development of spatial contrast sensitivity in monkey and human infants. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[18]  Mark D. Fairchild,et al.  A top down description of S-CIELAB and CIEDE2000 , 2003 .

[19]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[20]  Peter D. Burns.  Signal-to-noise ratio analysis of charge-coupled device imagers , 1990, Other Conferences.

[21]  Peter D. Burns,et al.  Intrinsic camera resolution measurement , 2015, Electronic Imaging.

[22]  Zhou Wang,et al.  Reduced- and No-Reference Image Quality Assessment , 2011, IEEE Signal Processing Magazine.

[23]  Uwe Artmann,et al.  Description of texture loss using the dead leaves target: current issues and a new intrinsic approach , 2014, Electronic Imaging.

[24]  Sophie Triantaphillidou,et al.  Validation of Modulation Transfer Functions and Noise Power Spectra from Natural Scenes , 2019, ArXiv.

[25]  R. E. Jacobson,et al.  The relationship between objective and subjective image quality criteria , 1993 .

[26]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[27]  Peter D. Burns.  Refined measurement of digital image texture loss , 2013, Electronic Imaging.

[28]  Brian Keelan,et al.  Handbook of Image Quality: Characterization and Prediction , 2002 .

[29]  C. I. Coleman,et al.  Image Science: Principles, Analysis and Evaluation of Photographic-type Imaging Processes , 1975 .

[30]  Uwe Artmann.  Measurement of Noise using the dead leaves pattern , 2018 .

[31]  L. Sica,et al.  Image-sharpness criterion for space-variant imaging , 1981 .

[32]  Peter G. J. Barten,et al.  Physical model for the contrast sensitivity of the human eye , 1992, Electronic Imaging.

[33]  Peter G. J. Barten,et al.  Evaluation of the effect of noise on subjective image quality , 1991, Electronic Imaging.

[34]  Frédéric Guichard,et al.  Measuring texture sharpness of a digital camera , 2009, Electronic Imaging.

[35]  Otto H. Schade,et al.  Image Quality: A Comparison of Photographic and Television Systems , 1987 .

[36]  Sophie Triantaphillidou,et al.  Image quality optimization, via application of contextual contrast sensitivity and discrimination functions , 2015, Electronic Imaging.

[37]  Sophie Triantaphillidou,et al.  Bridging the Gap Between Imaging Performance and Image Quality Measures , 2018 .

[38]  Mark A. Richardson,et al.  Use of the first-order Wiener kernel transform in the evaluation of SQRIn and PIC quality metrics for JPEG compression , 2003, IS&T/SPIE Electronic Imaging.

[39]  Donald Baxter,et al.  Calibration and adaptation of ISO visual noise for I3A's Camera Phone Image Quality initiative , 2012, Electronic Imaging.

[40]  Peter G. J. Barten,et al.  Contrast sensitivity of the human eye and its e ects on image quality , 1999 .

[41]  Peter G. J. Barten.  The Square Root Integral (SQRI): A New Metric To Describe The Effect Of Various Display Parameters On Perceived Image Quality , 1989, Photonics West - Lasers and Applications in Science and Engineering.