Quantitative image quality evaluation of MR images using perceptual difference models.

The authors are using a perceptual difference model (Case-PDM) to quantitatively evaluate image quality of the thousands of test images which can be created when optimizing fast magnetic resonance (MR) imaging strategies and reconstruction techniques. In this validation study, they compared human evaluation of MR images from multiple organs and from multiple image reconstruction algorithms to Case-PDM and similar models. The authors found that Case-PDM compared very favorably to human observers in double-stimulus continuous-quality scale and functional measurement theory studies over a large range of image quality. The Case-PDM threshold for nonperceptible differences in a 2-alternative forced choice study varied with the type of image under study, but was approximately 1.1 for diffuse image effects, providing a rule of thumb. Ordering the image quality evaluation models, we found in overall Case-PDM approximately IDM (Sarnoff Corporation) approximately SSIM [Wang et al. IEEE Trans. Image Process. 13, 600-612 (2004)] > mean squared error NR [Wang et al. (2004) (unpublished)] > DCTune (NASA) > IQM (MITRE Corporation). The authors conclude that Case-PDM is very useful in MR image evaluation but that one should probably restrict studies to similar images and similar processing, normally not a limitation in image reconstruction studies.

[1]  V. Ralph Algazi,et al.  Objective picture quality scale (PQS) for image coding , 1998, IEEE Trans. Commun..

[2]  Andrew P. Bradley,et al.  Perceptual quality metrics applied to still image compression , 1998, Signal Process..

[3]  Tokuhiko Omatsu,et al.  Wavelet compression on detection of brain lesions with magnetic resonance imaging , 2009, Journal of Digital Imaging.

[4]  J. Sijbers,et al.  Maximum likelihood estimation of signal amplitude and noise variance from MR data , 2004, Magnetic resonance in medicine.

[5]  Tzong-Jer Chen,et al.  Quality of Compressed Medical Images , 2007, Journal of Digital Imaging.

[6]  Jiahua Fan,et al.  Using a human visual system model to optimize soft-copy mammography display: influence of MTF compensation. , 2003, Academic radiology.

[7]  Markus Barth,et al.  Contrast‐to‐noise ratio (CNR) as a quality parameter in fMRI , 2007, Journal of magnetic resonance imaging : JMRI.

[8]  Jean-Bernard Martens,et al.  Subjective quality assessment of compressed images , 1997, Signal Process..

[9]  J. Lubin A human vision system model for objective picture quality measurements , 1997 .

[10]  Jean-Bernard Martens,et al.  Image dissimilarity , 1998, Signal Process..

[11]  S. Klein,et al.  Measuring, estimating, and understanding the psychometric function: A commentary , 2001, Perception & psychophysics.

[12]  S. Schoenberg,et al.  Measurement of signal‐to‐noise ratios in MR images: Influence of multichannel coils, parallel imaging, and reconstruction filters , 2007, Journal of magnetic resonance imaging : JMRI.

[13]  Daniel K Sodickson,et al.  Self‐calibrating parallel imaging with automatic coil sensitivity extraction , 2002, Magnetic resonance in medicine.

[14]  M Fuderer,et al.  The information content of MR images. , 1988, IEEE transactions on medical imaging.

[15]  William F. Eddyy,et al.  Improved image registration by using fourier interpolation , 1996, Magnetic resonance in medicine.

[16]  Norman H. Anderson,et al.  Integration Theory Applied To Models of Inequity , 1975 .

[17]  Seong Ho Park,et al.  Image quality and focal lesion detection on T2‐weighted MR imaging of the liver: Comparison of two high‐resolution free‐breathing imaging techniques with two breath‐hold imaging techniques , 2007, Journal of magnetic resonance imaging : JMRI.

[18]  Jonathan S. Lewin,et al.  Validation of a human vision model for image quality evaluation of fast interventional magnetic resonance imaging , 2002, J. Electronic Imaging.

[19]  Donglai Huo,et al.  Robust GRAPPA reconstruction and its evaluation with the perceptual difference model , 2008, Journal of magnetic resonance imaging : JMRI.

[20]  Miguel P Eckstein,et al.  Classification images for detection, contrast discrimination, and identification tasks with a common ideal observer. , 2006, Journal of vision.

[21]  David L. Wilson,et al.  Optimization of detector pixel size for stent visualization in x-ray fluoroscopy. , 2006 .

[22]  J. Pipe Motion correction with PROPELLER MRI: Application to head motion and free‐breathing cardiac imaging , 1999, Magnetic resonance in medicine.

[23]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[24]  O. Simonetti,et al.  Artifact and noise suppression in GRAPPA imaging using improved k‐space coil calibration and variable density sampling , 2005, Magnetic resonance in medicine.

[25]  Eli Peli,et al.  Thresholds vary between spatial and temporal forced-choice paradigms: the case of lateral interactions in peripheral vision. , 2005, Spatial vision.

[26]  David L. Wilson,et al.  Perceptual difference model (Case-PDM) for evaluation of MR images: validation and calibration , 2007, SPIE Medical Imaging.

[27]  Rolf Ulrich,et al.  Threshold estimation in two-alternative forced-choice (2AFC) tasks: The Spearman-Kärber method , 2004, Perception & psychophysics.

[28]  Lubomir M. Hadjiiski,et al.  Feature selection and classifier performance in computer-aided diagnosis: the effect of finite sample size. , 2000, Medical physics.

[29]  Yun Zhou,et al.  A practice of medical image quality evaluation , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[30]  David L Wilson,et al.  Image quality evaluation of flat panel and image intensifier digital magnification in x-ray fluoroscopy. , 2002, Medical physics.

[31]  Donglai Huo,et al.  Application of perceptual difference model on regularization techniques of parallel MR imaging. , 2006, Magnetic resonance imaging.

[32]  R. Bender,et al.  Calculating confidence intervals for the number needed to treat. , 2001, Controlled clinical trials.

[33]  Hans Roehrig,et al.  Using a human visual system model to optimize soft-copy mammography display: influence of display phosphor. , 2003, Academic radiology.

[34]  P M Jakob,et al.  VD‐AUTO‐SMASH imaging , 2001, Magnetic resonance in medicine.

[35]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[36]  Ian R Summers,et al.  Information content and quality of MR thumb images. , 2003, Physics in medicine and biology.

[37]  Peter Boesiger,et al.  k‐t BLAST and k‐t SENSE: Dynamic MRI with high frame rate exploiting spatiotemporal correlations , 2003, Magnetic resonance in medicine.

[38]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[39]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[40]  A. Burgess Comparison of receiver operating characteristic and forced choice observer performance measurement methods. , 1995, Medical physics.

[41]  Donglai Huo,et al.  QUANTITATIVE IMAGE QUALITY EVALUATION OF FAST MAGNETIC RESONANCE IMAGING , 2007 .

[42]  Peter Kellman,et al.  Dynamic autocalibrated parallel imaging using temporal GRAPPA (TGRAPPA) , 2005, Magnetic resonance in medicine.

[43]  E. Peli Contrast in complex images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[44]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[45]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[46]  Miew Keen Choong,et al.  Improving Diagnostic Quality of MR Images Through Controlled Lossy Compression Using SPIHT , 2006, Journal of Medical Systems.

[47]  Christos P. Loizou,et al.  Quality evaluation of ultrasound imaging in the carotid artery based on normalization and speckle reduction filtering , 2006, Proceedings of the 12th IEEE Mediterranean Electrotechnical Conference (IEEE Cat. No.04CH37521).

[48]  Hiroshi Tanaka,et al.  Qualitative and quantitative assessment of video transmitted by DVTS (digital video transport system) in surgical telemedicine , 2007, Journal of telemedicine and telecare.

[49]  Donglai Huo,et al.  Methods for quantitative image quality evaluation of MRI parallel reconstructions: detection and perceptual difference model. , 2007, Magnetic resonance imaging.

[50]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[51]  Takeshi Yoshikawa,et al.  Focal liver lesions: Breathhold gradient‐ and spin‐echo T2‐weighted imaging for detection and characterization , 2006, Journal of magnetic resonance imaging : JMRI.

[52]  J Velikina,et al.  Highly constrained backprojection for time‐resolved MRI , 2006, Magnetic resonance in medicine.

[53]  Abu-Bakr Al-Mehdi,et al.  Increased Depth of Cellular Imaging in the Intact Lung Using Far-Red and Near-Infrared Fluorescent Probes , 2006, Int. J. Biomed. Imaging.

[54]  D L Wilson,et al.  Pulsed fluoroscopy detectability from interspersed adaptive forced-choice measurements. , 1996, Medical physics.

[55]  Donglai Huo,et al.  Optimization of Spiral MRI Using a Perceptual Difference Model , 2006, Int. J. Biomed. Imaging.

[56]  Elizabeth A. Krupinski,et al.  Use of a Human Visual System Model to Predict Observer Performance with CRT vs LCD Display of Images , 2004, Journal of Digital Imaging.

[57]  Eric Clarkson,et al.  Efficiency of the human observer detecting random signals in random backgrounds. , 2005, Journal of the Optical Society of America. A, Optics, image science, and vision.

[58]  Yoshiyuki Takahashi,et al.  Optimal inversion time for acquiring flow-sensitive alternating inversion recovery images to quantify regional cerebral blood flow , 2002, European Radiology.