Diagnostic quality assessment of medical images: Challenges and trends

With medical imaging technologies growth, the question of their assessment on the impact and benefit on patient care is rising. Development and design of those medical imaging technologies should take into account the concept of image quality as it might impact the ability of practicians while they are using image information. Towards that goal, one should consider several human factors involved in image analysis and interpretation, e.g. image perception issues, decision process, image analysis pipeline (detection, localization, characterization…). While many efforts have been dedicated to objectively assess the value of imaging system in terms of ideal decision process, new trends have recently emerged to deal with human observer perfomances. This task effort is huge considering the variability of imaging acquisition methods and the possible pathologies. This paper proposes a survey of some key issues and results associated to this effort. We first outline the wide range of medical images with their own specific features. Next, we review the main methodologies to evaluate diagnostic quality of medical images from subjective assessment including ROC analysis, and diagnostic criteria quality analysis, to objective assessment including metrics based on the HVS, and model observers. At last, we present another evaluation method: eye-tracking studies to gain basic understanding of the visual search and decision-making process.

[1]  Charles E Metz,et al.  ROC analysis in medical imaging: a tutorial review of the literature , 2008, Radiological physics and technology.

[2]  Bradley James Erickson,et al.  Irreversible Compression of Medical Images , 2002, Journal of Digital Imaging.

[3]  Xuanqin Mou,et al.  Divisive normalization in channelized Hotelling observer , 2010, Electronic Imaging.

[4]  R. Swensson Unified measurement of observer performance in detecting and localizing target objects on images. , 1996, Medical physics.

[5]  T. Crawford,et al.  How do radiologists do it? The influence of experience and training on searching for chest nodules. , 2006 .

[6]  E A Krupinski,et al.  Perception research in medical imaging. , 2005, The British journal of radiology.

[7]  Xin He,et al.  ROC, LROC, FROC, AFROC: an alphabet soup. , 2009, Journal of the American College of Radiology : JACR.

[8]  Jeffrey Lubin,et al.  The use of psychophysical data and models in the analysis of display system performance , 1993 .

[9]  Bo Hyoung Kim,et al.  Irreversible JPEG 2000 compression of abdominal CT for primary interpretation: assessment of visually lossless threshold , 2006, European Radiology.

[10]  R. Sukanesh,et al.  Performance Evaluation of Shape Adaptive Discrete Wavelet Transform Based Magnetic Resonance Images Coding , 2009, 2009 International Conference on Future Computer and Communication.

[11]  Yongyi Yang,et al.  Learning a Channelized Observer for Image Quality Assessment , 2009, IEEE Transactions on Medical Imaging.

[12]  Mathias Prokop,et al.  JPEG2000 compression of thin-section CT images of the lung: effect of compression ratio on image quality. , 2006, Radiology.

[13]  Elizabeth A Krupinski,et al.  Technology and perception in the 21st-century reading room. , 2006, Journal of the American College of Radiology : JACR.

[14]  Elizabeth A. Krupinski,et al.  Channelized model observer using a visual discrimination model , 2005, SPIE Medical Imaging.

[15]  Ljiljana Platisa,et al.  Channelized hotelling observers for the detection of 2D signals in 3D simulated images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[16]  Hans Roehrig,et al.  Using a human visual system model to optimize soft-copy mammography display: influence of display phosphor. , 2003, Academic radiology.

[17]  H E Rockette,et al.  Statistical test to assess rank-order imaging studies. , 2001, Academic radiology.

[18]  J A Solomon,et al.  Model of visual contrast gain control and pattern masking. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[19]  Amine Nait-Ali,et al.  Compression of Biomedical Images and Signals , 2008 .

[20]  H H Barrett,et al.  Addition of a channel mechanism to the ideal-observer model. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[21]  Wilfried Philips,et al.  The use of steerable channels for detecting asymmetrical signals with random orientations , 2010, Medical Imaging.

[22]  R. F. Wagner,et al.  Continuous versus categorical data for ROC analysis: some quantitative considerations. , 2001, Academic radiology.

[23]  Donglai Huo,et al.  Methods for quantitative image quality evaluation of MRI parallel reconstructions: detection and perceptual difference model. , 2007, Magnetic resonance imaging.

[24]  Tom Kimpe,et al.  Impact of defective pixels in AMLCDs on the perception of medical images , 2006, SPIE Medical Imaging.

[25]  H.H. Barrett,et al.  Model observers for assessment of image quality , 1993, 2002 IEEE Nuclear Science Symposium Conference Record.

[26]  Artur Przelaskowski Vector quality measure of lossy compressed medical images , 2004, Comput. Biol. Medicine.

[27]  Rafal Mantiuk,et al.  Artifacts in slab average-intensity-projection images reformatted from JPEG 2000 compressed thin-section abdominal CT data sets. , 2008, AJR. American journal of roentgenology.

[28]  Kunio Doi,et al.  Experimental design and data analysis in receiver operating characteristic studies: lessons learned from reports in radiology from 1997 to 2006. , 2009, Radiology.

[29]  Kevin S Berbaum,et al.  An empirical comparison of discrete ratings and subjective probability ratings. , 2002, Academic radiology.

[30]  Maryellen L Giger,et al.  Potential effect of different radiologist reporting methods on studies showing benefit of CAD. , 2008, Academic radiology.

[31]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[32]  E. Krupinski,et al.  Anniversary paper: evaluation of medical imaging systems. , 2008, Medical physics.

[33]  Christine Cavaro-Ménard,et al.  Eye-position recording during brain MRI examination to identify and characterize steps of glioma diagnosis , 2010, Medical Imaging.

[34]  R. F. Wagner,et al.  Assessment of medical imaging systems and computer aids: a tutorial review. , 2007, Academic radiology.

[35]  Kunio Doi,et al.  Independent versus sequential reading in ROC studies of computer-assist modalities: analysis of components of variance. , 2002, Academic radiology.

[36]  Harrison H Barrett,et al.  Validating the use of channels to estimate the ideal linear observer. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.