Variability and Standardization of Quantitative Imaging

Abstract Radiological images have been assessed qualitatively in most clinical settings by the expert eyes of radiologists and other clinicians. On the other hand, quantification of radiological images has the potential to detect early disease that may be difficult to detect with human eyes, complement or replace biopsy, and provide clear differentiation of disease stage. Further, objective assessment by quantification is a prerequisite of personalized/precision medicine. This review article aims to summarize and discuss how the variability of quantitative values derived from radiological images are induced by a number of factors and how these variabilities are mitigated and standardization of the quantitative values are achieved. We discuss the variabilities of specific biomarkers derived from magnetic resonance imaging and computed tomography, and focus on diffusion-weighted imaging, relaxometry, lung density evaluation, and computer-aided computed tomography volumetry. We also review the sources of variability and current efforts of standardization of the rapidly evolving techniques, which include radiomics and artificial intelligence.

[1]  E. Purcell,et al.  Effects of Diffusion on Free Precession in Nuclear Magnetic Resonance Experiments , 1954 .

[2]  S. Meiboom,et al.  Modified Spin‐Echo Method for Measuring Nuclear Relaxation Times , 1958 .

[3]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[4]  D. Look,et al.  Time Saving in Measurement of NMR and EPR Relaxation Times , 1970 .

[5]  J. Hanley,et al.  The effect of measuring error on the results of therapeutic trials in advanced cancer , 1976, Cancer.

[6]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[7]  S. Riederer,et al.  Optimizing the precision in T1 relaxation estimation using limited flip angles , 1987, Magnetic resonance in medicine.

[8]  G. Barker,et al.  Semiautomated quality assurance for quantitative magnetic resonance imaging. , 1992, Magnetic resonance imaging.

[9]  P. Tofts,et al.  Ni-DTPA doped agarose gel--a phantom material for Gd-DTPA enhancement measurements. , 1993, Magnetic resonance imaging.

[10]  C. Stewart‐Amidei Profiles , 1995 .

[11]  D. Altman,et al.  Statistics Notes: Measurement error and correlation coefficients , 1996, BMJ.

[12]  A. Nevill,et al.  Assessing agreement between measurements recorded on a ratio scale in sports medicine and sports science. , 1997, British journal of sports medicine.

[13]  M. Tanemura,et al.  Quantitative assessment of the spatial distribution of low attenuation areas on X-ray CT using texture analysis in patients with chronic pulmonary emphysema. , 1997, Frontiers of medical and biological engineering : the international journal of the Japan Society of Medical Electronics and Biological Engineering.

[14]  R. Edelman,et al.  A Phantom for diffusion‐weighted imaging of acute stroke , 1998, Journal of magnetic resonance imaging : JMRI.

[15]  M. Knopp,et al.  Estimating kinetic parameters from dynamic contrast‐enhanced t1‐weighted MRI of a diffusable tracer: Standardized quantities and symbols , 1999, Journal of magnetic resonance imaging : JMRI.

[16]  A. MacKay,et al.  Are mono‐exponential fits to a few echoes sufficient to determine T2 relaxation for in vivo human brain? , 1999, Magnetic resonance in medicine.

[17]  D. Hoult The principle of reciprocity in signal strength calculations—a mathematical guide , 2000 .

[18]  J. Fischer,et al.  Intrarater and interrater reliability of the MS functional composite outcome measure , 2000, Neurology.

[19]  R M Harrison,et al.  Quality assurance for MRI: practical experience. , 2000, The British journal of radiology.

[20]  D. DeMets,et al.  Biomarkers and surrogate endpoints: Preferred definitions and conceptual framework , 2001, Clinical pharmacology and therapeutics.

[21]  P. Paré,et al.  Quantitative assessment of airway remodeling using high-resolution CT. , 2002, Chest.

[22]  A. Pfefferbaum,et al.  Replicability of diffusion tensor imaging measurements of fractional anisotropy and trace in brain , 2003, Journal of magnetic resonance imaging : JMRI.

[23]  H. Potter,et al.  T2 quantitation of articular cartilage at 1.5 T , 2003, Journal of magnetic resonance imaging : JMRI.

[24]  M. Leach,et al.  Developing a quality control protocol for diffusion imaging on a clinical MRI system. , 2004, Physics in medicine and biology.

[25]  R. Constable,et al.  Measurement and correction of transmitter and receiver induced nonuniformities in vivo , 2005, Magnetic resonance in medicine.

[26]  T. Peters,et al.  High‐resolution T1 and T2 mapping of the brain in a clinically acceptable time with DESPOT1 and DESPOT2 , 2005, Magnetic resonance in medicine.

[27]  Harold L Kundel,et al.  History of research in medical image perception. , 2006, Journal of the American College of Radiology : JACR.

[28]  M. Hasegawa,et al.  Airflow limitation and airway dimensions in chronic obstructive pulmonary disease. , 2006, American journal of respiratory and critical care medicine.

[29]  M. Symms,et al.  A simple correction for B1 field errors in magnetization transfer ratio measurements. , 2006, Magnetic resonance imaging.

[30]  D. Xu,et al.  Nodule management protocol of the NELSON randomised lung cancer screening trial. , 2006, Lung cancer.

[31]  S. Nelson,et al.  Measurement of in vivo multi-component T2 relaxation times for brain tissue using multi-slice T2 prep at 1.5 and 3 T. , 2006, Magnetic resonance imaging.

[32]  G. Wright,et al.  Rapid high‐resolution T1 mapping by variable flip angles: Accurate and precise measurements in the presence of radiofrequency field inhomogeneity , 2006, Magnetic resonance in medicine.

[33]  G. Barker,et al.  Sources of variation in multi-centre brain MTR histogram studies: body-coil transmission eliminates inter-centre differences , 2006, Magnetic Resonance Materials in Physics, Biology and Medicine.

[34]  E. V. van Beek,et al.  The Lung Image Database Consortium (LIDC): a comparison of different size metrics for pulmonary nodule measurements. , 2007, Academic radiology.

[35]  K. Uğurbil,et al.  Magnetic field and tissue dependencies of human brain longitudinal 1H2O relaxation in vivo , 2007, Magnetic resonance in medicine.

[36]  L. Turnbull,et al.  Repeatability of echo-planar-based diffusion measurements of the human prostate at 3 T. , 2007, Magnetic resonance imaging.

[37]  David Bonekamp,et al.  Diffusion tensor imaging in children and adolescents: Reproducibility, hemispheric, and age-related differences , 2007, NeuroImage.

[38]  P. Lundberg,et al.  Rapid magnetic resonance quantification on the brain: Optimization for clinical usage , 2008, Magnetic resonance in medicine.

[39]  H. Kauczor,et al.  Radiation dose reduction in chest CT: a review. , 2008, AJR. American journal of roentgenology.

[40]  Kei Yamada,et al.  Variability in absolute apparent diffusion coefficient values across different platforms may be substantial: a multivendor, multi-institutional comparison study. , 2008, Radiology.

[41]  D. Barboriak,et al.  Repeatability of quantitative parameters derived from diffusion tensor imaging in patients with glioblastoma multiforme , 2009, Journal of magnetic resonance imaging : JMRI.

[42]  P. Choyke,et al.  Diffusion-weighted magnetic resonance imaging as a cancer biomarker: consensus and recommendations. , 2009, Neoplasia.

[43]  E. Merkle,et al.  Short- and midterm reproducibility of apparent diffusion coefficient measurements at 3.0-T diffusion-weighted imaging of the abdomen. , 2009, Radiology.

[44]  S. Lam,et al.  New and current clinical imaging techniques to study chronic obstructive pulmonary disease. , 2009, American journal of respiratory and critical care medicine.

[45]  T. Chenevert,et al.  Diffusion-weighted MRI for assessment of early cancer treatment response. , 2010, Current pharmaceutical biotechnology.

[46]  J. Remy,et al.  Thoracic applications of dual energy. , 2010, Radiologic clinics of North America.

[47]  E. Weibel,et al.  American Thoracic Society Documents An Official Research Policy Statement of the American Thoracic Society/European Respiratory Society: Standards for Quantitative Assessment of Lung Structure , 2010 .

[48]  Raúl San José Estépar,et al.  Pulmonary hypertension and computed tomography measurement of small pulmonary vessels in severe emphysema. , 2010, American journal of respiratory and critical care medicine.

[49]  Sang Joon Park,et al.  Chronic obstructive pulmonary disease: quantitative and visual ventilation pattern analysis at xenon ventilation CT performed by using a dual-energy technique. , 2010, Radiology.

[50]  D. Sullivan,et al.  A collaborative enterprise for multi-stakeholder participation in the advancement of quantitative imaging. , 2011, Radiology.

[51]  D. Collins,et al.  Multicentre imaging measurements for oncology and in the brain. , 2011, The British journal of radiology.

[52]  C. Meyer,et al.  Diffusion coefficient measurement using a temperature‐controlled fluid for quality control in multicenter studies , 2011, Journal of magnetic resonance imaging : JMRI.

[53]  G. McLennan,et al.  Quantitative imaging test approval and biomarker qualification: interrelated but distinct activities. , 2011, Radiology.

[54]  C. Gatsonis,et al.  Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening , 2012 .

[55]  H. Kauczor,et al.  Treatment Monitoring in Gliomas: Comparison of Dynamic Susceptibility-Weighted Contrast-Enhanced and Spectroscopic MRI Techniques for Identifying Treatment Failure , 2011, Investigative radiology.

[56]  A. Hrõbjartsson,et al.  Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. , 2011, Journal of clinical epidemiology.

[57]  J. Bussink,et al.  Diffusion-weighted MR imaging in liver metastases of colorectal cancer: reproducibility and biological validation , 2013, European Radiology.

[58]  R. Deichmann,et al.  Correction of systematic errors in quantitative proton density mapping , 2012, Magnetic resonance in medicine.

[59]  M. Tanter,et al.  Measurement of pulsatile motion with millisecond resolution by MRI , 2012, Magnetic resonance in medicine.

[60]  Ali O. Farooqi,et al.  Lung cancers diagnosed at annual CT screening: volume doubling times. , 2012, Radiology.

[61]  K. Murase,et al.  Quantitative bronchial luminal volumetric assessment of pulmonary function loss by thin-section MDCT in pulmonary emphysema patients. , 2012, European journal of radiology.

[62]  Meilan K. Han,et al.  Pulmonary arterial enlargement and acute exacerbations of COPD. , 2012, The New England journal of medicine.

[63]  Y. Ohno,et al.  Three-dimensional airway lumen volumetry: comparison with bronchial wall area and parenchymal densitometry in assessment of airway obstruction in pulmonary emphysema. , 2012, The British journal of radiology.

[64]  A. Dirksen,et al.  CT screening for lung cancer brings forward early disease. The randomised Danish Lung Cancer Screening Trial: status after five annual screening rounds with low-dose CT , 2012, Thorax.

[65]  H. Huisman,et al.  Interpatient variation in normal peripheral zone apparent diffusion coefficient: effect on the prediction of prostate cancer aggressiveness. , 2012, Radiology.

[66]  Maud Marchal,et al.  An anthropomorphic polyvinyl alcohol brain phantom based on Colin27 for use in multimodal imaging. , 2012, Medical physics.

[67]  R. Boubertakh,et al.  In vitro and in vivo repeatability of abdominal diffusion-weighted MRI. , 2012, The British journal of radiology.

[68]  T. Mizoue,et al.  A decrease in lung cancer mortality following the introduction of low-dose chest CT screening in Hitachi, Japan. , 2012, Lung cancer.

[69]  M. Markey,et al.  Differentiating tumor recurrence from treatment necrosis: a review of neuro-oncologic imaging strategies. , 2013, Neuro-oncology.

[70]  J. Goldin Computed Tomography as a Biomarker in Clinical Trials Imaging , 2013, Journal of thoracic imaging.

[71]  J. Duerk,et al.  Magnetic Resonance Fingerprinting , 2013, Nature.

[72]  J. Remy,et al.  Thoracic Applications of Dual Energy , 2014, Seminars in Respiratory and Critical Care Medicine.

[73]  P. Lambin,et al.  Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation , 2014, PloS one.

[74]  H. Merisaari,et al.  Optimization of b‐value distribution for biexponential diffusion‐weighted MR imaging of normal prostate , 2014, Journal of magnetic resonance imaging : JMRI.

[75]  H. Kauczor,et al.  Radiation dose reduction in chest CT--review of available options. , 2014, European journal of radiology.

[76]  M. E. Moseley,et al.  MR vascular fingerprinting: A new approach to compute cerebral blood volume, mean vessel radius, and oxygenation maps in the human brain , 2014, NeuroImage.

[77]  A. Leung,et al.  Prognostic importance of volumetric measurements in stage I lung adenocarcinoma. , 2014, Radiology.

[78]  A. Padhani,et al.  Apparent diffusion coefficient measurements as very early predictive markers of response to chemotherapy in hepatic metastasis: A preliminary investigation of reproducibility and diagnostic value , 2014, Journal of magnetic resonance imaging : JMRI.

[79]  Binsheng Zhao,et al.  Comparison of 1D, 2D, and 3D nodule sizing methods by radiologists for spherical and complex nodules on thoracic CT phantom images. , 2014, Academic radiology.

[80]  K. Fong,et al.  Biomarkers of progression of chronic obstructive pulmonary disease (COPD). , 2014, Journal of thoracic disease.

[81]  T. Ebbers,et al.  Simultaneous three-dimensional myocardial T1 and T2 mapping in one breath hold with 3D-QALAS , 2014, Journal of Cardiovascular Magnetic Resonance.

[82]  P. Börnert,et al.  Ventricular B1+ perturbation at 7 T – real effect or measurement artifact? , 2014, NMR in biomedicine.

[83]  S. Matsumoto,et al.  Iterative reconstruction technique vs filter back projection: utility for quantitative bronchial assessment on low-dose thin-section MDCT in patients with/without chronic obstructive pulmonary disease , 2014, European Radiology.

[84]  H. D. de Koning,et al.  Detection of lung cancer through low-dose CT screening (NELSON): a prespecified analysis of screening test performance and interval cancers. , 2014, The Lancet. Oncology.

[85]  T. Helbich,et al.  Improved Diagnostic Accuracy With Multiparametric Magnetic Resonance Imaging of the Breast Using Dynamic Contrast-Enhanced Magnetic Resonance Imaging, Diffusion-Weighted Imaging, and 3-Dimensional Proton Magnetic Resonance Spectroscopic Imaging , 2014, Investigative radiology.

[86]  M. Schluchter,et al.  Simultaneous T1 and T2 Brain Relaxometry in Asymptomatic Volunteers Using Magnetic Resonance Fingerprinting , 2015, Tomography.

[87]  P. Hahn,et al.  Body MR Imaging: Artifacts, k-Space, and Solutions. , 2015, Radiographics : a review publication of the Radiological Society of North America, Inc.

[88]  Olivier Gevaert,et al.  Core samples for radiomics features that are insensitive to tumor segmentation: method and pilot study using CT images of hepatocellular carcinoma , 2015, Journal of medical imaging.

[89]  A. Field,et al.  Mean apparent diffusion coefficient values in defining radiotherapy planning target volumes in glioblastoma. , 2015, Quantitative imaging in medicine and surgery.

[90]  M. Griswold,et al.  MR fingerprinting using fast imaging with steady state precession (FISP) with spiral readout , 2015, Magnetic resonance in medicine.

[91]  D. Lynch,et al.  CT staging and monitoring of fibrotic interstitial lung diseases in clinical practice and treatment trials: a position paper from the Fleischner Society. , 2015, The Lancet. Respiratory medicine.

[92]  Kyle J Myers,et al.  Quantitative imaging biomarkers: A review of statistical methods for computer algorithm comparisons , 2014, Statistical methods in medical research.

[93]  T. Scheenen,et al.  Multiparametric Magnetic Resonance Imaging in Prostate Cancer Management: Current Status and Future Perspectives , 2015, Investigative radiology.

[94]  N. Petrick,et al.  Statistical analysis of lung nodule volume measurements with CT in a large-scale phantom study. , 2015, Medical physics.

[95]  M. Sahraian,et al.  Classification algorithms with multi-modal data fusion could accurately distinguish neuromyelitis optica from multiple sclerosis , 2015, NeuroImage: Clinical.

[96]  P. Marsden,et al.  False Discovery Rates in PET and CT Studies with Texture Features: A Systematic Review , 2015, PloS one.

[97]  N. Obuchowski,et al.  Introduction to metrology series , 2015, Statistical methods in medical research.

[98]  Christine L. Tardif,et al.  On the accuracy of T1 mapping: Searching for common ground , 2015, Magnetic resonance in medicine.

[99]  Erich P Huang,et al.  Meta-analysis of the technical performance of an imaging procedure: Guidelines and statistical methodology , 2015, Statistical methods in medical research.

[100]  Mithat Gönen,et al.  Quantitative imaging biomarkers: A review of statistical methods for technical performance assessment , 2015, Statistical methods in medical research.

[101]  M. Scorsetti,et al.  Long-Term Follow-up Results of the DANTE Trial, a Randomized Study of Lung Cancer Screening with Spiral Computed Tomography. , 2015, American journal of respiratory and critical care medicine.

[102]  S. Armato,et al.  Role of the Quantitative Imaging Biomarker Alliance in optimizing CT for the evaluation of lung cancer screen-detected nodules. , 2015, Journal of the American College of Radiology : JACR.

[103]  Jinzhong Yang,et al.  Measuring Computed Tomography Scanner Variability of Radiomics Features , 2015, Investigative radiology.

[104]  J. Alger,et al.  Between-Scanner and Between-Visit Variation in Normal White Matter Apparent Diffusion Coefficient Values in the Setting of a Multi-Center Clinical Trial , 2016, Clinical Neuroradiology.

[105]  Fei Yang,et al.  Quantitative radiomics: impact of stochastic effects on textural feature analysis implies the need for standards , 2015, Journal of medical imaging.

[106]  D. Auer,et al.  Multi-centre reproducibility of diffusion MRI parameters for clinical sequences in the brain , 2015, NMR in biomedicine.

[107]  H. Merisaari,et al.  Evaluation of different mathematical models for diffusion‐weighted imaging of normal prostate and prostate cancer using high b‐values: A repeatability study , 2015, Magnetic resonance in medicine.

[108]  H. Barnhart,et al.  The emerging science of quantitative imaging biomarkers terminology and definitions for scientific studies and regulatory submissions , 2015, Statistical methods in medical research.

[109]  Robert J. Nordstrom,et al.  The Quantitative Imaging Network in Precision Medicine , 2016, Tomography.

[110]  Stephen J Sawiak,et al.  MR fingerprinting with simultaneous B1 estimation , 2015, Magnetic resonance in medicine.

[111]  Steffen Löck,et al.  Image biomarker standardisation initiative , 2016 .

[112]  W. Block,et al.  Rapid multicomponent relaxometry in steady state with correction of magnetization transfer effects , 2016, Magnetic resonance in medicine.

[113]  Wei Huang,et al.  Demonstration of nonlinearity bias in the measurement of the apparent diffusion coefficient in multicenter trials , 2016, Magnetic resonance in medicine.

[114]  W. Tsai,et al.  Reproducibility of radiomics for deciphering tumor phenotype with imaging , 2016, Scientific Reports.

[115]  Yong Chen,et al.  MR Fingerprinting for Rapid Quantitative Abdominal Imaging. , 2016, Radiology.

[116]  Lubomir M. Hadjiiski,et al.  Radiomics of Lung Nodules: A Multi-Institutional Study of Robustness and Agreement of Quantitative Imaging Features , 2016, Tomography.

[117]  M. Harisinghani,et al.  A practical primer on PI-RADS version 2: a pictorial essay , 2016, Abdominal Radiology.

[118]  Nicholas Petrick,et al.  Statistical Issues in Testing Conformance with the Quantitative Imaging Biomarker Alliance (QIBA) Profile Claims. , 2016, Academic radiology.

[119]  M. Esposito,et al.  Quality assurance multicenter comparison of different MR scanners for quantitative diffusion‐weighted imaging , 2016, Journal of magnetic resonance imaging : JMRI.

[120]  Keith Wachowicz,et al.  Analytical corrections of banding artifacts in driven equilibrium single pulse observation of T2 (DESPOT2) , 2016, Magnetic resonance in medicine.

[121]  Kilian M. Pohl,et al.  Harmonizing DTI measurements across scanners to examine the development of white matter microstructure in 803 adolescents of the NCANDA study , 2016, NeuroImage.

[122]  P. Lundberg,et al.  Modeling the Presence of Myelin and Edema in the Brain Based on Multi-Parametric Quantitative MRI , 2016, Front. Neurol..

[123]  M. Miquel,et al.  Diffusion-weighted magnetic resonance imaging in cancer: Reported apparent diffusion coefficients, in-vitro and in-vivo reproducibility. , 2016, World journal of radiology.

[124]  N. Hylton,et al.  Design of a breast phantom for quantitative MRI , 2016, Journal of magnetic resonance imaging : JMRI.

[125]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[126]  D. Lynch,et al.  Pulmonary CT and MRI phenotypes that help explain chronic pulmonary obstruction disease pathophysiology and outcomes , 2016, Journal of magnetic resonance imaging : JMRI.

[127]  Paul Kinahan,et al.  Radiomics: Images Are More than Pictures, They Are Data , 2015, Radiology.

[128]  Y. Ohno,et al.  Comparative evaluation of newly developed model-based and commercially available hybrid-type iterative reconstruction methods and filter back projection method in terms of accuracy of computer-aided volumetry (CADv) for low-dose CT protocols in phantom study. , 2016, European journal of radiology.

[129]  A. MacKay,et al.  Measuring water content using T2 relaxation at 3T: Phantom validations and simulations. , 2016, Magnetic resonance imaging.

[130]  Ken E Sakaie,et al.  Quantitative quality assurance in a multicenter HARDI clinical trial at 3T. , 2017, Magnetic resonance imaging.

[131]  D. Lynch,et al.  Securing safe and informative thoracic CT examinations-Progress of radiation dose reduction techniques. , 2017, European journal of radiology.

[132]  O. Abe,et al.  SyMRI of the Brain , 2017, Investigative radiology.

[133]  P. Lakhani,et al.  Deep Learning at Chest Radiography: Automated Classification of Pulmonary Tuberculosis by Using Convolutional Neural Networks. , 2017, Radiology.

[134]  Lawrence L. Wald,et al.  3D MR fingerprinting with accelerated stack-of-spirals and hybrid sliding-window and GRAPPA reconstruction , 2017, NeuroImage.

[135]  O. Abe,et al.  Analysis of White Matter Damage in Patients with Multiple Sclerosis via a Novel In Vivo MR Method for Measuring Myelin, Axons, and G-Ratio , 2017, American Journal of Neuroradiology.

[136]  Ragini Verma,et al.  Harmonization of multi-site diffusion tensor imaging data , 2017, NeuroImage.

[137]  Teaching Neuroimages: Obscured Cerebral Infarction on MRI , 2017, Clinical Neuroradiology.

[138]  J. Duerk,et al.  MR fingerprinting using the quick echo splitting NMR imaging technique , 2017, Magnetic resonance in medicine.

[139]  M. Ladd,et al.  Temperature and concentration calibration of aqueous polyvinylpyrrolidone (PVP) solutions for isotropic diffusion MRI phantoms , 2017, PloS one.

[140]  D. Lynch,et al.  Standardizing CT lung density measure across scanner manufacturers , 2017, Medical physics.

[141]  Hanzhang Lu,et al.  Multiparametric estimation of brain hemodynamics with MR fingerprinting ASL , 2017, Magnetic resonance in medicine.

[142]  K. Kumamaru,et al.  Utility of a Multiparametric Quantitative MRI Model That Assesses Myelin and Edema for Evaluating Plaques, Periplaque White Matter, and Normal-Appearing White Matter in Patients with Multiple Sclerosis: A Feasibility Study , 2017, American Journal of Neuroradiology.

[143]  F. Fennessy,et al.  Multiparametric Magnetic Resonance Imaging of the Prostate , 2017, Investigative radiology.

[144]  Jesse I. Hamilton,et al.  MR fingerprinting for rapid quantification of myocardial T1, T2, and proton spin density , 2017, Magnetic resonance in medicine.

[145]  M. Griswold,et al.  Repeatability of magnetic resonance fingerprinting T1 and T2 estimates assessed using the ISMRM/NIST MRI system phantom , 2017, Magnetic resonance in medicine.

[146]  Thomas Frauenfelder,et al.  Deep Learning in Mammography: Diagnostic Accuracy of a Multipurpose Image Analysis Software in the Detection of Breast Cancer , 2017, Investigative radiology.

[147]  Mara Cercignani,et al.  Brain microstructure by multi-modal MRI: Is the whole greater than the sum of its parts? , 2017, NeuroImage.

[148]  J. E. van Timmeren,et al.  Influence of gray level discretization on radiomic feature stability for different CT scanners, tube currents and slice thicknesses: a comprehensive phantom study , 2017, Acta oncologica.

[149]  P. Lambin,et al.  Radial gradient and radial deviation radiomic features from pre-surgical CT scans are associated with survival among lung adenocarcinoma patients , 2017, Oncotarget.

[150]  Geoffrey G. Zhang,et al.  Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels , 2017, Medical physics.

[151]  Y. Ohno,et al.  Xenon-enhanced CT using subtraction CT: Basic and preliminary clinical studies for comparison of its efficacy with that of dual-energy CT and ventilation SPECT/CT to assess regional ventilation and pulmonary functional loss in smokers. , 2017, European journal of radiology.

[152]  P. Lambin,et al.  Radiomics: the bridge between medical imaging and personalized medicine , 2017, Nature Reviews Clinical Oncology.

[153]  S. Aoki,et al.  The Advantage of Synthetic MRI for the Visualization of Anterior Temporal Pole Lesions on Double Inversion Recovery (DIR), Phase-sensitive Inversion Recovery (PSIR), and Myelin Images in a Patient with CADASIL , 2017, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[154]  M. Kataoka,et al.  Impact of the Number of Iterations in Compressed Sensing Reconstruction on Ultrafast Dynamic Contrast-enhanced Breast MR Imaging , 2018, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[155]  So Mi Lee,et al.  Age-Related Changes in Tissue Value Properties in Children: Simultaneous Quantification of Relaxation Times and Proton Density Using Synthetic Magnetic Resonance Imaging , 2017, Investigative radiology.

[156]  Frank Thiele,et al.  Clinical Evaluation of a Multiparametric Deep Learning Model for Glioblastoma Segmentation Using Heterogeneous Magnetic Resonance Imaging Data From Clinical Routine , 2018, Investigative radiology.

[157]  Young Han Lee,et al.  Quantitative T2 Mapping of Knee Cartilage: Comparison between the Synthetic MR Imaging and the CPMG Sequence , 2018, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[158]  S. Aoki,et al.  Reduced visualization of cerebral infarction on diffusion-weighted images with short diffusion times , 2018, Neuroradiology.

[159]  S. Aoki,et al.  Spatial Restriction within Intracranial Epidermoid Cysts Observed Using Short Diffusion-time Diffusion-weighted Imaging , 2017, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[160]  S. Park,et al.  Methodologic Guide for Evaluating Clinical Performance and Effect of Artificial Intelligence Technology for Medical Diagnosis and Prediction. , 2018, Radiology.

[161]  Kunihiro Yagihashi,et al.  Quantitative CT Evaluation of Small Pulmonary Vessels in Patients with Acute Pulmonary Embolism. , 2018, Academic radiology.

[162]  R. Gillies,et al.  Repeatability and Reproducibility of Radiomic Features: A Systematic Review , 2018, International journal of radiation oncology, biology, physics.

[163]  J. Canales‐Vázquez,et al.  Radiomics of CT Features May Be Nonreproducible and Redundant: Influence of CT Acquisition Parameters. , 2018, Radiology.

[164]  J. E. van Timmeren,et al.  Tracking tumor biology with radiomics: A systematic review utilizing a radiomics quality score. , 2018, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[165]  Geoffrey G. Zhang,et al.  Voxel size and gray level normalization of CT radiomic features in lung cancer , 2018, Scientific Reports.

[166]  Jin Keun Seo,et al.  Deep learning for undersampled MRI reconstruction , 2017, Physics in medicine and biology.

[167]  C. Jack,et al.  Quantitative magnetic resonance imaging phantoms: A review and the need for a system phantom , 2018, Magnetic resonance in medicine.

[168]  M. McMahon,et al.  Rapid and quantitative chemical exchange saturation transfer (CEST) imaging with magnetic resonance fingerprinting (MRF) , 2017, Magnetic resonance in medicine.

[169]  Daniel K Sodickson,et al.  Exploring the sensitivity of magnetic resonance fingerprinting to motion. , 2018, Magnetic resonance imaging.

[170]  S. Aoki,et al.  Synthetic MRI of the knee: new perspectives in musculoskeletal imaging and possible applications for the assessment of bone marrow disorders. , 2018, The British journal of radiology.

[171]  W. Stiller Basics of iterative reconstruction methods in computed tomography: A vendor-independent overview. , 2018, European journal of radiology.

[172]  Travis B. Smith,et al.  Multi‐parametric T2* magnetic resonance fingerprinting using variable echo times , 2018, NMR in biomedicine.

[173]  T. Yankeelov,et al.  Repeatability, reproducibility, and accuracy of quantitative mri of the breast in the community radiology setting , 2018, Journal of magnetic resonance imaging : JMRI.

[174]  T. Helbich,et al.  Diffusion-Weighted Imaging With Apparent Diffusion Coefficient Mapping for Breast Cancer Detection as a Stand-Alone Parameter: Comparison With Dynamic Contrast-Enhanced and Multiparametric Magnetic Resonance Imaging , 2018, Investigative radiology.

[175]  A. Manoliu,et al.  Image Quality and Geometric Distortion of Modern Diffusion-Weighted Imaging Sequences in Magnetic Resonance Imaging of the Prostate , 2017, Investigative radiology.

[176]  Russell T. Shinohara,et al.  Harmonization of cortical thickness measurements across scanners and sites , 2017, NeuroImage.

[177]  L. Schad,et al.  A novel 3D printed mechanical actuator using centrifugal force for magnetic resonance elastography: Initial results in an anthropomorphic prostate phantom , 2018, PloS one.

[178]  S. Punwani,et al.  Fat fraction mapping using magnetic resonance imaging: insight into pathophysiology. , 2017, The British journal of radiology.

[179]  S. Aoki,et al.  Automated brain tissue and myelin volumetry based on quantitative MR imaging with various in-plane resolutions. , 2017, Journal of neuroradiology. Journal de neuroradiologie.

[180]  S. Aoki,et al.  Application of Quantitative Microstructural MR Imaging with Atlas-based Analysis for the Spinal Cord in Cervical Spondylotic Myelopathy , 2018, Scientific Reports.

[181]  Els Fieremans,et al.  Physical and numerical phantoms for the validation of brain microstructural MRI: A cookbook , 2018, NeuroImage.

[182]  Anthony E Samir,et al.  Essentials of Statistical Methods for Assessing Reliability and Agreement in Quantitative Imaging. , 2017, Academic radiology.

[183]  O. Abe,et al.  Changes in the ADC of diffusion-weighted MRI with the oscillating gradient spin-echo (OGSE) sequence due to differences in substrate viscosities , 2018, Japanese Journal of Radiology.

[184]  Tobias Kober,et al.  Magnetization transfer in magnetic resonance fingerprinting , 2019, Magnetic resonance in medicine.

[185]  S. Aoki,et al.  Gray Matter Alterations in Early and Late Relapsing-Remitting Multiple Sclerosis Evaluated with Synthetic Quantitative Magnetic Resonance Imaging , 2019, Scientific Reports.

[186]  A Vamvakas,et al.  Imaging biomarker analysis of advanced multiparametric MRI for glioma grading. , 2019, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[187]  M. Nittka,et al.  Comprehensive Evaluation of B1+-corrected FISP-based Magnetic Resonance Fingerprinting: Accuracy, Repeatability and Reproducibility of T1 and T2 Relaxation Times for ISMRM/NIST System Phantom and Volunteers , 2019, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[188]  Saori C. Tanaka,et al.  Harmonization of resting-state functional MRI data across multiple imaging sites via the separation of site differences into sampling bias and measurement bias , 2018, bioRxiv.

[189]  B. Baessler,et al.  Robustness and Reproducibility of Radiomics in Magnetic Resonance Imaging: A Phantom Study , 2019, Investigative radiology.

[190]  T. Kubo Vendor free basics of radiation dose reduction techniques for CT. , 2019, European journal of radiology.

[191]  J Wrobel,et al.  Intensity warping for multisite MRI harmonization , 2019, NeuroImage.

[192]  Evgeny Burnaev,et al.  Bayesian Generative Models for Knowledge Transfer in MRI Semantic Segmentation Problems , 2019, Front. Neurosci..

[193]  Y. Ohno,et al.  Effects of acquisition method and reconstruction algorithm for CT number measurement on standard-dose CT and reduced-dose CT: a QIBA phantom study , 2019, Japanese Journal of Radiology.

[194]  Kourosh Jafari-Khouzani,et al.  Effect of Region of Interest Size on the Repeatability of Quantitative Brain Imaging Biomarkers , 2019, IEEE Transactions on Biomedical Engineering.

[195]  Yuta Kobayashi,et al.  Diffusion-weighting Caused by Spoiler Gradients in the Fast Imaging with Steady-state Precession Sequence May Lead to Inaccurate T2 Measurements in MR Fingerprinting , 2018, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[196]  Yun Jiang,et al.  Magnetic resonance fingerprinting: a technical review , 2018, Magnetic resonance in medicine.

[197]  N. Hattori,et al.  Improving the Quality of Synthetic FLAIR Images with Deep Learning Using a Conditional Generative Adversarial Network for Pixel-by-Pixel Image Translation , 2019, American Journal of Neuroradiology.

[198]  Pew-Thian Yap,et al.  Multi-Site Harmonization of Diffusion MRI Data via Method of Moments , 2019, IEEE Transactions on Medical Imaging.

[199]  O. Abe,et al.  Choroid plexus cysts analyzed using diffusion-weighted imaging with short diffusion-time. , 2019, Magnetic resonance imaging.

[200]  Aaron Carass,et al.  DeepHarmony: A deep learning approach to contrast harmonization across scanner changes. , 2019, Magnetic resonance imaging.

[201]  Andreas Maier,et al.  Magnetic Resonance Fingerprinting Reconstruction Using Recurrent Neural Networks , 2019, GMDS.

[202]  P. Lambin,et al.  Stability of radiomics features in apparent diffusion coefficient maps from a multi-centre test-retest trial , 2019, Scientific Reports.

[203]  M. Nittka,et al.  Reproducibility and Repeatability of MR Fingerprinting Relaxometry in the Human Brain. , 2019, Radiology.

[204]  M. Kitajima,et al.  Deep Learning Based Noise Reduction for Brain MR Imaging: Tests on Phantoms and Healthy Volunteers , 2019, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[205]  Holden H. Wu,et al.  Recommendations towards standards for quantitative MRI (qMRI) and outstanding needs , 2019, Journal of magnetic resonance imaging : JMRI.

[206]  T. Helbich,et al.  Impact of Machine Learning With Multiparametric Magnetic Resonance Imaging of the Breast for Early Prediction of Response to Neoadjuvant Chemotherapy and Survival Outcomes in Breast Cancer Patients , 2019, Investigative radiology.

[207]  M. Schluchter,et al.  Targeted Biopsy Validation of Peripheral Zone Prostate Cancer Characterization With Magnetic Resonance Fingerprinting and Diffusion Mapping. , 2019, Investigative radiology.

[208]  K. Kumamaru,et al.  Diagnostic accuracy of 3D deep-learning-based fully automated estimation of patient-level minimum fractional flow reserve from coronary computed tomography angiography. , 2019, European heart journal cardiovascular Imaging.

[209]  S. Aoki,et al.  Convolutional neural network-based segmentation can help in assessing the substantia nigra in neuromelanin MRI , 2019, Neuroradiology.

[210]  L. Esserman,et al.  Test–retest repeatability and reproducibility of ADC measures by breast DWI: Results from the ACRIN 6698 trial , 2018, Journal of magnetic resonance imaging : JMRI.

[211]  Po-Hsuan Cameron Chen,et al.  How to Read Articles That Use Machine Learning: Users' Guides to the Medical Literature. , 2019, JAMA.

[212]  Andrew Dienstfrey,et al.  Assessing effects of scanner upgrades for clinical studies , 2019, Journal of magnetic resonance imaging : JMRI.

[213]  S. Aoki,et al.  Brain tissue and myelin volumetric analysis in multiple sclerosis at 3T MRI with various in-plane resolutions using synthetic MRI , 2019, Neuroradiology.

[214]  J. Gillard,et al.  A Comparison of Black-blood T2 Mapping Sequences for Carotid Vessel Wall Imaging at 3T: An Assessment of Accuracy and Repeatability , 2018, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[215]  M. Knopp,et al.  NCTN Assessment on Current Applications of Radiomics in Oncology. , 2019, International journal of radiation oncology, biology, physics.

[216]  Y. Ohno,et al.  Radiation dose reduction techniques for chest CT: Principles and clinical results. , 2019, European journal of radiology.

[217]  K. Kapur,et al.  Reproducibility of Structural and Diffusion Tensor Imaging in the TACERN Multi-Center Study , 2019, Front. Integr. Neurosci..

[218]  H. Sugano,et al.  Aberrant myelination in patients with Sturge-Weber syndrome analyzed using synthetic quantitative magnetic resonance imaging , 2019, Neuroradiology.

[219]  O. Abe,et al.  Linearity, Bias, Intrascanner Repeatability, and Interscanner Reproducibility of Quantitative Multidynamic Multiecho Sequence for Rapid Simultaneous Relaxometry at 3 T: A Validation Study With a Standardized Phantom and Healthy Controls , 2019, Investigative radiology.

[220]  S. Aoki,et al.  3D quantitative synthetic MRI‐derived cortical thickness and subcortical brain volumes: Scan–rescan repeatability and comparison with conventional T1‐weighted images , 2019, Journal of magnetic resonance imaging : JMRI.

[221]  Yogesh Rathi,et al.  Retrospective harmonization of multi-site diffusion MRI data acquired with different acquisition parameters , 2019, NeuroImage.

[222]  Josef Pfeuffer,et al.  Effect of spiral undersampling patterns on FISP MRF parameter maps. , 2019, Magnetic resonance imaging.

[223]  A. Lutti,et al.  Establishing intra‐ and inter‐vendor reproducibility of T1 relaxation time measurements with 3T MRI , 2018, Magnetic resonance in medicine.

[224]  O. Abe,et al.  Three-dimensional high-resolution simultaneous quantitative mapping of the whole brain with 3D-QALAS: An accuracy and repeatability study. , 2019, Magnetic resonance imaging.

[225]  Petro M. Kostandy,et al.  Automated Abdominal Segmentation of CT Scans for Body Composition Analysis Using Deep Learning. , 2019, Radiology.

[226]  O. Abe,et al.  White Matter Abnormalities in Multiple Sclerosis Evaluated by Quantitative Synthetic MRI, Diffusion Tensor Imaging, and Neurite Orientation Dispersion and Density Imaging , 2019, American Journal of Neuroradiology.

[227]  Bram Stieltjes,et al.  A Practical Guide to Artificial Intelligence-Based Image Analysis in Radiology. , 2020, Investigative radiology.

[228]  O. Abe,et al.  Deep Learning Approach for Generating MRA Images From 3D Quantitative Synthetic MRI Without Additional Scans. , 2020, Investigative radiology.

[229]  A. Simmons,et al.  The reliability of a deep learning model in clinical out-of-distribution MRI data: a multicohort study , 2019, Medical Image Anal..