Augmented Reality and Virtual Reality: Initial Successes in Diagnostic Radiology

In this chapter, we will review the applications of augmented reality (AR) and virtual reality (VR) in diagnostic radiology. We begin the chapter by discussing state of the art medical imaging techniques to include scanner hardware, spatial resolution, and presentation methods to the radiologist or other medical professionals. We continue by discussing the methodology of a technique called Depth-3-Dimensional (D3D) imaging, which transforms cross-sectional medical imaging datasets into a left and right eye images that that can be viewed with state of the art AR or VR headsets. We include results of the D3D processed AR/VR imaging and conclude with a discussion of the path forward.

[1]  David B. Douglas,et al.  Augmented Reality: Advances in Diagnostic Imaging , 2017, Multimodal Technol. Interact..

[2]  E. Fishman,et al.  Three-dimensional volume rendering of spiral CT data: theory and method. , 1999, Radiographics : a review publication of the Radiological Society of North America, Inc.

[3]  John M Boone,et al.  Breast CT: potential for breast cancer screening and diagnosis. , 2006, Future oncology.

[4]  B S Kuszyk,et al.  CT angiography with volume rendering: advantages and applications in splanchnic vascular imaging. , 1996, Radiology.

[5]  John M Boone,et al.  Computed tomography use in a tertiary care university hospital. , 2008, Journal of the American College of Radiology : JACR.

[6]  C. White,et al.  Missed lung cancer on chest radiography and computed tomography: imaging and medicolegal issues. , 1999, Journal of thoracic imaging.

[7]  越智 誉司 Curved Planar reformatted CT Angiography : Usefulness for the Evaluation of Aneurysms at the Carotid Siphon , 2000 .

[8]  E. Fishman,et al.  Volume rendering versus maximum intensity projection in CT angiography: what works best, when, and why. , 2006, Radiographics : a review publication of the Radiological Society of North America, Inc.

[9]  Roland Bammer,et al.  Diffusion Tensor Imaging of TBI: Potentials and Challenges , 2015, Topics in magnetic resonance imaging : TMRI.

[10]  A. Jemal,et al.  Breast cancer statistics, 2013 , 2014, CA: a cancer journal for clinicians.

[11]  P. Douglas,et al.  Perfusion Imaging in Acute Traumatic Brain Injury. , 2018, Neuroimaging clinics of North America.

[12]  Jonathan H Sunshine,et al.  Body MR imaging and CT volume: variations and trends based on an analysis of medicare and fee-for-service health insurance databases. , 2002, AJR. American journal of roentgenology.

[13]  P. Ferroli,et al.  Advanced 3-dimensional planning in neurosurgery. , 2013, Neurosurgery.

[14]  Ulf Tiede,et al.  Display Of Multiple 3D-Objects Using The Generalized Voxel-Model , 1988, Medical Imaging.

[15]  Max Wintermark,et al.  Correlation between arterial spin labeling MRI and dynamic FDG on PET-MR in Alzheimer’s disease and non-Alzhiemer’s disease patients , 2015, EJNMMI Physics.

[16]  Lonie R. Salkowski,et al.  Use of microcalcification descriptors in BI-RADS 4th edition to stratify risk of malignancy. , 2007, Radiology.

[17]  J. Gurney,et al.  Missed lung cancer at CT: imaging findings in nine patients. , 1996, Radiology.

[18]  E. Kim,et al.  Correlation between mammographic manifestations and averaged histopathologic nuclear grade using prognosis-predict scoring system for the prognosis of ductal carcinoma in situ. , 1999, Clinical imaging.

[19]  Jean M. Mitchell,et al.  Controlling the Escalating Use of Advanced Imaging , 2009, Medical care research and review : MCRR.

[20]  C A Kelsey,et al.  CT scanning: patterns of use and dose , 2000, Journal of radiological protection : official journal of the Society for Radiological Protection.

[21]  Nola Hylton,et al.  Clinically Meaningful Tumor Reduction Rates Vary by Prechemotherapy MRI Phenotype and Tumor Subtype in the I-SPY 1 TRIAL (CALGB 150007/150012; ACRIN 6657) , 2013, Annals of Surgical Oncology.

[22]  David B Douglas,et al.  Augmented Reality Imaging System: 3D Viewing of a Breast Cancer. , 2016, Journal of nature and science.

[23]  C. Mathers,et al.  Estimates of worldwide burden of cancer in 2008: GLOBOCAN 2008 , 2010, International journal of cancer.

[24]  David B Douglas,et al.  D3D augmented reality imaging system: proof of concept in mammography , 2016, Medical devices.

[25]  Eduardo E. Lovo,et al.  A NOVEL, INEXPENSIVE METHOD OF IMAGE COREGISTRATION FOR APPLICATIONS IN IMAGE‐GUIDED SURGERY USING AUGMENTED REALITY , 2007, Neurosurgery.

[26]  S. Bouchard,et al.  Moving from Virtual Reality Exposure-Based Therapy to Augmented Reality Exposure-Based Therapy: A Review , 2014, Front. Hum. Neurosci..

[27]  David B. Douglas,et al.  Virtual reality and augmented reality: Advances in surgery , 2017 .