Improved interventional X-ray appearance

Depth cues are an essential part of navigation and device positioning tasks during clinical interventions. Yet, many minimally-invasive procedures, such as catheterizations, are usually performed under X-ray guidance only depicting a 2D projection of the anatomy, which lacks depth information. Previous attempts to integrate pre-operative 3D data of the patient by registering these to intra-operative data have led to virtual 3D renderings independent of the original X-ray appearance and planar 2D color overlays (e.g. roadmaps). A major drawback associated to these solutions is the trade-off between X-ray attenuation values that is completely neglected during 3D renderings, and depth perception not being incorporated into the 2D roadmaps. This paper presents a novel technique for enhancing depth perception of interventional X-ray images preserving the original attenuation appearance. Starting from patient-specific pre-operative 3D data, our method relies on GPU ray casting to compute a colored depth map, which assigns a predefined color to the first incidence of gradient magnitude value above a predefined threshold along the ray. The colored depth map values are carefully integrated into the X-Ray image while maintaining its original grey-scale intensities. The presented method was tested and analysed for three relevant clinical scenarios covering different anatomical aspects and targeting different levels of interventional expertise. Results demonstrate that improving depth perception of X-ray images has the potential to lead to safer and more efficient clinical interventions.

[1]  Pere-Pau Vázquez,et al.  Depth-Enhanced Maximum Intensity Projection , 2010, VG@Eurographics.

[2]  M. Sarifuddin A New Perceptually Uniform Color Space with Associated Color Similarity Measure for Content-Based Image and Video Retrieval , 2005 .

[3]  D. Louis Collins,et al.  An Evaluation of Depth Enhancing Perceptual Cues for Vascular Volume Visualization in Neurosurgery , 2014, IEEE Transactions on Visualization and Computer Graphics.

[4]  Kenneth Moreland,et al.  Diverging Color Maps for Scientific Visualization , 2009, ISVC.

[5]  Kurt Hornik,et al.  Escaping RGBland: Selecting colors for statistical graphics , 2009, Comput. Stat. Data Anal..

[6]  Zhiguang Zhou,et al.  Shape-enhanced maximum intensity projection , 2011, The Visual Computer.

[7]  Penny Rheingans Task-based color scale design , 2000, Applied Imaging Pattern Recognition.

[8]  R Kikinis,et al.  Local maximum intensity projection (LMIP): a new rendering method for vascular visualization. , 1998, Journal of computer assisted tomography.

[9]  Bernice E. Rogowitz,et al.  Building perceptual color maps for visualizing interval data , 2000, Electronic Imaging.

[10]  Nassir Navab,et al.  Interventional 2D-3D Registration in the Presence of Occlusion , 2014 .

[11]  David Borland,et al.  Rainbow Color Map (Still) Considered Harmful , 2007 .

[12]  Lejing Wang,et al.  The Colored X-Rays , 2012, AE-CAI.

[13]  Nikolaus F. Troje,et al.  Enhancing Depth Perception in Translucent Volumes , 2006, IEEE Transactions on Visualization and Computer Graphics.

[14]  Nassir Navab,et al.  Depth Perception - A Major Issue in Medical AR: Evaluation Study by Twenty Surgeons , 2006, MICCAI.

[15]  Lindsay W. MacDonald,et al.  Tutorial: Using Color Effectively in Computer Graphics , 1999, IEEE Computer Graphics and Applications.

[16]  Stefanie Demirci,et al.  Advanced 2D-3D registration for endovascular aortic interventions: addressing dissimilarity in images , 2008, SPIE Medical Imaging.

[17]  Stefan Bruckner,et al.  Enhancing Depth-Perception with Flexible Volumetric Halos , 2007, IEEE Transactions on Visualization and Computer Graphics.

[18]  Stefan Bruckner,et al.  Instant Volume Visualization using Maximum Intensity Difference Accumulation , 2009, Comput. Graph. Forum.

[19]  Maximilian Baust,et al.  Disocclusion-based 2D-3D registration for aortic interventions , 2013, Comput. Biol. Medicine.

[20]  Lejing Wang,et al.  Interactive 3D Visualization of a Single-View X-Ray Image , 2011, MICCAI.

[21]  Michael J. Bailey,et al.  Using ChromaDepth to Obtain Inexpensive Single-image Stereovision for Scientific Visualization , 1998, J. Graphics, GPU, & Game Tools.

[22]  Oliver Deussen,et al.  Image enhancement by unsharp masking the depth buffer , 2006, SIGGRAPH 2006.

[23]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[24]  Samuel S. Silva,et al.  Using color in visualization: A survey , 2011, Comput. Graph..

[25]  Timo Ropinski,et al.  Visually Supporting Depth Perception in Angiography Imaging , 2006, Smart Graphics.

[26]  Ganesh S. Oak Information Visualization Introduction , 2022 .