GPU Accelerated Generation of Digitally Reconstructed Radiographs for 2-D/3-D Image Registration

Recent advances in programming languages for graphics processing units (GPUs) provide developers with a convenient way of implementing applications which can be executed on the CPU and GPU interchangeably. GPUs are becoming relatively cheap, powerful, and widely available hardware components, which can be used to perform intensive calculations. The last decade of hardware performance developments shows that GPU-based computation is progressing significantly faster than CPU-based computation, particularly if one considers the execution of highly parallelisable algorithms. Future predictions illustrate that this trend is likely to continue. In this paper, we introduce a way of accelerating 2-D/3-D image registration by developing a hybrid system which executes on the CPU and utilizes the GPU for parallelizing the generation of digitally reconstructed radiographs (DRRs). Based on the advancements of the GPU over the CPU, it is timely to exploit the benefits of many-core GPU technology by developing algorithms for DRR generation. Although some previous work has investigated the rendering of DRRs using the GPU, this paper investigates approximations which reduce the computational overhead while still maintaining a quality consistent with that needed for 2-D/3-D registration with sufficient accuracy to be clinically acceptable in certain applications of radiation oncology. Furthermore, by comparing implementations of 2-D/3-D registration on the CPU and GPU, we investigate current performance and propose an optimal framework for PC implementations addressing the rigid registration problem. Using this framework, we are able to render DRR images from a $256\times 256\times 133$ CT volume in ${\sim}24$ ms using an NVidia GeForce 8800 GTX and in ${\sim}2$ ms using NVidia GeForce GTX 580. In addition to applications requiring fast automatic patient setup, these levels of performance suggest image-guided radiation therapy at video frame rates is technically feasible using relatively low cost PC architecture.

[1]  Thomas Martin Deserno,et al.  Survey: interpolation methods in medical image processing , 1999, IEEE Transactions on Medical Imaging.

[2]  Limin Luo,et al.  Point-based digitally reconstructed radiograph , 2008, 2008 19th International Conference on Pattern Recognition.

[3]  Timo Ropinski,et al.  An Advanced Volume Raycasting Technique using GPU Stream Processing , 2010, GRAPP.

[4]  Fumihiko Ino,et al.  A GPGPU Approach for Accelerating 2-D/3-D Rigid Registration of Medical Images , 2006, ISPA.

[5]  Paul Suetens,et al.  GPU-accelerated digitally reconstructed radiographs , 2008 .

[6]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[7]  Sylvain Lefebvre,et al.  Texture sprites: texture elements splatted on surfaces , 2005, I3D '05.

[8]  Liang-Gee Chen,et al.  A novel image compression algorithm by using Log-Exp transform , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[9]  Frank Sauer,et al.  Automatic registration of portal images and volumetric CT for patient positioning in radiation therapy , 2006, Medical Image Anal..

[10]  Thomas Malzbender,et al.  Fourier volume rendering , 1993, TOGS.

[11]  Paul Suetens,et al.  DIGITALLY RECONSTRUCTED RADIOGRAPHS USING THE GRAPHICS HARDWARE , 2007 .

[12]  Wolfgang Birkfellner,et al.  Fast DRR splat rendering using common consumer graphics hardware. , 2007, Medical physics.

[13]  Daniel Weiskopf,et al.  A Spectral Analysis of Function Composition and its Implications for Sampling in Direct Volume Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[14]  J M Wilkinson,et al.  Geometric uncertainties in radiotherapy. , 2004, The British journal of radiology.

[15]  Bernhard Kainz,et al.  Automatic Differentiation for GPU-Accelerated 2D/3D Registration , 2008 .

[16]  Christopher Bethune,et al.  Accelerated computation of digitally reconstructed radiographs , 2005 .

[17]  Nelson L. Max,et al.  Hardware-accelerated simulated radiography , 2005, VIS 05. IEEE Visualization, 2005..

[18]  Mark Fisher,et al.  Performance of 2D/3D medical image registration using compressed volumetric data , 2008 .

[19]  Takeo Kanade,et al.  Iterative x-ray/ct registration using accelerated volume rendering , 2001 .

[20]  Hubert Nguyen,et al.  GPU Gems 3 , 2007 .

[21]  Peter Shirley,et al.  An efficient and robust ray-box intersection algorithm , 2005, J. Graph. Tools.

[22]  R L Siddon,et al.  Calculation of the radiological depth. , 1985, Medical physics.

[23]  M. Oldham,et al.  Digital tomosynthesis with an on-board kilovoltage imaging device. , 2006, International journal of radiation oncology, biology, physics.

[24]  Hui Yan,et al.  Accelerating reconstruction of reference digital tomosynthesis using graphics hardware. , 2007, Medical physics.

[25]  Pheng-Ann Heng,et al.  Accelerating Algebraic Reconstruction Using CUDA-Enabled GPU , 2009, 2009 Sixth International Conference on Computer Graphics, Imaging and Visualization.

[26]  Daniel Rueckert,et al.  Fast generation of digitally reconstructed radiographs using attenuation fields with application to 2D-3D image registration , 2005, IEEE Transactions on Medical Imaging.

[27]  M. Fisher,et al.  Performance of a 2 D-3 D Image Registration System using ( Lossy ) Compressed X-ray CT , 2009 .

[28]  S Giannouli,et al.  CT imaging based digitally reconstructed radiographs and their application in brachytherapy , 2000, Physics in medicine and biology.

[29]  Avinash C. Kak,et al.  Principles of computerized tomographic imaging , 2001, Classics in applied mathematics.

[30]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[31]  Martin J. Murphy,et al.  Reconstruction of a cone-beam CT image via forward iterative projection matching , 2010 .

[32]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[33]  Alen Docef,et al.  Reconstruction of a cone-beam CT image via forward iterative projection matching. , 2010, Medical physics.

[34]  Jakob Spork,et al.  High-performance GPU based Rendering for Real-Time, rigid 2D/3D-Image Registration in Radiation Oncology , 2011 .

[35]  Wolfgang Birkfellner,et al.  Wobbled splatting—a fast perspective volume rendering method for simulation of x-ray images from CT , 2005, Physics in medicine and biology.

[36]  Shinichi Minohara,et al.  Development of a GPU-based multithreaded software application to calculate digitally reconstructed radiographs for radiotherapy , 2009, Radiological physics and technology.

[37]  Jie Cheng,et al.  Programming Massively Parallel Processors. A Hands-on Approach , 2010, Scalable Comput. Pract. Exp..

[38]  Catharine H Clark,et al.  The use of electronic portal imaging to verify patient position during intensity-modulated radiotherapy delivered by the dynamic MLC technique. , 2002, International journal of radiation oncology, biology, physics.

[39]  John Amanatides,et al.  A Fast Voxel Traversal Algorithm for Ray Tracing , 1987, Eurographics.

[40]  Martin Kraus,et al.  Pre-Integrated Volume Rendering , 2005, The Visualization Handbook.