Fast calculation of digitally reconstructed radiographs using light fields

Calculating digitally reconstructed radiographs (DRRs)is an important step in intensity-based fluoroscopy-to-CT image registration methods. Unfortunately, the standard techniques to generate DRRs involve ray casting and run in time O(n3),where we assume that n is approximately the size (in voxels) of one side of the DRR as well as one side of the CT volume. Because of this, generation of DRRs is typically the rate-limiting step in the execution time of intensity-based fluoroscopy-to-CT registration algorithms. We address this issue by extending light field rendering techniques from the computer graphics community to generate DRRs instead of conventional rendered images. Using light fields allows most of the computation to be performed in a preprocessing step;after this precomputation step, very accurate DRRs can be generated in time O(n2). Using a light field generated from 1,024 DRRs of resolution 256×256, we can create new DRRs that appear visually identical to ones generated by conventional ray casting. Importantly, the DRRs generated using the light field are computed over 300 times faster than DRRs generated using conventional ray casting(50 vs.17,000 ms on a PC with a 2 GHz Intel Pentium 4 processor).

[1]  Lee Westover,et al.  Footprint evaluation for volume rendering , 1990, SIGGRAPH.

[2]  Pat Hanrahan,et al.  Hierarchical splatting: a progressive refinement algorithm for volume rendering , 1991, SIGGRAPH.

[3]  Max A. Viergever,et al.  Acceleration of ray-casting using 3-D distance transforms , 1992, Other Conferences.

[4]  Marc Levoy,et al.  Frequency domain volume rendering , 1993, SIGGRAPH.

[5]  J Bijhold,et al.  Three-dimensional verification of patient placement during radiotherapy using portal images. , 1993, Medical physics.

[6]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[7]  M. Levoy,et al.  Fast volume rendering using a shear-warp factorization of the viewing transformation , 1994, SIGGRAPH.

[8]  D. R. Fish,et al.  A patient-to-computed-tomography image registration method based on digitally reconstructed radiographs. , 1994, Medical physics.

[9]  T. Boult,et al.  Registration of planar film radiographs with computed tomography , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[10]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[11]  M van Herk,et al.  Automatic three-dimensional inspection of patient setup in radiation therapy using portal images, simulator images, and computed tomography data. , 1996, Medical physics.

[12]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[13]  Jürgen Weese,et al.  Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery , 1997, IEEE Transactions on Information Technology in Biomedicine.

[14]  M. Murphy.  An automatic six-degree-of-freedom image registration algorithm for image-guided frameless stereotaxic radiosurgery. , 1997, Medical physics.

[15]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[16]  J. Alison Noble,et al.  Real-Time Registration of 3D Cerebral Vessels to X-ray Angiograms , 1998, MICCAI.

[17]  Peter Kazanzides,et al.  Anatomy-based registration of CT-scan and intraoperative X-ray images for guiding a surgical robot , 1998, IEEE Transactions on Medical Imaging.

[18]  Jürgen Weese,et al.  A comparison of similarity measures for use in 2-D-3-D medical image registration , 1998, IEEE Transactions on Medical Imaging.

[19]  Marcel Breeuwer,et al.  The EASI project-improving the effectiveness and quality of image-guided surgery , 1998, IEEE Transactions on Information Technology in Biomedicine.

[20]  William E. Lorensen,et al.  The visualization toolkit (2nd ed.): an object-oriented approach to 3D graphics , 1998 .

[21]  Liang-Gee Chen,et al.  A novel image compression algorithm by using Log-Exp transform , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[22]  Marie-Odile Berger,et al.  Fully Automatic 3D/2D Subtracted Angiography Registration , 1999, MICCAI.

[23]  Arie E. Kaufman,et al.  Fast Ray-Tracing of Rectilinear Volume Data Using Distance Transforms , 2000, IEEE Trans. Vis. Comput. Graph..

[24]  D L Hill,et al.  Validation of a two- to three-dimensional registration algorithm for aligning preoperative CT images and intraoperative fluoroscopy images. , 2001, Medical physics.

[25]  Kensaku Mori,et al.  Fast volume rendering based on software optimisation using multimedia instructions on PC platforms , 2002 .