NIRViz: 3D Visualization Software for Multimodality Optical Imaging Using Visualization Toolkit (VTK) and Insight Segmentation Toolkit (ITK)

Optical imaging using near-infrared light is used for noninvasive probing of tissues to recover vascular and molecular status of healthy and diseased tissues using hemoglobin contrast arising due to absorption of light. While multimodality optical techniques exist, visualization techniques in this area are limited. Addressing this issue, we present a simple framework for image overlay of optical and magnetic resonance (MRI) or computerized tomographic images which is intuitive and easily usable, called NIRViz. NIRViz is a multimodality software platform for the display and navigation of Digital Imaging and Communications in Medicine (DICOM) MRI datasets and 3D optical image solutions geared toward visualization and coregistration of optical contrast in diseased tissues such as cancer. We present the design decisions undertaken during the design of the software, the libraries used in the implementation, and other implementation details as well as preliminary results from the software package. Our implementation uses the Visualization Toolkit library to do most of the work, with a Qt graphical user interface for the front end. Challenges encountered include reslicing DICOM image data and coregistration of image space and mesh space. The resulting software provides a simple and customized platform to display surface and volume meshes with optical parameters such as hemoglobin concentration, overlay them on magnetic resonance images, allow the user to interactively change transparency of different image sets, rotate geometries, clip through the resulting datasets, obtain mesh and optical solution information, and successfully interact with both functional and structural medical image information.

[1]  William J. Schroeder,et al.  The Visualization Toolkit , 2005, The Visualization Handbook.

[2]  Simon R. Arridge,et al.  Elsevier Editorial System(tm) for NeuroImage Manuscript Draft Manuscript Number: Title: THREE DIMENSIONAL OPTICAL IMAGING OF BLOOD VOLUME AND OXYGENATION IN THE NEONATAL BRAIN , 2005 .

[3]  B. Tromberg,et al.  Predicting response to breast cancer neoadjuvant chemotherapy using diffuse optical spectroscopy , 2007, Proceedings of the National Academy of Sciences.

[4]  B. Pogue,et al.  A boundary element approach for image-guided near-infrared absorption and scatter estimation. , 2007, Medical physics.

[5]  B. Pogue,et al.  Evaluation of breast tumor response to neoadjuvant chemotherapy with tomographic diffuse optical spectroscopy: case studies of tumor region-of-interest changes. , 2009, Radiology.

[6]  B. Tromberg,et al.  Diffuse optical monitoring of blood flow and oxygenation in human breast cancer during early stages of neoadjuvant chemotherapy. , 2007, Journal of biomedical optics.

[7]  V. Ntziachristos,et al.  Three-dimensional diffuse optical tomography in the parallel plane transmission geometry: evaluation of a hybrid frequency domain/continuous wave clinical system for breast imaging. , 2003, Medical physics.

[8]  D. Boas,et al.  Diffuse optical tomography system to image brain activation with improved spatial resolution and validation with functional magnetic resonance imaging. , 2006, Applied optics.

[9]  Luis Ibáñez,et al.  The ITK Software Guide , 2005 .

[10]  B. Pogue,et al.  Image-guided optical spectroscopy provides molecular-specific information in vivo: MRI-guided spectroscopy of breast cancer hemoglobin, water, and scatterer size. , 2007, Optics letters.

[11]  M. Eppstein,et al.  Three-dimensional Bayesian optical image reconstruction with domain decomposition , 2001, IEEE Transactions on Medical Imaging.

[12]  Hamid Dehghani,et al.  Numerical modelling and image reconstruction in diffuse optical tomography , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[13]  E. Conant,et al.  Breast Cancer Detection Based on Incremental Biochemical and Physiological Properties of Breast Cancers , 2005 .

[14]  B. Pogue,et al.  Three-dimensional optical tomography: resolution in small-object imaging. , 2003, Applied optics.

[15]  S. Achilefu,et al.  In vivo fluorescence lifetime tomography. , 2009, Journal of biomedical optics.

[16]  Subhadra Srinivasan,et al.  Methodology development for three-dimensional MR-guided near infrared spectroscopy of breast tumors. , 2008, Optics express.

[17]  Frank Sauer,et al.  Standardized platform for coregistration of nonconcurrent diffuse optical and magnetic resonance breast images obtained in different geometries. , 2007, Journal of biomedical optics.

[18]  Jennifer J. Gibson,et al.  Electromagnetic breast imaging: results of a pilot study in women with abnormal mammograms. , 2007, Radiology.

[19]  B. Tromberg,et al.  In vivo absorption, scattering, and physiologic properties of 58 malignant breast tumors determined by broadband diffuse optical spectroscopy. , 2006, Journal of biomedical optics.

[20]  B. Pogue,et al.  Imaging breast adipose and fibroglandular tissue molecular signatures by using hybrid MRI-guided near-infrared spectral tomography. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[21]  S. Arridge,et al.  INSTITUTE OF PHYSICS PUBLISHING PHYSICS IN MEDICINE AND BIOLOGY , 2003 .

[22]  Ron Kikinis,et al.  3D Slicer , 2012, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[23]  Eric L. Miller,et al.  Hybrid FMT–CT imaging of amyloid-β plaques in a murine Alzheimer's disease model , 2009, NeuroImage.