Medical applications of multi-field volume rendering and VR techniques

This paper reports on a new approach for visualizing multi-field MRI or CT datasets in an immersive environment with medical applications. Multi-field datasets combine multiple scanning modalities into a single 3D, multivalued, dataset. In our approach, they are classified and rendered using real-time hardware accelerated volume rendering, and displayed in a hybrid work environment, consisting of a dual power wall and a desktop PC. For practical reasons in this environment, the design and use of the transfer functions is subdivided into two steps, classification and exploration. The classification step is done at the desktop, taking advantage of the 2D mouse as a high accuracy input device. The exploration process takes place on the powerwall. We present our new approach, describe the underlying implementation issues, report on our experiences with different immersive environments, and suggest ways it can be used for collaborative medical diagnosis and treatment planning.