Quantitative image-level evaluation of multiresolution 3D texture-based volume rendering

This research focuses on a quantitative evaluation of images produced by multi-resolution 3D texture-based volume rendering methods. Volume rendering techniques utilize nearly all the data in a volumetric data set to construct an image, so using coarser versions of the original data may negatively impact the display quality of the images produced. The trade-offs between a more efficient use of memory space needed to store a multi-resolution representation versus the potential sacrifice of image quality are characterized by visual inspection and by two image quality measurements: root mean square error (RMSE) and normalized mutual information (NMI). RMSE is a traditional image quality measurement and NMI is a recent technique used in image processing and human vision research that incorporates image entropies into a concise, intuitive information-based measurement to quantify information content. Using image entropy as a measure of information can help determine if there is some kind of structural artifact in the image, so it may compliment RMSE, which is often used to identify random error. The analysis of images produced from multi-resolution volume rendering experiments indicates that there is additional merit in looking at information-based measurements of image quality as well as using traditional measurements to identify and quantitatively evaluate regions of mismatch.

[1]  Rüdiger Westermann,et al.  Level-of-detail volume rendering via 3D textures , 2000, VVS.

[2]  Jane Wilhelms,et al.  Multi-dimensional trees for controlled volume rendering and compression , 1994, VVS '94.

[3]  W. Pratt.  Spatial Transform Coding of Color Images , 1971 .

[4]  Bernd Hamann,et al.  Multiresolution techniques for interactive texture-based volume visualization , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[5]  James F. Blinn,et al.  Light reflection functions for simulation of clouds and dusty surfaces , 1982, SIGGRAPH.

[6]  Alex T. Pang,et al.  Extended Specifications and Test Data Sets for Data Level Comparisons of Direct Volume Rendering Algorithms , 2001, IEEE Trans. Vis. Comput. Graph..

[7]  Rüdiger Westermann,et al.  Efficiently using graphics hardware in volume rendering applications , 1998, SIGGRAPH.

[8]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[9]  Andrew P. Bradley,et al.  Perceptual quality metrics applied to still image compression , 1998, Signal Process..

[10]  Masaki Oshima,et al.  Auto Segmentation of Oil Slick in RADARSAT SAR Image Data around Rupat Island, Malacca Strait , 2001 .

[11]  Raghu Machiraju,et al.  Structure-Significant Representation of Structured Datasets , 1998, IEEE Trans. Vis. Comput. Graph..

[12]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[13]  D L Hill,et al.  Automated three-dimensional registration of magnetic resonance and positron emission tomography brain images by multiresolution optimization of voxel similarity measures. , 1997, Medical physics.

[14]  Pat Hanrahan,et al.  Fast algorithms for volume ray tracing , 1992, VVS.

[15]  Peter Williams,et al.  Metrics and generation specifications for comparing volume‐rendered images , 1999 .

[16]  James D. Foley,et al.  Fundamentals of interactive computer graphics , 1982 .

[17]  R. Narayan,et al.  Maximum Entropy Image Restoration in Astronomy , 1986 .

[18]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[19]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[20]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[21]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[22]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[23]  Yun He,et al.  Multiscale Signal Processing and Shape Analysis for an Inverse Sar Imaging System , 2001 .

[24]  Paolo Sabella,et al.  A rendering algorithm for visualizing 3D scalar fields , 1988, SIGGRAPH.

[25]  J. M. Zachary,et al.  An Information Theoretic Approach to Content Based Image Retrieval. , 2000 .