The potential synergies of visual scene reconstruction and medical image reconstruction

Image reconstruction in nuclear medicine produces valuable volumetric data of vital markers in living bodies. Visual scene reconstruction methods, that aim to recreate a scene from camera images, are also continuously improved by the recent advancements of light-fields and camera systems. The parallels of the two fields are increasingly noticeable as we now have the computing power and methods to take into account transparent materials and ray trace the scattering and other effects of lights for visual scene reconstruction. In this paper, we aim to highlight and analyze the similarities and potential synergies of the two methods.

[1]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[2]  A. Cserkaszky,et al.  Implementation of 3D Monte Carlo PET reconstruction algorithm on GPU , 2009, 2009 IEEE Nuclear Science Symposium Conference Record (NSS/MIC).

[3]  Maria G. Martini,et al.  To interpolate or not to interpolate: Subjective assessment of interpolation performance on a light field display , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[4]  Benjamin M. W. Tsui,et al.  Noise properties of filtered-backprojection and ML-EM reconstructed emission tomographic images , 1992 .

[5]  Yael Pritch,et al.  Scene reconstruction from high spatio-angular resolution light fields , 2013, ACM Trans. Graph..

[6]  C. Dyer.  Volumetric Scene Reconstruction from Multiple Views , 2001 .

[7]  R A Brooks,et al.  Theory of image reconstruction in computed tomography. , 1975, Radiology.

[8]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[9]  László Bokor,et al.  The interdependence of spatial and angular resolution in the quality of experience of light field visualization , 2017, 2017 International Conference on 3D Immersion (IC3D).

[10]  Maria G. Martini,et al.  Evaluation of the Concept of Dynamic Adaptive Streaming of Light Field Video , 2018, IEEE Transactions on Broadcasting.

[11]  Steven M. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, International Journal of Computer Vision.

[12]  J. B. Mann,et al.  Compton Scattering Factors for Spherically Symmetric Free Atoms , 1967 .

[13]  Maria G. Martini,et al.  From a different point of view : how the field of view of light field displays affects the willingness to pay and to use , 2016 .

[14]  Maria G. Martini,et al.  Perceived quality of angular resolution for light field displays and the validy of subjective assessment , 2016, 2016 International Conference on 3D Imaging (IC3D).

[15]  Robert Bregovic,et al.  Light Field Reconstruction Using Shearlet Transform , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Alvaro Collet,et al.  High-quality streamable free-viewpoint video , 2015, ACM Trans. Graph..

[17]  Christophe Schlick,et al.  An Inexpensive BRDF Model for Physically‐based Rendering , 1994, Comput. Graph. Forum.

[18]  M. Vannier,et al.  Why do commercial CT scanners still employ traditional, filtered back-projection for image reconstruction? , 2009, Inverse problems.

[19]  Maria G. Martini,et al.  Viva la resolution: the perceivable differences between image resolutions for light field displays , 2016 .

[20]  Masahiro Suzuki,et al.  Usefulness of a glass-free medical three-dimensional autostereoscopic display in neurosurgery , 2014, International Journal of Computer Assisted Radiology and Surgery.

[21]  Daniel S. F. Magalhães,et al.  Glasses-free 3D viewing systems for medical imaging , 2012 .

[22]  Maria G. Martini,et al.  The Effect of Light Field Reconstruction and Angular Resolution Reduction on the Quality of Experience , 2016, 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[23]  Larry S. Davis.  Foundations of Image Understanding , 2001 .

[24]  Michel Desvignes,et al.  High Speed 3D Tomography on CPU, GPU, and FPGA , 2008, EURASIP J. Embed. Syst..