Surface reconstruction from multiview projection data employing a microlens array-based optical detector: a simulation study

Abstract. This article proposes a surface reconstruction method from multiview projectional data acquired by means of a rotationally mounted microlens array-based light detector (MLA-D). The technique is adapted for in vivo small animal imaging, specifically for imaging of nude mice, and does not require an additional imaging step (e.g., by means of a secondary structural modality) or additional hardware (e.g., laser-scanning approaches). Any potential point within the field of view (FOV) is evaluated by a proposed photo-consistency measure, utilizing sensor image light information as provided by elemental images (EIs). As the superposition of adjacent EIs yields depth information for any point within the FOV, the three-dimensional surface of the imaged object is estimated by a graph cuts-based method through global energy minimization. The proposed surface reconstruction is evaluated on simulated MLA-D data, incorporating a reconstructed mouse data volume as acquired by x-ray computed tomography. Compared with a previously presented back projection-based surface reconstruction method, the proposed technique yields a significantly lower error rate. Moreover, while the back projection-based method may not be able to resolve concave surfaces, this approach does. Our results further indicate that the proposed method achieves high accuracy at a low number of projections.

[1]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Liji Cao,et al.  Evaluation of shape recognition abilities for a micro-lens array based optical detector by a dedicated simulation framework , 2013, Photonics West - Biomedical Optics.

[3]  B. Pogue,et al.  Imaging breast adipose and fibroglandular tissue molecular signatures by using hybrid MRI-guided near-infrared spectral tomography. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[5]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Hamid Dehghani,et al.  Simultaneous multiple view high resolution surface geometry acquisition using structured light and mirrors. , 2013, Optics express.

[7]  Mohammed Bennamoun,et al.  Non-parametric techniques for fast and robust stereo matching , 1997, TENCON '97 Brisbane - Australia. Proceedings of IEEE TENCON '97. IEEE Region 10 Annual Conference. Speech and Image Technologies for Computing and Telecommunications (Cat. No.97CH36162).

[8]  Joerg Peter Synchromodal optical in vivo imaging employing microlens array optics: a complete framework , 2013, Photonics West - Biomedical Optics.

[9]  Jie Tian,et al.  Generalized free-space diffuse photon transport model based on the influence analysis of a camera lens diaphragm. , 2010, Applied optics.

[10]  Roberto Cipolla,et al.  Using Multiple Hypotheses to Improve Depth-Maps for Multi-View Stereo , 2008, ECCV.

[11]  Liji Cao,et al.  Geometrical co-calibration of a tomographic optical system with CT for intrinsically co-registered imaging , 2010, Physics in medicine and biology.

[12]  Junjie Yao,et al.  Fluorescent Optical Imaging of Small Animals Using Filtered Back-projection 3D Surface Reconstruction Method , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[13]  Hamid Dehghani,et al.  Multi-modal molecular diffuse optical tomography system for small animal imaging , 2013, Measurement science & technology.

[14]  Greg Humphreys,et al.  Physically Based Rendering: From Theory to Implementation , 2004 .

[15]  Roberto Cipolla,et al.  Multiview Stereo via Volumetric Graph-Cuts and Occlusion Robust Photo-Consistency , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Vasilis Ntziachristos,et al.  Free-space fluorescence molecular tomography utilizing 360° geometry projections , 2007 .

[17]  M. Brian Blake,et al.  IGSTK: an open source software toolkit for image-guided surgery , 2006, Computer.

[18]  Jörg Peter,et al.  Image formation with a microlens-based optical detector: a three-dimensional mapping approach. , 2009, Applied optics.

[19]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Liji Cao,et al.  Iterative reconstruction of projection images from a microlens-based optical detector. , 2011, Optics express.

[21]  Vasilis Ntziachristos,et al.  Noncontact optical imaging in mice with full angular coverage and automatic surface extraction. , 2007, Applied optics.

[22]  W. Semmler,et al.  Development and Initial Results of a Tomographic Dual-Modality Positron/Optical Small Animal Imager , 2007, IEEE Transactions on Nuclear Science.

[23]  Éva Tardos,et al.  Approximation algorithms for classification problems with pairwise relationships: metric labeling and Markov random fields , 2002, JACM.

[24]  Gilbae Park,et al.  Reconstruction of three-dimensional occluded object using optical flow and triangular mesh reconstruction in integral imaging. , 2010, Optics express.

[25]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[27]  Marc Levoy,et al.  Light Fields and Computational Imaging , 2006, Computer.

[28]  Jorge Ripoll,et al.  Fluorescence Molecular Tomography: Principles and Potential for Pharmaceutical Research , 2011, Pharmaceutics.

[29]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[30]  W. Semmler,et al.  Geometric Co-Calibration of an Integrated Small Animal SPECT-CT System for Intrinsically Co-Registered Imaging , 2009, IEEE Transactions on Nuclear Science.

[31]  G Passalis,et al.  Enhanced reconstruction of three-dimensional shape and texture from integral photography images. , 2007, Applied optics.

[32]  Liji Cao,et al.  Bayesian reconstruction strategy of fluorescence-mediated tomography using an integrated SPECT-CT-OT system , 2010, Physics in medicine and biology.

[33]  Myungjin Cho,et al.  Three-Dimensional Optical Sensing and Visualization Using Integral Imaging , 2011, Proceedings of the IEEE.

[34]  Yusuke Ogura,et al.  Three-Dimensional Information Acquisition Using a Compound Imaging System , 2007 .