Subpixel based defocused points removal in photon-limited volumetric dataset

Abstract The asymptotic property of the maximum likelihood estimator (MLE) has been utilized to reconstruct three-dimensional (3D) sectional images in the photon counting imaging (PCI) regime. At first, multiple 2D intensity images, known as Elemental images (EI), are captured. Then the geometric ray-tracing method is employed to reconstruct the 3D sectional images at various depth cues. We note that a 3D sectional image consists of both focused and defocused regions, depending on the reconstructed depth position. The defocused portion is redundant and should be removed in order to facilitate image analysis e.g., 3D object tracking, recognition, classification and navigation. In this paper, we present a subpixel level three-step based technique (i.e. involving adaptive thresholding, boundary detection and entropy based segmentation) to discard the defocused sparse-samples from the reconstructed photon-limited 3D sectional images. Simulation results are presented demonstrating the feasibility and efficiency of the proposed method.

[1]  John T. Sheridan,et al.  Multispectral single-channel 3D computational integral imaging using compressive sensing , 2015 .

[2]  Yitzhak Yitzhaky,et al.  Automatic 3D object localization and isolation using computational integral imaging. , 2015, Applied optics.

[3]  Yitzhak Yitzhaky,et al.  Detection of Object Existence From a Single Reconstructed Plane Obtained by Integral Imaging , 2014, IEEE Photonics Technology Letters.

[4]  Hoon Yoo.  Depth extraction for 3D objects via windowing technique in computational integral imaging with a lenslet array , 2013 .

[5]  Byung-Geun Lee,et al.  Interferometry based multispectral photon-limited 2D and 3D integral image encryption employing the Hartley transform. , 2015, Optics express.

[6]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Nobuhiko Hata,et al.  Surgical navigation by autostereoscopic image overlay of integral videography , 2004, IEEE Transactions on Information Technology in Biomedicine.

[8]  Byoungho Lee,et al.  Recent progress in three-dimensional information processing based on integral imaging. , 2009, Applied optics.

[9]  Subhasis Chaudhuri,et al.  A Variational Approach to Recovering Depth From Defocused Images , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Michael S Feld,et al.  Overcoming the diffraction limit using multiple light scattering in a highly disordered medium. , 2011, Physical review letters.

[11]  Jae-Young Jang,et al.  Depth extraction by using the correlation of the periodic function with an elemental image in integral imaging. , 2012, Applied optics.

[12]  J Arai,et al.  Real-time pickup method for a three-dimensional image based on integral photography. , 1997, Applied optics.

[13]  Bahram Javidi,et al.  Three dimensional visualization by photon counting computational Integral Imaging. , 2008, Optics express.

[14]  Peter Lawrence,et al.  An Investigation of Methods for Determining Depth from Focus , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  James P. Ryle,et al.  Space-variant defocused content removal in Photon-counted volumetric datasets , 2016 .

[16]  Inkyu Moon,et al.  3D Visualization at Low Light Levels Using Multispectral Photon Counting Integral Imaging , 2013, Journal of Display Technology.

[17]  Brian Glennon,et al.  Calibration of a digital in-line holographic microscopy system: depth of focus and bioprocess analysis. , 2013, Applied optics.

[18]  J. Goodman.  Statistical Optics , 1985 .

[19]  John T. Sheridan,et al.  Segmentation and visualization of digital in-line holographic microscopy of three-dimensional scenes using reconstructed intensity images , 2009, Optical Engineering + Applications.

[20]  Byoungho Lee,et al.  Depth extraction by use of a rectangular lens array and one-dimensional elemental image modification. , 2004, Applied optics.

[21]  Eun-Soo Kim,et al.  Depth extraction of 3D objects using axially distributed image sensing. , 2012, Optics express.

[22]  Faliu Yi,et al.  Simultaneous reconstruction of multiple depth images without off-focus points in integral imaging using a graphics processing unit. , 2014, Applied optics.

[23]  Gang Chen,et al.  Color Image Analysis by Quaternion-Type Moments , 2014, Journal of Mathematical Imaging and Vision.

[24]  Myungjin Cho,et al.  Three-Dimensional Optical Sensing and Visualization Using Integral Imaging , 2011, Proceedings of the IEEE.

[25]  David Mas,et al.  Resolution limits to object tracking with subpixel accuracy. , 2012, Optics letters.

[26]  Takanori Okoshi.  Three-Dimensional Imaging Techniques , 1976 .

[27]  B. Javidi,et al.  Integral imaging with improved depth of field by use of amplitude-modulated microlens arrays. , 2004, Applied optics.

[28]  Bahram Javidi,et al.  Three-dimensional integral imaging with improved visualization using subpixel optical ray sensing. , 2012, Optics letters.

[29]  V. Bove.  Entropy-based depth from focus , 1993 .

[30]  Herbert E. Ives,et al.  Optical Properties of a Lippmann Lenticulated Sheet , 1931 .

[31]  Yuhui Zheng,et al.  Image segmentation by generalized hierarchical fuzzy C-means algorithm , 2015, J. Intell. Fuzzy Syst..

[32]  Bahram Javidi,et al.  Three-Dimensional Image Sensing, Visualization, and Processing Using Integral Imaging , 2006, Proceedings of the IEEE.