An overview of flexible sensing integral imaging for three-dimensional profilometric reconstruction with occlusion removal

We overview a previously reported method for three-dimensional (3D) profilometric reconstruction with occlusion removal based on flexible sensing integral imaging. With flexible sensing, the field-of-view of the image system can be increased by randomly distributing a camera array on a non-planar surface. The camera matrices are estimated using the captured multi-perspective elemental images, and the estimated matrices are used for 3D reconstruction. Object recognition is then implemented on the reconstructed image by nonlinear correlation to detect the 3D position of the object. Finally, an algorithm is proposed to visualize the 3D profile of the object with occlusion removal.

[1]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Filiberto Pla,et al.  Three-Dimensional Integral Imaging for Gesture Recognition Under Occlusions , 2017, IEEE Signal Processing Letters.

[3]  Bahram Javidi,et al.  Three-dimensional imaging with detector arrays on arbitrarily shaped surfaces. , 2011, Optics letters.

[4]  Marc Pollefeys,et al.  3D Occlusion Inference from Silhouette Cues , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[6]  Myungjin Cho,et al.  3D Integral Imaging Using Sparse Sensors With Unknown Positions , 2010, Journal of Display Technology.

[7]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[8]  Filiberto Pla,et al.  Integral imaging techniques for flexible sensing through image-based reprojection. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Xiao Xiao,et al.  Occlusion Removal Using Depth Mapping in Three-Dimensional Integral Imaging , 2012, Journal of Display Technology.

[10]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .

[11]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[12]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[13]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[14]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[15]  Bahram Javidi,et al.  Profilometry and optical slicing by passive three-dimensional imaging. , 2009, Optics letters.

[16]  Bahram Javidi,et al.  Three Dimensional Sensing, Visualization, and Display , 2008, 3DTV-CON 2008.

[17]  Bahram Javidi,et al.  Three-dimensional integral imaging with flexible sensing. , 2014, Optics letters.

[18]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[19]  Bahram Javidi,et al.  Three-dimensional profilometric reconstruction using flexible sensing integral imaging and occlusion removal. , 2017, Applied optics.

[20]  B. Javidi,et al.  Breakthroughs in Photonics 2014: Recent Advances in 3-D Integral Imaging Sensing and Display , 2015, IEEE Photonics Journal.

[21]  F. Okano,et al.  Gradient-index lens-array method based on real-time integral photography for three-dimensional images. , 1998, Applied optics.

[22]  Marc Levoy,et al.  Reconstructing Occluded Surfaces Using Synthetic Apertures: Stereo, Focus and Robust Measures , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[23]  G. Sandini,et al.  Computer Vision — ECCV'92 , 1992, Lecture Notes in Computer Science.

[24]  Andreas Geiger,et al.  Automatic camera and range sensor calibration using a single shot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[25]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[26]  B. Javidi,et al.  Three-dimensional visualization of partially occluded objects using integral imaging , 2005, Journal of Display Technology.