An analysis of 3D point cloud reconstruction from light field images

Current methodologies for the generation of 3D point cloud from real world scenes rely upon a set of 2D images capturing the scene from several points of view. Novel plenoptic cameras sample the light field crossing the main camera lens creating a light field image. The information available in a plenoptic image must be processed in order to render a view or create the depth map of the scene. This paper analyses a method for the reconstruction of 3D models. The reconstruction of the model is obtained from a single image shot. Exploiting the properties of plenoptic images, a point cloud is generated and compared with a point cloud of the same object but generated with a different plenoptic camera.

[1]  Cristian Perra,et al.  Wireless cooperative access to images , 2013, 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC).

[2]  Cristian Perra,et al.  Data formats for high efficiency coding of Lytro-Illum light fields , 2015, 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA).

[3]  Cristian Perra,et al.  Lossless plenoptic image compression using adaptive block differential prediction , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[5]  Jianbo Liu,et al.  Precise 3D Reconstruction from a Single Image , 2012, ACCV.

[6]  Cristian Perra,et al.  3D reconstruction from plenoptic image , 2015, 2015 23rd Telecommunications Forum Telfor (TELFOR).

[7]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[8]  Daniel Cohen-Or,et al.  3-Sweep , 2013, ACM Trans. Graph..

[9]  Leonard T. Bruton,et al.  Gradient-based depth estimation from 4D light fields , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[10]  G. Lippmann.  Epreuves reversibles donnant la sensation du relief , 1908 .

[11]  Cristian Perra.  On the coding of plenoptic raw images , 2014, 2014 22nd Telecommunications Forum Telfor (TELFOR).

[12]  Cristian Perra.  A low computational complexity blockiness estimation based on spatial analysis , 2014, 2014 22nd Telecommunications Forum Telfor (TELFOR).

[13]  George Pavlidis,et al.  Multi-image 3D reconstruction data evaluation , 2014 .

[14]  Daniel Cohen-Or,et al.  Flower reconstruction from a single photo , 2014, Comput. Graph. Forum.

[15]  Daniele D. Giusto,et al.  Interactive Image Viewing in Mobile Devices Based on JPEG XR , 2011, MobiMedia.

[16]  Daniele D. Giusto,et al.  High-frequency error recovery in JPEG XR coded images , 2011, 2011 18th IEEE International Conference on Image Processing.

[17]  Paolo Cignoni,et al.  MeshLab: an Open-Source 3D Mesh Processing System , 2008, ERCIM News.

[18]  Cristian Perra,et al.  High efficiency coding of light field images based on tiling and pseudo-temporal data arrangement , 2016, 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[19]  Dikpal Reddy,et al.  External Mask Based Depth and Light Field Camera , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[20]  C. Perra,et al.  Unfocused plenoptic camera calibration , 2014, 2014 22nd Telecommunications Forum Telfor (TELFOR).

[21]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[22]  Zhan Yu,et al.  Line Assisted Light Field Triangulation and Stereo Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[23]  Xiaoou Tang,et al.  3-D Modeling From a Single View of a Symmetric Object , 2012, IEEE Transactions on Image Processing.

[24]  Anestis Koutsoudis,et al.  Performance Evaluation of a Multi-Image 3D Reconstruction Software on a Low-Feature Artefact , 2013 .

[25]  Zhan Yu,et al.  Plenoptic depth map in the case of occlusions , 2013, Electronic Imaging.

[26]  Tom E. Bishop,et al.  The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Cristian Perra,et al.  An Entrepreneurship Centre in the lifelong learning spirit , 2010, 2010 9th International Conference on Information Technology Based Higher Education and Training (ITHET).

[28]  Tom E. Bishop,et al.  Plenoptic depth estimation from multiple aliased views , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[29]  Daniel Cremers,et al.  Relative Volume Constraints for Single View 3D Reconstruction , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.