Rotational Crossed-Slit Light Fields

Light fields (LFs) are image-based representation that records the radiance along all rays along every direction through every point in space. Traditionally LFs are acquired by using a 2D grid of evenly spaced pinhole cameras or by translating a pinhole camera along the 2D grid using a robot arm. In this paper, we present a novel LF sampling scheme by exploiting a special non-centric camera called the crossed-slit or XSlit camera. An XSlit camera acquires rays that simultaneously pass through two oblique slits. We show that, instead of translating the camera as in the pinhole case, we can effectively sample the LF by rotating individual or both slits while keeping the camera fixed. This leads a "fixed-location" LF acquisition scheme. We further show through theoretical analysis and experiments that the resulting XSlit LFs provide several advantages: they provide more dense spatial-angular sampling, are amenable multi-view stereo matching and volumetric reconstruction, and can synthesize unique refocusing effects.

[1]  Ronald A. Rensink,et al.  Influence of scene-based properties on visual search. , 1990, Science.

[2]  Yoav Y. Schechner,et al.  Multiscale ultrawide foveated video extrapolation , 2011, 2011 IEEE International Conference on Computational Photography (ICCP).

[3]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[4]  Wei Yang,et al.  Depth-of-Field and Coded Aperture Imaging on XSlit Lens , 2014, ECCV.

[5]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[6]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[7]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  E. DeYoe,et al.  A physiological correlate of the 'spotlight' of visual attention , 1999, Nature Neuroscience.

[9]  F. Durand,et al.  General linear cameras: theory and applications , 2005 .

[10]  Jingyi Yu,et al.  Manhattan Scene Understanding via XSlit Imaging , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Tomas Pajdla,et al.  Geometry of Two-Slit Camera , 2002 .

[12]  Tomás Pajdla Stereo with Oblique Cameras , 2004, International Journal of Computer Vision.

[13]  Leonard McMillan,et al.  General Linear Cameras , 2004, ECCV.

[14]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[15]  Zhan Yu,et al.  Line Assisted Light Field Triangulation and Stereo Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[16]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[17]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[18]  Daphna Weinshall,et al.  Mosaicing New Views: The Crossed-Slits Projection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[20]  Jingyi Yu,et al.  A Rotational Stereo Model Based on XSlit Imaging , 2013, 2013 IEEE International Conference on Computer Vision.

[21]  James F. Parker,et al.  Bioastronautics Data Book: Second Edition. NASA SP-3006. , 1973 .

[22]  Yoav Y. Schechner,et al.  Ultrawide Foveated Video Extrapolation , 2011, IEEE Journal of Selected Topics in Signal Processing.

[23]  Haibin Ling,et al.  Saliency Detection on Light Field , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[25]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[26]  R. J. Watt,et al.  Mechanisms of interpolation in human spatial vision , 1982, Nature.

[27]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[28]  Steven M. Seitz,et al.  The Space of All Stereo Images , 2004, International Journal of Computer Vision.