Light field image sensors based on the Talbot effect.

We present a pixel-scale sensor that uses the Talbot effect to detect the local intensity and incident angle of light. The sensor comprises two local diffraction gratings stacked above a photodiode. When illuminated by a plane wave, the upper grating generates a self-image at the half Talbot depth. The second grating, placed at this depth, blocks or passes light depending upon incident angle. Several such structures, tuned to different incident angles, are sufficient to extract local incident angle and intensity. Furthermore, arrays of such structures are sufficient to localize light sources in three dimensions without any additional optics.

[1]  Liren Liu,et al.  Uniform theory of the Talbot effect with partially coherent light illumination. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  Parkinson.  LV. Letter from Mr. Parkinson, of hoxton-square, relative to Mr. Donovan's museum , 1807 .

[3]  E. E. Sicre,et al.  Tunable bandstop filter for binary objects: A self-imaging technique , 1983 .

[4]  John William Strutt,et al.  Scientific Papers: On Copying Diffraction-Gratings, and on some Phenomena connected therewith , 2009 .

[5]  W. Talbot.  Facts relating to optical science , 1836 .

[6]  A. El Gamal,et al.  A 0.5 μm pixel frame-transfer CCD image sensor in 110 nm CMOS , 2007, 2007 IEEE International Electron Devices Meeting.

[7]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[8]  W. Duane Montgomery,et al.  Self-Imaging Objects of Infinite Aperture* , 1967 .

[9]  M. Levoy,et al.  The light field , 1939 .

[10]  Chuan-fu Cheng,et al.  Quasi-Talbot effect of the high-density grating in near field. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Lord Rayleigh F.R.S..  XXV. On copying diffraction-gratings, and on some phenomena connected therewith , 1881 .

[13]  H.-S. Philip Wong,et al.  A 3D Multi-Aperture Image Sensor Architecture , 2006, IEEE Custom Integrated Circuits Conference 2006.

[14]  Changhe Zhou,et al.  Polarization-dependent Talbot effect. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[16]  Hammond,et al.  Near-field imaging of atom diffraction gratings: The atomic Talbot effect. , 1995, Physical review. A, Atomic, molecular, and optical physics.

[17]  A. M. Goncharenko,et al.  Talbot effect for oblique angle of light propagation , 1996 .

[18]  J R Leger,et al.  Real-time depth measurement and display using Fresnel diffraction and white-light processing. , 1984, Applied optics.

[19]  J. Winthrop,et al.  Theory of Fresnel Images. I. Plane Periodic Objects in Monochromatic Light , 1965 .

[20]  T C Strand,et al.  Range measurement using Talbot diffraction imaging of gratings. , 1984, Applied optics.

[21]  Jürg E. Balmer,et al.  A wavefront sensor based on the fractional Talbot effect , 2001 .

[22]  M. Levoy,et al.  Light field microscopy , 2006, SIGGRAPH 2006.

[23]  M. A. Breazeale,et al.  Secondary Interference in the Fresnel Zone of Gratings , 1959 .

[24]  A W Lohmann,et al.  Making an array illuminator based on the talbot effect. , 1990, Applied optics.

[25]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[26]  Leonard McMillan,et al.  Dynamically reparameterized light fields , 2000, SIGGRAPH.

[27]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[28]  Kiyoharu Aizawa,et al.  Reconstructing Dense Light Field From Array of Multifocus Images for Novel View Synthesis , 2007, IEEE Transactions on Image Processing.

[29]  C C Davis,et al.  Apparent superresolution in near-field optical imaging of periodic gratings. , 1998, Optics letters.

[30]  A. W. Lohmann,et al.  An interferometer based on the Talbot effect , 1971 .

[31]  Ren Ng.  Fourier Slice Photography , 2005 .

[32]  H.-O. Carmesin,et al.  Depth map by convergent 3D-Talbot-interferometry , 1998 .

[33]  Enrique E. Sicre,et al.  Wavefront sensor using the Talbot effect , 1999 .

[34]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[35]  H.-S. Philip Wong,et al.  A Multi-Aperture Image Sensor With 0.7 $\mu{\hbox{m}}$ Pixels in 0.11 $\mu{\hbox{m}}$ CMOS Technology , 2008, IEEE Journal of Solid-State Circuits.

[36]  D. Spencer,et al.  The photic field , 1981 .