Super Field-of-View Lensless Camera by Coded Image Sensors †

A lensless camera is an ultra-thin computational-imaging system. Existing lensless cameras are based on the axial arrangement of an image sensor and a coding mask, and therefore, the back side of the image sensor cannot be captured. In this paper, we propose a lensless camera with a novel design that can capture the front and back sides simultaneously. The proposed camera is composed of multiple coded image sensors, which are complementary-metal-oxide-semiconductor (CMOS) image sensors in which air holes are randomly made at some pixels by drilling processing. When the sensors are placed facing each other, the object-side sensor works as a coding mask and the other works as a sparsified image sensor. The captured image is a sparse coded image, which can be decoded computationally by using compressive sensing-based image reconstruction. We verified the feasibility of the proposed lensless camera by simulations and experiments. The proposed thin lensless camera realized super-field-of-view imaging without lenses or coding masks and therefore can be used for rich information sensing in confined spaces. This work also suggests a new direction in the design of CMOS image sensors in the era of computational imaging.

[1]  Laura Waller,et al.  DiffuserCam: Lensless Single-exposure 3D Imaging , 2017, ArXiv.

[2]  Ick,et al.  DiffuserCam : Lensless Single-exposure 3 D Imaging , 2017 .

[3]  Shree K. Nayar,et al.  PiCam , 2013, ACM Trans. Graph..

[4]  Keiichiro Kagawa,et al.  Lensless imaging with image sensors functioning as coded apertures , 2018 .

[5]  Aswin C. Sankaranarayanan,et al.  Lensless Imaging: A computational renaissance , 2016, IEEE Signal Processing Magazine.

[6]  E. Candès,et al.  Sparsity and incoherence in compressive sampling , 2006, math/0611957.

[7]  Nakamura Yusuke,et al.  Lensless Light-Field Imaging with Fresnel Zone Aperture , 2016 .

[8]  W. Choi,et al.  Optical Imaging With the Use of a Scattering Lens , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[9]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[10]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[11]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[12]  Aswin C. Sankaranarayanan,et al.  FlatCam: Replacing Lenses with Masks and Computation , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[13]  Jun Ohta,et al.  Implantable CMOS Biomedical Devices , 2009, Sensors.

[14]  Yusuke Nakamura,et al.  Lensless light-field imaging with Fresnel zone aperture: quasi-coherent coding. , 2018, Applied optics.

[15]  Yasushi Yagi,et al.  Lensless imaging for wide field of view , 2015 .

[16]  Prasant Potuluri,et al.  Imaging with random 3D reference structures. , 2003, Optics express.

[17]  J. Tanida,et al.  Single-shot phase imaging with a coded aperture. , 2014, Optics letters.

[18]  D. Brady Optical Imaging and Spectroscopy , 2009 .

[19]  J. Goodman Introduction to Fourier optics , 1969 .

[20]  Rajesh Menon,et al.  Lensless Photography with only an image sensor , 2017, Applied optics.

[21]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[22]  Masahiro Nunoshita,et al.  An implantable and fully integrated complementary metal–oxide semiconductor device for in vivo neural imaging and electrical interfacing with the mouse hippocampus , 2008 .

[23]  Adrian Stern,et al.  Optical Compressive Imaging , 2016 .

[24]  Weidong Zhou,et al.  Origami silicon optoelectronics for hemispherical electronic eye systems , 2017, Nature Communications.

[25]  Jun Tanida,et al.  Compact wide-field-of-view imager with a designed disordered medium , 2015 .