Multidimensional imaging using a lensless randomly coded aperture camera

Some of the recent advances in the image engineering technology are three-dimensional and multi-spectral image acquisition. In order to obtain depth information of objects, many technologies are possible such as stereography, ToF, coded aperture and so on. Optical filters, diffraction gratings and variation of light source are available for multi-/hyperspectral imaging. A simple scheme for realizing those advanced technologies are discussed in this study. The proposed system includes only a monochromatic image sensor and a randomly coded aperture without lenses. The lensless imaging technologies are available not only for conventional image acquisition but also for refocusing method. As a statistical optics approach associating with the random coded aperture, simple imaging optics with diffusers are introduced. Those have been applied to acquire depth information and color images. However, none of the proposal to acquire depth and color information simultaneously has been discussed. The size of the point spread function (PSF) of a randomly coded aperture depends on the depth position of a point source. The inverse function of the PSF can retrieve the image on the corresponding depth position, because PSFs of different depths do not correlate to each other. The different wavelengths lead the different PSFs even for the same depth position. It is caused by the nature of diffraction of the aperture. Because of the nature, the selectivities of depth and wavelength are independent, then the proposed system realizes fourdimensional image acquisition with a deterministic approach by using a designed randomly coded aperture.

[1]  Ick,et al.  DiffuserCam : Lensless Single-exposure 3 D Imaging , 2017 .

[2]  Masud Mansuripur,et al.  Certain computational aspects of vector diffraction problems , 1989 .

[3]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, ACM Trans. Graph..

[4]  Yusuke Nakamura,et al.  Lensless close-up imaging with Fresnel zone aperture , 2018, Japanese Journal of Applied Physics.

[5]  Shree K. Nayar,et al.  Programmable Aperture Camera Using LCoS , 2010, IPSJ Trans. Comput. Vis. Appl..

[6]  Haruka Saito,et al.  Image focusing analysis using coded aperture made of a printed mask , 2019, Japanese Journal of Applied Physics.

[7]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[8]  Kosuke Sato,et al.  Fusing Depth from Defocus and Stereo with Coded Apertures , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  S. Sahoo,et al.  Single-shot multispectral imaging with a monochromatic camera , 2017, 1707.09453.

[10]  Takashi Matsuyama,et al.  Depth measurement by the multi-focus camera , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).