High-resolution adaptive imaging with a single photodiode

During the past few years, the emergence of spatial light modulators operating at the tens of kHz has enabled new imaging modalities based on single-pixel photodetectors. The nature of single-pixel imaging enforces a reciprocal relationship between frame rate and image size. Compressive imaging methods allow images to be reconstructed from a number of projections that is only a fraction of the number of pixels. In microscopy, single-pixel imaging is capable of producing images with a moderate size of 128 × 128 pixels at frame rates under one Hz. Recently, there has been considerable interest in the development of advanced techniques for high-resolution real-time operation in applications such as biological microscopy. Here, we introduce an adaptive compressive technique based on wavelet trees within this framework. In our adaptive approach, the resolution of the projecting patterns remains deliberately small, which is crucial to avoid the demanding memory requirements of compressive sensing algorithms. At pattern projection rates of 22.7 kHz, our technique would enable to obtain 128 × 128 pixel images at frame rates around 3 Hz. In our experiments, we have demonstrated a cost-effective solution employing a commercial projection display.

[1]  V. Ntziachristos Going deeper than microscopy: the optical imaging frontier in biology , 2010, Nature Methods.

[2]  Jeffrey D. Blanchard,et al.  Toward deterministic compressed sensing , 2013, Proceedings of the National Academy of Sciences.

[3]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[4]  Aswin C. Sankaranarayanan,et al.  CS-MUVI: Video compressive sensing for spatial-multiplexing cameras , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[5]  David R. Smith,et al.  Terahertz compressive imaging with metamaterial spatial light modulators , 2014, Nature Photonics.

[6]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[7]  Sina Jafarpour,et al.  Deterministic matrices matching the compressed sensing phase transitions of Gaussian random matrices , 2012, Proceedings of the National Academy of Sciences.

[8]  Steve Marschner,et al.  Dual photography , 2005, ACM Trans. Graph..

[9]  Eddie L. Jacobs,et al.  Adaptive compressive sensing algorithm for video acquisition using a single-pixel camera , 2013, J. Electronic Imaging.

[10]  Daniel J. Lum,et al.  Photon counting compressive depth mapping , 2013, Optics express.

[11]  Kevin J. Mitchell,et al.  Single-pixel infrared and visible microscope , 2014 .

[12]  Aswin C. Sankaranarayanan,et al.  Video Compressive Sensing for Spatial Multiplexing Cameras Using Motion-Flow Models , 2015, SIAM J. Imaging Sci..

[13]  Bo Song,et al.  Single pixel infrared camera using a carbon nanotube photodetector , 2011, 2011 IEEE SENSORS Proceedings.

[14]  Mark R. Freeman,et al.  3D Computational Imaging with Single-Pixel Detectors , 2013 .

[15]  Enrique Tajahuerce,et al.  Single-pixel polarimetric imaging spectrometer by compressive sensing , 2013 .

[16]  Manfred Bayer,et al.  Compressive adaptive computational ghost imaging , 2013, Scientific Reports.

[17]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[18]  Vicente Durán,et al.  Single-pixel polarimetric imaging. , 2012, Optics letters.

[19]  E Tajahuerce,et al.  Compressive imaging in scattering media. , 2015, Optics express.

[20]  Matthew A. Herman,et al.  A higher-speed compressive sensing camera through multi-diode design , 2013, Defense, Security, and Sensing.

[21]  Graham M. Gibson,et al.  Simultaneous real-time visible and infrared video with single-pixel detectors , 2015, Scientific Reports.

[22]  Ling-An Wu,et al.  Adaptive compressive ghost imaging based on wavelet trees and sparse representation. , 2014, Optics express.

[23]  David Shrekenhamer,et al.  Terahertz single pixel imaging with an optically controlled dynamic spatial light modulator. , 2013, Optics express.

[24]  Vicente Durán,et al.  Image transmission through dynamic scattering media by single-pixel photodetection. , 2014, Optics express.

[25]  Marc Levoy,et al.  Dual photography , 2005, SIGGRAPH 2005.

[26]  Wai Lam Chan,et al.  A single-pixel terahertz imaging system based on compressed sensing , 2008 .

[27]  Miles J. Padgett,et al.  Near video-rate linear Stokes imaging with single-pixel detectors , 2015 .