A Semi Nonnegative Matrix Factorization Technique for Pattern Generalization in Single-Pixel Imaging

A single-pixel camera is a computational imaging device that only requires a single point detector to capture the image of a scene. This device measures the inner product of the scene and the spatial light modulator patterns. The image of the scene can be recovered through postprocessing the measurements obtained for a set of different patterns. Independent of the strategy used for image recovery, real acquisitions require the spatial light modulator patterns to be positive. In addition, the dark current measured in the absence of modulation must be rejected. To date, both experimental issues have been addressed empirically. In this paper, we solve these from a general perspective. Indeed, we propose to seek positive patterns that are linear combinations of the desired patterns (with negative values), and the linear transformation matrices are chosen to reject the dark current. We refer to the problem of finding the positive patterns and the linear combinations as “pattern generalization.” To the best of our knowledge, this is the first time that this problem has been introduced. In addition, we show that pattern generalization can be solved using a semi nonnegative matrix factorization algorithm. The data obtained from simulations demonstrate that our approach performs similarly to or better than conventional methods, while using fewer measurements.

[1]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[2]  Nicolas Gillis,et al.  The Why and How of Nonnegative Matrix Factorization , 2014, ArXiv.

[3]  E. Candès,et al.  Compressive fluorescence microscopy for biological and hyperspectral imaging , 2012, Proceedings of the National Academy of Sciences.

[4]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[5]  E. Tajahuerce,et al.  High-resolution adaptive imaging with a single photodiode , 2015, Scientific Reports.

[6]  Enrique Tajahuerce,et al.  Dual-mode optical microscope based on single-pixel imaging , 2016 .

[7]  Wai Lam Chan,et al.  A single-pixel terahertz imaging system based on compressed sensing , 2008 .

[8]  Miles J. Padgett,et al.  Near video-rate linear Stokes imaging with single-pixel detectors , 2015 .

[9]  Faramarz Farahi,et al.  Active illumination single-pixel camera based on compressive sensing. , 2011, Applied optics.

[10]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[11]  Nicolas Gillis,et al.  Exact and Heuristic Algorithms for Semi-Nonnegative Matrix Factorization , 2014, SIAM J. Matrix Anal. Appl..

[12]  Jianwei Ma,et al.  Single-Pixel Remote Sensing , 2009, IEEE Geoscience and Remote Sensing Letters.

[13]  Ling-An Wu,et al.  Coloured computational imaging with single-pixel detectors based on a 2D discrete cosine transform , 2016, 1603.02793.

[14]  Amir Averbuch,et al.  Adaptive Compressed Image Sensing Using Dictionaries , 2012, SIAM J. Imaging Sci..

[15]  Andrea Farina,et al.  Adaptive Basis Scan by Wavelet Prediction for Single-Pixel Imaging , 2017, IEEE Transactions on Computational Imaging.

[16]  Zibang Zhang,et al.  Three-dimensional single-pixel imaging with far fewer measurements than effective image pixels. , 2016, Optics letters.

[17]  Heng-Ming Tai,et al.  Adaptive single-pixel imaging based on guided coefficients. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  David R. Smith,et al.  Terahertz compressive imaging with metamaterial spatial light modulators , 2014, Nature Photonics.

[19]  Mehrdad Abolbashari,et al.  High-resolution hyperspectral single-pixel imaging system based on compressive sensing , 2012 .

[20]  Ling-An Wu,et al.  Adaptive compressive ghost imaging based on wavelet trees and sparse representation. , 2014, Optics express.

[21]  Aswin C. Sankaranarayanan,et al.  Enhanced Compressive Imaging Using Model-Based Acquisition: Smarter sampling by incorporating domain knowledge , 2016, IEEE Signal Processing Magazine.

[22]  Chris H. Q. Ding,et al.  Convex and Semi-Nonnegative Matrix Factorizations , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Ronald R. Coifman,et al.  Application of spatial light modulators for new modalities in spectrometry and imaging , 2003, SPIE BiOS.

[24]  Amir Averbuch,et al.  Adaptive compressed image sensing based on wavelet modeling and direct sampling , 2017 .

[25]  Qian Chen,et al.  Adaptive compressed photon counting 3D imaging based on wavelet trees and depth map sparse representation. , 2016, Optics express.

[26]  Jingang Zhong,et al.  Single-pixel imaging by means of Fourier spectrum acquisition , 2015, Nature Communications.

[27]  Richard G. Baraniuk,et al.  A new compressive imaging camera architecture using optical-domain compression , 2006, Electronic Imaging.

[28]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[29]  Abdelhak M. Zoubir,et al.  Compressive sensing and adaptive direct sampling in hyperspectral imaging , 2014, Digit. Signal Process..

[30]  Kevin J. Mitchell,et al.  Single-pixel infrared and visible microscope , 2014 .

[31]  Vicente Durán,et al.  Image transmission through dynamic scattering media by single-pixel photodetection. , 2014, Optics express.

[32]  Graham M. Gibson,et al.  3D single-pixel video , 2016 .

[33]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[34]  Chih-Jen Lin,et al.  Projected Gradient Methods for Nonnegative Matrix Factorization , 2007, Neural Computation.

[35]  Xavier Intes,et al.  Time-resolved hyperspectral single-pixel camera implementation for compressive wide-field fluorescence lifetime imaging , 2016, SPIE BiOS.

[36]  Qian Chen,et al.  Adaptive compressed sampling based on extended wavelet trees. , 2014, Applied optics.

[37]  M. Padgett,et al.  Fast full-color computational imaging with single-pixel detectors. , 2013, Optics express.

[38]  Jeffrey H. Shapiro,et al.  Computational ghost imaging , 2008, 2009 Conference on Lasers and Electro-Optics and 2009 Conference on Quantum electronics and Laser Science Conference.

[39]  Yu-Jin Zhang,et al.  Nonnegative Matrix Factorization: A Comprehensive Review , 2013, IEEE Transactions on Knowledge and Data Engineering.

[40]  Michael W. Berry,et al.  Algorithms and applications for approximate nonnegative matrix factorization , 2007, Comput. Stat. Data Anal..

[41]  P. Paatero,et al.  Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values† , 1994 .