Compressive Sensing Image Sensors-Hardware Implementation

The compressive sensing (CS) paradigm uses simultaneous sensing and compression to provide an efficient image acquisition technique. The main advantages of the CS method include high resolution imaging using low resolution sensor arrays and faster image acquisition. Since the imaging philosophy in CS imagers is different from conventional imaging systems, new physical structures have been developed for cameras that use the CS technique. In this paper, a review of different hardware implementations of CS encoding in optical and electrical domains is presented. Considering the recent advances in CMOS (complementary metal–oxide–semiconductor) technologies and the feasibility of performing on-chip signal processing, important practical issues in the implementation of CS in CMOS sensors are emphasized. In addition, the CS coding for video capture is discussed.

[1]  Qiyin Fang,et al.  CMOS imaging for biomedical applications , 2008, IEEE Potentials.

[2]  Aydogan Ozcan,et al.  Lensless wide-field fluorescent imaging on a chip using compressive decoding of sparse objects , 2010, Optics express.

[3]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[4]  Dennis W Prather,et al.  Experimental demonstration of an optical-sectioning compressive sensing microscope (CSM). , 2010, Optics express.

[5]  R. Genov,et al.  Focal-Plane Algorithmically-Multiplying CMOS Computational Image Sensor , 2009, IEEE Journal of Solid-State Circuits.

[6]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[7]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[8]  V. Gruev,et al.  Low Power Programmable Current Mode Computational Imaging Sensor , 2012, IEEE Sensors Journal.

[9]  Jianwei Ma,et al.  Compressed Sensing for Surface Characterization and Metrology , 2010, IEEE Transactions on Instrumentation and Measurement.

[10]  Shahram Shirani,et al.  Compressive sensing with modified Total Variation minimization algorithm , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[12]  Rebecca Willett,et al.  Compressive coded aperture video reconstruction , 2008, 2008 16th European Signal Processing Conference.

[13]  Frédéric Lesage,et al.  The Application of Compressed Sensing for , 2009 .

[14]  Mark A Neifeld,et al.  Feature-specific structured imaging. , 2006, Applied optics.

[15]  R. Fergus,et al.  Random Lens Imaging , 2006 .

[16]  Otmar Scherzer,et al.  Handbook of Mathematical Methods in Imaging , 2015, Handbook of Mathematical Methods in Imaging.

[17]  Adrian Basarab,et al.  Compressed sensing of ultrasound images: Sampling of spatial and frequency domains , 2010, 2010 IEEE Workshop On Signal Processing Systems.

[18]  Hengyong Yu,et al.  Compressed sensing based interior tomography , 2009, Physics in medicine and biology.

[19]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[20]  A. El Gamal,et al.  CMOS image sensors , 2005, IEEE Circuits and Devices Magazine.

[21]  Ashwin A. Wagadarikar,et al.  Single disperser design for coded aperture snapshot spectral imaging. , 2008, Applied optics.

[22]  David V. Anderson,et al.  Compressive Sensing on a CMOS Separable-Transform Image Sensor , 2010, Proceedings of the IEEE.

[23]  P. K. Basu,et al.  Silicon Photonics: Fundamentals and Devices , 2012 .

[24]  E.J. Candes.  Compressive Sampling , 2022 .

[25]  Wai Lam Chan,et al.  A single-pixel terahertz imaging system based on compressed sensing , 2008 .

[26]  Rebecca Willett,et al.  Compressive coded aperture superresolution image reconstruction , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Babak Hassibi,et al.  Recovering Sparse Signals Using Sparse Measurement Matrices in Compressed DNA Microarrays , 2008, IEEE Journal of Selected Topics in Signal Processing.

[28]  Xiaolin Wu,et al.  High frame rate video capture by multiple cameras with coded exposure , 2010, 2010 IEEE International Conference on Image Processing.

[29]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[30]  Jeffrey B. Sampsell,et al.  Digital micromirror device and its application to projection displays , 1994 .

[31]  Tolga Çukur,et al.  Signal Compensation and Compressed Sensing for Magnetization-Prepared MR Angiography , 2011, IEEE Transactions on Medical Imaging.

[32]  Qiyin Fang,et al.  CMOS Image Sensors for High Speed Applications , 2009, Sensors.

[33]  Laurent Jacques,et al.  A (256×256) pixel 76.7mW CMOS imager/ compressor based on real-time In-pixel compressive sensing , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[34]  J. Romberg.  Imaging via Compressive Sampling [Introduction to compressive sampling and recovery via convex programming] , 2008 .

[35]  Pascal Frossard,et al.  Ultrasound tomography with learned dictionaries , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[36]  Alin Achim,et al.  Compressive sensing for ultrasound RF echoes using a-Stable Distributions , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[37]  M. Deen,et al.  CMOS photodetector systems for low-level light applications , 2009 .

[38]  E. Sidky,et al.  Image reconstruction in circular cone-beam computed tomography by constrained, total-variation minimization , 2008, Physics in medicine and biology.

[39]  Qiyin Fang,et al.  CMOS Active-Pixel Sensor With In-Situ Memory for Ultrahigh-Speed Imaging , 2011, IEEE Sensors Journal.

[40]  E E Fenimore,et al.  New family of binary arrays for coded aperture imaging. , 1989, Applied optics.

[41]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[42]  Jie Tang,et al.  Prior image constrained compressed sensing (PICCS): a method to accurately reconstruct dynamic CT images from highly undersampled projection data sets. , 2008, Medical physics.

[43]  Qiyin Fang,et al.  Toward a Miniaturized Wireless Fluorescence-Based Diagnostic Imaging System , 2008, IEEE Journal of Selected Topics in Quantum Electronics.

[44]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[45]  Henry Arguello,et al.  Spatial super-resolution in code aperture spectral imaging , 2012, Defense + Commercial Sensing.

[46]  Amine Bermak,et al.  Compressive Acquisition CMOS Image Sensor: From the Algorithm to Hardware Implementation , 2010, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[47]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[48]  Shu Wang,et al.  Adaptive Sparsity Matching Pursuit Algorithm for Sparse Reconstruction , 2012, IEEE Signal Processing Letters.

[49]  M. Deen,et al.  CMOS-Based Active Pixel for Low-Light-Level Detection: Analysis and Measurements , 2007, IEEE Transactions on Electron Devices.

[50]  G. Blelloch.  Introduction to Data Compression * , 2022 .

[51]  Kun Liu,et al.  CMOS low data rate imaging method based on compressed sensing , 2012 .

[52]  Deanna Needell,et al.  Signal Recovery From Incomplete and Inaccurate Measurements Via Regularized Orthogonal Matching Pursuit , 2007, IEEE Journal of Selected Topics in Signal Processing.

[53]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[54]  Vasilis Ntziachristos,et al.  Guest Editorial Compressive Sensing for Biomedical Imaging , 2011, IEEE Trans. Medical Imaging.

[55]  Thomas Strohmer,et al.  High-Resolution Radar via Compressed Sensing , 2008, IEEE Transactions on Signal Processing.

[56]  Massimo Fornasier,et al.  Compressive Sensing , 2015, Handbook of Mathematical Methods in Imaging.

[57]  E. Candès.  The restricted isometry property and its implications for compressed sensing , 2008 .

[58]  Robert Pless,et al.  Compressive sensing and differential image-motion estimation , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[59]  Amine Bermak,et al.  Block-based compressive sampling for digital pixel sensor array , 2010, 2nd Asia Symposium on Quality Electronic Design (ASQED).

[60]  Aswin C. Sankaranarayanan,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[61]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[62]  Laurent Jacques,et al.  CMOS compressed imaging by Random Convolution , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[63]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[64]  D. W. Prather,et al.  Compressive confocal microscopy: 3D reconstruction algorithms , 2009, MOEMS-MEMS.

[65]  Ali Cafer Gürbüz,et al.  A Compressive Sensing Data Acquisition and Imaging Method for Stepped Frequency GPRs , 2009, IEEE Transactions on Signal Processing.

[66]  A. Stern,et al.  Random Projections Imaging With Extended Space-Bandwidth Product , 2007, Journal of Display Technology.

[67]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[68]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[69]  Jean-Luc Starck,et al.  Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[70]  Olgica Milenkovic,et al.  Subspace Pursuit for Compressive Sensing Signal Reconstruction , 2008, IEEE Transactions on Information Theory.

[71]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[72]  Gert Cauwenberghs,et al.  An Active Pixel CMOS separable transform image sensor , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[73]  Abbas El Gamal,et al.  A 256×256 CMOS image sensor with ΔΣ-based single-shot compressed sensing , 2012, 2012 IEEE International Solid-State Circuits Conference.