CMOS approach to compressed-domain image acquisition.

A hardware implementation of a real-time compressed-domain image acquisition system is demonstrated. The system performs front-end computational imaging, whereby the inner product between an image and an arbitrarily-specified mask is implemented in silicon. The acquisition system is based on an intelligent readout integrated circuit (iROIC) that is capable of providing independent bias voltages to individual detectors, which enables implementation of spatial multiplication with any prescribed mask through a bias-controlled response-modulation mechanism. The modulated pixels are summed up in the image grabber to generate the compressed samples, namely aperture-coded coefficients, of an image. A rigorous bias-selection algorithm is presented to the readout circuit, which exploits the bias-dependent nature of the imager's responsivity. Proven functionality of the hardware in transform coding compressed image acquisition, silicon-level compressive sampling, in pixel nonuniformity correction and hardware-level implementation of region-based enhancement is demonstrated.

[1]  Sabu Emmanuel,et al.  Sensor Pattern Noise Estimation Using Probabilistically Estimated RAW Values , 2016, IEEE Signal Processing Letters.

[2]  E. Candes,et al.  11-magic : Recovery of sparse signals via convex programming , 2005 .

[3]  Hao Yu,et al.  An Ultra-Low Power CMOS Image Sensor with On-Chip Energy Harvesting and Power Management Capability , 2015, Sensors.

[4]  Y. Oike,et al.  Design and implementation of real-time 3-D image sensor with 640 /spl times/ 480 pixel resolution , 2004, IEEE Journal of Solid-State Circuits.

[5]  Gunhee Han,et al.  A 10b Column-wise Two-step Single-slope ADC for High-speed CMOS Image Sensor , 2007 .

[6]  Payman Zarkesh-Ha,et al.  Spatio-temporal tunable pixels for multi-spectral infrared imagers , 2013, 2013 IEEE 56th International Midwest Symposium on Circuits and Systems (MWSCAS).

[7]  Yong Woo Kim,et al.  Challenges of megapixel camera module assembly and test , 2005, Proceedings Electronic Components and Technology, 2005. ECTC '05..

[8]  A. Piva.  An Overview on Image Forensics , 2013 .

[9]  Murtaza Haider,et al.  Beyond the hype: Big data concepts, methods, and analytics , 2015, Int. J. Inf. Manag..

[10]  Caesar Kueh,et al.  CCD vs CMOS , 2008 .

[11]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[12]  Meng Sheng,et al.  Calibration-based NUC Method in Real-time Based on IRFPA , 2011 .

[13]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[14]  Max J. Schulz,et al.  Nonuniformity correction and correctability of infrared focal plane arrays , 1995, Defense, Security, and Sensing.

[15]  Majeed M. Hayat,et al.  Intelligent bias-selection method for computational imaging on a CMOS imager , 2016, 2016 IEEE Photonics Conference (IPC).

[16]  Richard G. Baraniuk,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[17]  Chao Zhang,et al.  An efficient fractal image coding algorithm using unified feature and DCT , 2009 .

[18]  Sergio N. Torres,et al.  Adaptive scene-based nonuniformity correction method for infrared-focal plane arrays , 2003, SPIE Defense + Commercial Sensing.

[19]  Joaquim Salvi,et al.  Review of CMOS image sensors , 2006, Microelectron. J..

[20]  Qionghai Dai,et al.  Models of Monocular and Binocular Visual Perception in Quality Assessment of Stereoscopic Images , 2016, IEEE Transactions on Computational Imaging.

[21]  Jeffrey B. Sampsell,et al.  Digital micromirror device and its application to projection displays , 1994 .

[22]  Sunetra K. Mendis,et al.  CMOS active pixel image sensor , 1994 .

[23]  Graham M. Gibson,et al.  Simultaneous real-time visible and infrared video with single-pixel detectors , 2015, Scientific Reports.

[24]  Abbas El Gamal,et al.  A 256×256 CMOS image sensor with ΔΣ-based single-shot compressed sensing , 2012, 2012 IEEE International Solid-State Circuits Conference.

[25]  Alan J. Cooper,et al.  Improved photo response non-uniformity (PRNU) based source camera identification. , 2013, Forensic science international.

[26]  N. Nakano,et al.  Digital Still Camera System For Megapixel CCD , 1998, International 1998 Conference on Consumer Electronics.

[27]  Paramvir Bahl,et al.  Energy characterization and optimization of image sensing toward continuous mobile vision , 2013, MobiSys '13.

[28]  E. Dereniak,et al.  Linear theory of nonuniformity correction in infrared staring sensors , 1993 .

[29]  John Daugman,et al.  High Confidence Visual Recognition of Persons by a Test of Statistical Independence , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[31]  Subhasis Saha,et al.  Image compression—from DCT to wavelets: a review , 2000, CROS.

[32]  Xiubao Sui,et al.  Scene-based nonuniformity correction algorithm based on interframe registration. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[33]  Duane S. Boning,et al.  Analysis and decomposition of spatial variation in integrated circuit processes and devices , 1997 .

[34]  K. Yonemoto,et al.  A CMOS image sensor with a simple fixed-pattern-noise-reduction technology and a hole accumulation diode , 2000, IEEE Journal of Solid-State Circuits.

[35]  Guillermo Sapiro,et al.  Coded aperture compressive temporal imaging , 2013, Optics express.

[36]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[37]  Guido Gerig,et al.  A brain tumor segmentation framework based on outlier detection , 2004, Medical Image Anal..

[38]  Charles A. Bouman,et al.  Model based iterative reconstruction for Bright Field electron tomography , 2013, Electronic Imaging.

[39]  Shahram Shirani,et al.  Compressive Sensing Image Sensors-Hardware Implementation , 2013, Sensors.

[40]  Marian Codreanu,et al.  Compressed acquisition and progressive reconstruction of multi-dimensional correlated data in wireless sensor networks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[41]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[42]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.