Fast tracking of moving objects using single-pixel imaging

Abstract Successive images of a scene are captured and then further processed to achieve the moving object tracking. However, due to modulation rate limitations of the spatial light modulator in single-pixel imaging (SPI) system, the imaging frame rate cannot meet the high-resolution and real-time requirements for object tracking. In this paper, we demonstrate a fast object tracking technique based on SPI with an ultra-low sampling rate that is independent of imaging. We construct modulation information that satisfies the projection conditions and can transform 2D images into 1D projection curves. The 1D projection curves, which provide the location information of the moving object, can be obtained with high resolution in real-time, and then the tracking of the moving object is realized. A background subtraction technique for tracking moving objects that removes static components from a scene is also proposed. The proposed technique is verified by computational simulations and laboratory experiments. In the laboratory experiments, we demonstrate that the proposed method can be used to track moving objects with less than 0.2% of the measurements established by the Nyquist criterion, and it presents 256 × 256 pixels at ∼ 177 fps. The reported technique accelerates the tracking speed of SPI and provides an efficient strategy for remote sensing and biomedical applications.

[1]  Graham M. Gibson,et al.  Single-pixel three-dimensional imaging with time-based depth resolution , 2016, Nature Communications.

[2]  Minghua Chen,et al.  Fast time-lens-based line-scan single-pixel camera with multi-wavelength source. , 2015, Biomedical optics express.

[3]  Enrong Li,et al.  Ghost imaging of a moving target with an unknown constant speed , 2014 .

[4]  Shree K. Nayar,et al.  Efficient Space-Time Sampling with Pixel-Wise Coded Exposure for High-Speed Imaging , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Rafał Kotyński,et al.  Real-time single-pixel video imaging with Fourier domain regularization. , 2018, Optics express.

[6]  Zibang Zhang,et al.  Fast Fourier single-pixel imaging via binary illumination , 2017, Scientific Reports.

[7]  Bingjie Xu,et al.  Adaptive regional single-pixel imaging based on the Fourier slice theorem. , 2017, Optics express.

[8]  M. Padgett,et al.  Real-time imaging of methane gas leaks using a single-pixel camera. , 2017, Optics express.

[9]  Daniel J. Lum,et al.  Photon counting compressive depth mapping , 2013, Optics express.

[10]  Ying-jian Wang,et al.  Polarimetric ghost imaging. , 2014, Optics letters.

[11]  Miles J. Padgett,et al.  A Russian Dolls ordering of the Hadamard basis for compressive single-pixel imaging , 2017, Scientific Reports.

[12]  Jeffrey H. Shapiro,et al.  Computational ghost imaging , 2008, 2009 Conference on Lasers and Electro-Optics and 2009 Conference on Quantum electronics and Laser Science Conference.

[13]  Graham M Gibson,et al.  Improving the signal-to-noise ratio of single-pixel imaging using digital microscanning. , 2016, Optics express.

[14]  Robert W. Boyd,et al.  Compressive Object Tracking using Entangled Photons , 2013 .

[15]  O. Katz,et al.  Compressive ghost imaging , 2009, 0905.0321.

[16]  Wen-Kai Yu,et al.  Compressive moving target tracking with thermal light based on complementary sampling , 2015 .

[17]  Robert W. Boyd,et al.  Imaging with a small number of photons , 2014, Nature Communications.

[18]  M. Padgett,et al.  3D Computational Imaging with Single-Pixel Detectors , 2013, Science.

[19]  Graham M. Gibson,et al.  Simultaneous real-time visible and infrared video with single-pixel detectors , 2015, Scientific Reports.

[20]  A. Gatti,et al.  Ghost imaging with thermal light: comparing entanglement and classical correlation. , 2003, Physical review letters.

[21]  Wen Chen,et al.  1000 fps computational ghost imaging using LED-based structured illumination. , 2018, Optics express.

[22]  Aristide Dogariu,et al.  Tracking hidden objects using stochastic probing , 2017 .

[23]  Guihua Zeng,et al.  Lensless ghost imaging for moving objects , 2011 .

[24]  Liu Dong,et al.  Polarization-multiplexing ghost imaging , 2018 .

[25]  N. Tian,et al.  Fluorescence ghost imaging with pseudothermal light. , 2011, Optics letters.

[26]  E Tajahuerce,et al.  Signal-to-noise ratio of single-pixel cameras based on photodiodes. , 2018, Applied optics.

[27]  Roderick Murray-Smith,et al.  Deep learning for real-time single-pixel video , 2018, Scientific Reports.

[28]  P. Clemente,et al.  Computational imaging with a balanced detector , 2016, Scientific Reports.

[29]  Paul C. Beard,et al.  Single-pixel optical camera for video rate ultrasonic imaging , 2016 .

[30]  Rafal Kotynski,et al.  Compressive phase-only filtering at extreme compression rates , 2016, 1604.07751.

[31]  S M Mahdi Khamoushi,et al.  Sinusoidal ghost imaging. , 2015, Optics letters.

[32]  Dongfeng Shi,et al.  Multispectral computational ghost imaging with multiplexed illumination , 2017 .

[33]  Graham M. Gibson,et al.  3D single-pixel video , 2016 .

[34]  V. Damian,et al.  Single pixel sensing for THz laser beam profiler based on Hadamard Transform , 2016 .

[35]  Mingjie Sun,et al.  Adaptive foveated single-pixel imaging with dynamic supersampling , 2016, Science Advances.

[36]  Alberto Tosi,et al.  Photon-sparse microscopy: Visible light imaging using infrared illumination , 2015 .

[37]  Wen Chen,et al.  Object authentication in computational ghost imaging with the realizations less than 5% of Nyquist limit. , 2013, Optics letters.