Object Tracking and Classification in Videos Using Compressive Measurements

In this paper, we summarize some recent results on objective tracking and classification in infrared and low quality videos using compressive measurements. Two compressive measurement modes were investigated. One was based on subsampling of the original measurements. The other was based on coded aperture camera. It is important to emphasize that conventional trackers require the compressive measurements be reconstructed first before any tracking and classification processing steps begin. The reconstruction is time-consuming and may also lose information. Our proposed approach directly uses compressive measurements and a deep learning tracker known as You Only Look Once (YOLO), which is fast and can track multiple objects simultaneously, was used to track objects. The detected objects are then recognized using another deep learning model called residual network (ResNet). Extensive experiments using infrared videos from long distances were conducted. Results show that the proposed approach performs much better than conventional trackers, which failed to deal with compressive measurements. Instead, ResNet classifier performs better than the built-in classifier in YOLO.

[1]  Chiman Kwan,et al.  Compressive Vehicle Tracking Using Deep Learning , 2018, 2018 9th IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON).

[2]  Luca Bertinetto,et al.  Staple: Complementary Learners for Real-Time Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ralph Etienne-Cummings,et al.  Target tracking and classification using compressive sensing camera for SWIR videos , 2019, Signal, Image and Video Processing.

[4]  Chiman Kwan,et al.  Deep Learning Based Target Tracking and Classification Directly in Compressive Measurement for Low Quality Videos , 2019, Signal & Image Processing : An International Journal.

[5]  Chiman Kwan,et al.  A Comparative Study of Conventional and Deep Learning Target Tracking Algorithms for Low Quality Videos , 2018, ISNN.

[6]  Baoxin Li,et al.  Efficient anomaly detection algorithms for summarizing low quality videos , 2018, Defense + Security.

[7]  Ralph Etienne-Cummings,et al.  Deep Learning-Based Target Tracking and Classification for Low Quality Videos Using Coded Aperture Cameras , 2019, Sensors.

[8]  Chiman Kwan,et al.  Anomaly detection in low quality traffic monitoring videos using optical flow , 2018, Defense + Security.

[9]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[10]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Chiman Kwan,et al.  Tracking of Multiple Pixel Targets Using Multiple Cameras , 2018, ISNN.

[12]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[13]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Chiman Kwan,et al.  Comparison of several ballistic target tracking filters , 2006, 2006 American Control Conference.

[15]  Chiman Kwan,et al.  The development of a video browsing and video summary review tool , 2018, Defense + Security.

[16]  Chiman Kwan,et al.  Compressive object tracking and classification using deep learning for infrared videos , 2019, Defense + Commercial Sensing.

[17]  Jie Zhang,et al.  Compact all-CMOS spatiotemporal compressive sensing video camera with pixel-wise coded exposure. , 2016, Optics express.

[18]  A. Doulamis,et al.  Multimodal Data Fusion for Effective Surveillance of Critical Infrastructure , 2017 .

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Ralph Etienne-Cummings,et al.  Target Tracking and Classification Using Compressive Measurements of MWIR and LWIR Coded Aperture Cameras , 2019, Journal of Signal and Information Processing.

[21]  Genshe Chen,et al.  IMM-LMMSE filtering algorithm for ballistic target tracking with unknown ballistic coefficient , 2006, SPIE Defense + Commercial Sensing.

[22]  A. Berg,et al.  Detection and Tracking in Thermal Infrared Imagery , 2016 .