Automatic Frame-Cut Detection for Self-Diagnostics of Video Surveillance Systems

There are thousands of hours of digital video recorded everyday by surveillance cameras, dashboard cameras, police body cameras, that are often used as court evidence. These video recordings could have been edited before being archived and there is no easy way to know if they have been tampered with unless visually and carefully examined. A jump-cut could also be the result of faulty camera sensor, processing software failure, or transmission error. With the vast application span of security and surveillance cameras from banks, airports, borders, ports of entry, high value government properties such as embassies, it is important to have video security or surveillance system capable of self-diagnostics. In this research, we propose an automatic method that can examine video recordings and detect frame-cuts without any human intervention. Our algorithm could assist law enforcement, department of justice, department of home land security, customs and border protection, and other government agencies to examine thousands of hours of video recordings quickly and autonomously and produce the list of possible frame cuts with their timestamps.

[1]  Karen Panetta,et al.  Quality assessment of color images affected by transmission error, quantization noise, and noneccentricity pattern noise , 2015, 2015 IEEE International Symposium on Technologies for Homeland Security (HST).

[2]  Qiyong Lu,et al.  A universal hypercomplex color image quality index , 2012, 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings.

[3]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Albert A. Michelson,et al.  Studies in Optics , 1995 .

[5]  Karen Panetta,et al.  No-reference quality metrics for satellite weather images and sky images , 2017, 2017 IEEE International Symposium on Technologies for Homeland Security (HST).

[6]  Jaroslav Polec,et al.  An Efficient Method of Shot Cut Detection , 2012 .

[7]  Sos S. Agaian,et al.  No reference color image contrast and quality measures , 2013, IEEE Transactions on Consumer Electronics.

[8]  Jiying Zhao,et al.  An Image Quality Evaluation Method Based on Digital Watermarking , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Sos S. Agaian,et al.  Transform-based image enhancement algorithms with performance measure , 2001, IEEE Trans. Image Process..

[10]  Sos S. Agaian,et al.  TDMEC, a new measure for evaluating the image quality of color images acquired in vision systems , 2015, 2015 IEEE International Conference on Technologies for Practical Robot Applications (TePRA).

[11]  Hugh E. Williams,et al.  Video Cut Detection using Frame Windows , 2005, ACSC.

[12]  Sos S. Agaian,et al.  Human Visual System-Based Image Enhancement and Logarithmic Contrast Measure , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  A. Ferrero,et al.  Measurement uncertainty , 2006, IEEE Instrumentation & Measurement Magazine.

[14]  Sos S. Agaian,et al.  Parameterized Logarithmic Framework for Image Enhancement , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Alfredo Paolillo,et al.  Metrological Characterization of a Vision-Based Measurement System for the Online Inspection of Automotive Rubber Profile , 2009, IEEE Transactions on Instrumentation and Measurement.

[16]  Sos S. Agaian,et al.  Human visual system based similarity metrics , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[17]  Karen Panetta,et al.  Contrast enhancement for color images using discrete cosine transform coefficient scaling , 2016, 2016 IEEE Symposium on Technologies for Homeland Security (HST).

[18]  De Xu,et al.  Measurement and Defect Detection of the Weld Bead Based on Online Vision Inspection , 2010, IEEE Transactions on Instrumentation and Measurement.

[19]  Karen Panetta,et al.  A Robust No-Reference, No-Parameter, Transform Domain Image Quality Metric for Evaluating the Quality of Color Images , 2018, IEEE Access.

[20]  Sos S. Agaian,et al.  Transform Coefficient Histogram-Based Image Enhancement Algorithms Using Contrast Entropy , 2007, IEEE Transactions on Image Processing.

[21]  Sos S. Agaian,et al.  No reference color image quality measures , 2013, 2013 IEEE International Conference on Cybernetics (CYBCO).

[22]  Karen Panetta,et al.  A video forensic technique for detecting frame integrity using human visual system-inspired measure , 2017, 2017 IEEE International Symposium on Technologies for Homeland Security (HST).

[23]  Sos S. Agaian,et al.  Choosing the Optimal Spatial Domain Measure of Enhancement for Mammogram Images , 2014, Int. J. Biomed. Imaging.

[24]  Karen Panetta,et al.  Transform domain measure of enhancement — TDME — For security imaging applications , 2013, 2013 IEEE International Conference on Technologies for Homeland Security (HST).