Robust ENF Estimation Based on Harmonic Enhancement and Maximum Weight Clique

We present a framework for robust electric network frequency (ENF) extraction from real-world audio recordings, featuring multi-tone ENF harmonic enhancement and graph-based optimal harmonic selection. Specifically, We first extend the recently developed single-tone ENF signal enhancement method to the multi-tone scenario and propose a harmonic robust filtering algorithm (HRFA). It can respectively enhance each harmonic component without cross-component interference, thus further alleviating the effects of unwanted noise and audio content on the much weaker ENF signal. In addition, considering the fact that some harmonic components could be severely corrupted even after enhancement, disturbing rather than facilitating ENF estimation, we propose a graph-based harmonic selection algorithm (GHSA), which finds the optimal combination of harmonic components for more accurate ENF estimation. Noticeably, the harmonic selection problem is equivalently formulated as a maximum weight clique (MWC) problem in graph theory, and the Bron-Kerbosch algorithm (BKA) is adopted in the GHSA. With the enhanced and optimally selected harmonic components, both the existing maximum likelihood estimator (MLE) and weighted MLE (WMLE) are incorporated to yield the final ENF estimation results. The proposed framework is extensively evaluated using both synthetic signals and our ENF-WHU dataset consisting of $130$ real-world audio recordings, demonstrating substantially improved capability of extracting the ENF from realistically noisy observations over the existing single- and multi-tone competitors. This work further improves the applicability of the ENF as a forensic criterion in real-world situations.

[1]  Min Wu,et al.  Spectrum Combining for ENF Signal Estimation , 2013, IEEE Signal Processing Letters.

[2]  Mahmoud M. Elmesalawy,et al.  New Forensic ENF Reference Database for Media Recording Authentication Based on Harmony Search Technique Using GIS and Wide Area Frequency Measurements , 2014, IEEE Transactions on Information Forensics and Security.

[3]  A.G. Phadke,et al.  Power system frequency monitoring network (FNET) implementation , 2005, IEEE Transactions on Power Systems.

[4]  Haijian Zhang,et al.  ENF Signal Enhancement in Audio Recordings , 2020, IEEE Transactions on Information Forensics and Security.

[5]  Chau-Wai Wong,et al.  Invisible Geo-Location Signature in A Single Image , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Min Wu,et al.  Anti-Forensics and Countermeasures of Electrical Network Frequency Analysis , 2013, IEEE Transactions on Information Forensics and Security.

[7]  Luke Dosiek.  Extracting Electrical Network Frequency From Digital Recordings Using Frequency Demodulation , 2015, IEEE Signal Processing Letters.

[8]  José Antonio Apolinário,et al.  Edit Detection in Speech Recordings via Instantaneous Electric Network Frequency Variations , 2014, IEEE Transactions on Information Forensics and Security.

[9]  Vrizlynn L. L. Thing,et al.  A Dynamic Matching Algorithm for Audio Timestamp Identification Using the ENF Criterion , 2014, IEEE Transactions on Information Forensics and Security.

[10]  Mohamed-Slim Alouini,et al.  A Tutorial on Clique Problems in Communications and Signal Processing , 2018, Proceedings of the IEEE.

[11]  Shlomo Dubnov,et al.  Maximum a-posteriori probability pitch tracking in noisy environments using harmonic model , 2004, IEEE Transactions on Speech and Audio Processing.

[12]  Hyeran Byun,et al.  A Space-Time Graph Optimization Approach Based on Maximum Cliques for Action Detection , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Adi Hajj-Ahmad,et al.  ENF-Based Region-of-Recording Identification for Media Signals , 2015, IEEE Transactions on Information Forensics and Security.

[14]  Ying Zhang,et al.  Time-of-recording estimation for audio recordings , 2017 .

[15]  Chang-Tsun Li,et al.  Audio Forgery Detection Based on Max Offsets for Cross Correlation between ENF and Reference Signal , 2012, IWDW.

[16]  Yilu Liu,et al.  Source Location Identification of Distribution-Level Electric Network Frequency Signals at Multiple Geographic Scales , 2017, IEEE Access.

[17]  Xiangui Kang,et al.  Robust Electric Network Frequency Estimation with Rank Reduction and Linear Prediction , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[18]  Min Wu,et al.  “Seeing” ENF: Power-Signature-Based Timestamp for Digital Multimedia via Optical Sensing and Signal Processing , 2013, IEEE Transactions on Information Forensics and Security.

[19]  Johan Karlsson,et al.  ENF Extraction From Digital Recordings Using Adaptive Techniques and Frequency Tracking , 2012, IEEE Transactions on Information Forensics and Security.

[20]  Haijian Zhang,et al.  Robust time-varying filtering and separation of some nonstationary signals in low SNR environments , 2015, Signal Process..

[21]  Adi Hajj-Ahmad,et al.  Instantaneous frequency estimation and localization for ENF signals , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[22]  Fernando Pérez-González,et al.  Temporal Localization of Non-Static Digital Videos Using the Electrical Network Frequency , 2020, IEEE Signal Processing Letters.

[23]  João Paulo Carvalho Lustosa da Costa,et al.  ESPRIT-Hilbert-Based Audio Tampering Detection With SVM Classifier for Forensic Analysis via Electrical Network Frequency , 2017, IEEE Transactions on Information Forensics and Security.

[24]  Nasir D. Memon,et al.  Analysis of Rolling Shutter Effect on ENF-Based Video Forensics , 2019, IEEE Transactions on Information Forensics and Security.

[25]  Daniel Patricio Nicolalde Rodríguez,et al.  Audio Authenticity: Detecting ENF Discontinuity With High Precision Phase Analysis , 2010, IEEE Transactions on Information Forensics and Security.

[26]  Dechang Pi,et al.  Brain EEG Time-Series Clustering Using Maximum-Weight Clique , 2020, IEEE Transactions on Cybernetics.

[27]  Yang Li,et al.  Natural Timestamps in Powerline Electromagnetic Radiation , 2018, ACM Trans. Sens. Networks.

[28]  Yilu Liu,et al.  An Improved Discrete Fourier Transform-Based Algorithm for Electric Network Frequency Extraction , 2013, IEEE Transactions on Information Forensics and Security.

[29]  Min Wu,et al.  Modeling and analysis of Electric Network Frequency signal for timestamp verification , 2012, 2012 IEEE International Workshop on Information Forensics and Security (WIFS).

[30]  Ying Zhang,et al.  Audio Authentication by Exploring the Absolute-Error-Map of ENF Signals , 2016, IEEE Transactions on Information Forensics and Security.

[31]  Adi Hajj-Ahmad,et al.  Exploiting Power Signatures for Camera Forensics , 2016, IEEE Signal Processing Letters.

[32]  Guang Hua,et al.  Error Analysis of Forensic ENF Matching , 2018, 2018 IEEE International Workshop on Information Forensics and Security (WIFS).

[33]  Adi Hajj-Ahmad,et al.  ENF analysis on recaptured audio recordings , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[34]  Guoan Bi,et al.  On Practical Issues of Electric Network Frequency Based Audio Forensics , 2017, IEEE Access.

[35]  Asaf Cohen,et al.  Electrical Network Frequency (ENF) Maximum-Likelihood Estimation Via a Multitone Harmonic Model , 2013, IEEE Transactions on Information Forensics and Security.

[36]  Alan J. Cooper.  An automated approach to the Electric Network Frequency (ENF) criterion - Theory and practice , 2010 .

[37]  Yilu Liu,et al.  Application of Power System Frequency for Digital Audio Authentication , 2012, IEEE Transactions on Power Delivery.

[38]  Nasir Memon,et al.  Detecting the Presence of ENF Signal in Digital Videos: A Superpixel-Based Approach , 2017, IEEE Signal Processing Letters.

[39]  Yilu Liu,et al.  Tampering Detection of Digital Recordings Using Electric Network Frequency and Phase Angle , 2013 .

[40]  Chau-Wai Wong,et al.  Factors Affecting ENF Capture in Audio , 2019, IEEE Transactions on Information Forensics and Security.

[41]  Yong Liu,et al.  Wide-area measurement system development at the distribution level: An FNET/GridEye example , 2016, 2016 IEEE Power and Energy Society General Meeting (PESGM).