Detection of Electric Network Frequency in Audio Recordings–From Theory to Practical Detectors

Recently, it has been discovered that the electric network frequency (ENF) could be captured by digital audio, video, or even image files, and could further be exploited in forensic investigations. However, the existence of the ENF in multimedia content is not a sure thing, and if the ENF is not present, ENF-based forensic analysis would become useless or even misleading. In this paper, we address the problem of ENF detection in digital audio recordings, which is modeled as the detection of a weak (ENF) signal contaminated by unknown colored wide-sense stationary (WSS) Gaussian noise, while the signal also contains multiple unknown random parameters. We first derive three Neyman-Pearson (NP) detectors, i.e., general matched filter (GMF), matched filter (MF)-like detector, and the asymptotic approximation of the GMF, and choose the MF-like detector as the clairvoyant detector. For practical detectors, we show that the generalized likelihood ratio test (GLRT) could not be efficiently obtained due to the unknown noise and large matrix inversion. Alternatively, we propose two least-squares (LS)-based time domain detectors termed as LS-likelihood ratio test (LRT) and naive-LRT. Further, we propose a time-frequency (TF) domain detector, termed as TF detector, which exploits the a priori knowledge of the ENF. The performances of the derived detectors are extensively analyzed in terms of test statistic distributions, threshold selection, and computational complexity. The naive-LRT detector is found to be only effective for very short recordings. As the data recording length increases, both LS-LRT and TF detectors yield effective detection results, while the latter is approximately a constant false alarm rate (CFAR) detector. Practical experiments using real audio recordings justify the effectiveness of the proposed detectors and our analysis.

[1]  Min Wu,et al.  “Seeing” ENF: Power-Signature-Based Timestamp for Digital Multimedia via Optical Sensing and Signal Processing , 2013, IEEE Transactions on Information Forensics and Security.

[2]  Yilu Liu,et al.  Application of Power System Frequency for Digital Audio Authentication , 2012, IEEE Transactions on Power Delivery.

[3]  Chau-Wai Wong,et al.  Factors Affecting ENF Capture in Audio , 2019, IEEE Transactions on Information Forensics and Security.

[4]  Steven M. Kay,et al.  Optimal invariant detection of a sinusoid with unknown parameters , 2002, IEEE Trans. Signal Process..

[5]  João Paulo Carvalho Lustosa da Costa,et al.  ESPRIT-Hilbert-Based Audio Tampering Detection With SVM Classifier for Forensic Analysis via Electrical Network Frequency , 2017, IEEE Transactions on Information Forensics and Security.

[6]  Xiangui Kang,et al.  Robust Electric Network Frequency Estimation with Rank Reduction and Linear Prediction , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[7]  Daniel Patricio Nicolalde Rodríguez,et al.  Audio Authenticity: Detecting ENF Discontinuity With High Precision Phase Analysis , 2010, IEEE Transactions on Information Forensics and Security.

[8]  Chau-Wai Wong,et al.  Invisible Geo-Location Signature in A Single Image , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Min Wu,et al.  Spectrum Combining for ENF Signal Estimation , 2013, IEEE Signal Processing Letters.

[10]  Yilu Liu,et al.  Source Location Identification of Distribution-Level Electric Network Frequency Signals at Multiple Geographic Scales , 2017, IEEE Access.

[11]  Yilu Liu,et al.  Tampering Detection of Digital Recordings Using Electric Network Frequency and Phase Angle , 2013 .

[12]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[13]  Andreas Jakobsson,et al.  Cisoid parameter estimation in the colored noise case: asymptotic Cramer-Rao bound, maximum likelihood, and nonlinear least-squares , 1997, IEEE Trans. Signal Process..

[14]  Asaf Cohen,et al.  Electrical Network Frequency (ENF) Maximum-Likelihood Estimation Via a Multitone Harmonic Model , 2013, IEEE Transactions on Information Forensics and Security.

[15]  Min Wu,et al.  Anti-Forensics and Countermeasures of Electrical Network Frequency Analysis , 2013, IEEE Transactions on Information Forensics and Security.

[16]  Min Wu,et al.  Modeling and analysis of Electric Network Frequency signal for timestamp verification , 2012, 2012 IEEE International Workshop on Information Forensics and Security (WIFS).

[17]  Guoan Bi,et al.  On Practical Issues of Electric Network Frequency Based Audio Forensics , 2017, IEEE Access.

[18]  Joseph M. Francos,et al.  Bounds for estimation of complex exponentials in unknown colored noise , 1995, IEEE Trans. Signal Process..

[19]  Petre Stoica,et al.  Statistical analysis of two nonlinear least-squares estimators of sine-wave parameters in the colored-noise case , 1989 .

[20]  Alan J. Cooper An automated approach to the Electric Network Frequency (ENF) criterion - Theory and practice , 2010 .

[21]  Guang Hua,et al.  Error Analysis of Forensic ENF Matching , 2018, 2018 IEEE International Workshop on Information Forensics and Security (WIFS).

[22]  Adi Hajj-Ahmad,et al.  Exploiting Power Signatures for Camera Forensics , 2016, IEEE Signal Processing Letters.

[23]  Chang-Tsun Li,et al.  Audio Forgery Detection Based on Max Offsets for Cross Correlation between ENF and Reference Signal , 2012, IWDW.

[24]  Yilu Liu,et al.  An Improved Discrete Fourier Transform-Based Algorithm for Electric Network Frequency Extraction , 2013, IEEE Transactions on Information Forensics and Security.

[25]  Sanjit K. Mitra,et al.  Digital Signal Processing: A Computer-Based Approach , 1997 .

[26]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[27]  Adi Hajj-Ahmad,et al.  ENF-Based Region-of-Recording Identification for Media Signals , 2015, IEEE Transactions on Information Forensics and Security.

[28]  Ying Zhang,et al.  Time-of-recording estimation for audio recordings , 2017 .

[29]  Nasir Memon,et al.  Detecting the Presence of ENF Signal in Digital Videos: A Superpixel-Based Approach , 2017, IEEE Signal Processing Letters.

[30]  Luke Dosiek Extracting Electrical Network Frequency From Digital Recordings Using Frequency Demodulation , 2015, IEEE Signal Processing Letters.

[31]  Ying Zhang,et al.  Audio Authentication by Exploring the Absolute-Error-Map of ENF Signals , 2016, IEEE Transactions on Information Forensics and Security.

[32]  José Antonio Apolinário,et al.  Edit Detection in Speech Recordings via Instantaneous Electric Network Frequency Variations , 2014, IEEE Transactions on Information Forensics and Security.

[33]  Vrizlynn L. L. Thing,et al.  A Dynamic Matching Algorithm for Audio Timestamp Identification Using the ENF Criterion , 2014, IEEE Transactions on Information Forensics and Security.

[34]  Johan Karlsson,et al.  ENF Extraction From Digital Recordings Using Adaptive Techniques and Frequency Tracking , 2012, IEEE Transactions on Information Forensics and Security.