Facing Device Attribution Problem for Stabilized Video Sequences

A problem deeply investigated by multimedia forensics researchers is that of detecting which device has been used to capture a video. This enables us to trace down the owner of a video sequence, which proves extremely helpful to solve copyright infringement cases as well as to fight distribution of illicit material (e.g., child exploitation clips and terroristic threats). Currently, the most promising methods to tackle this task exploit unique noise traces left by camera sensors on acquired images. However, given the recent advancements in motion stabilization of video content, robustness of sensor pattern noise-based techniques is strongly hindered. Indeed, video stabilization introduces geometric transformations to video frames, thus making camera fingerprint estimation problematic with classical approaches. In this paper, we deal with the challenging problem of attributing stabilized videos to their recording device. Specifically, we propose: 1) a strategy to extract the characteristic fingerprint of a device, starting from either a set of images or stabilized video sequences and 2) a strategy to match a stabilized video sequence with a given fingerprint. The proposed methodology is tested on videos coming from a set of different smartphones, taken from the modern publicly available Vision Dataset. The conducted experiments also provide an interesting insight on the effect of modern smartphones video stabilization algorithms on specific video frames.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Irfan A. Essa,et al.  Calibration-free rolling shutter removal , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[3]  Michael Gleicher,et al.  Re-cinematography: Improving the camerawork of casual video , 2008, TOMCCAP.

[4]  Luisa Verdoliva,et al.  Blind PRNU-Based Image Clustering for Source Identification , 2017, IEEE Transactions on Information Forensics and Security.

[5]  Zeno J. M. H. Geradts,et al.  Source video camera identification for multiply compressed videos originating from YouTube , 2009, Digit. Investig..

[6]  Scott McCloskey,et al.  Confidence weighting for sensor fingerprinting , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Min Wu,et al.  Exploring compression effects for improved source camera identification using strongly compressed video , 2011, 2011 18th IEEE International Conference on Image Processing.

[8]  Kristin Norell,et al.  Identifying camcorders using noise patterns from video clips recorded with image stabilisation , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[9]  Michele Nappi,et al.  Secure User Authentication on Smartphones via Sensor and Face Recognition on Short Video Clips , 2017, GPC.

[10]  Enrico Magli,et al.  Compressed Fingerprint Matching and Camera Identification via Random Projections , 2015, IEEE Transactions on Information Forensics and Security.

[11]  David Jacobs,et al.  CTSR 2011-03 Digital Video Stabilization and Rolling Shutter Correction using Gyroscopes , 2011 .

[12]  Zeno Geradts,et al.  Source camera identification using Photo Response Non-Uniformity on WhatsApp , 2018, Digit. Investig..

[13]  Marco Fontani,et al.  VISION: a video and image dataset for source identification , 2017, EURASIP Journal on Information Security.

[14]  Miroslav Goljan,et al.  Digital camera identification from sensor pattern noise , 2006, IEEE Transactions on Information Forensics and Security.

[15]  Luisa Verdoliva,et al.  A Bayesian-MRF Approach for PRNU-Based Image Forgery Detection , 2014, IEEE Transactions on Information Forensics and Security.

[16]  Paolo Bestagini,et al.  Improving PRNU Compression Through Preprocessing, Quantization, and Coding , 2019, IEEE Transactions on Information Forensics and Security.

[17]  Mo Chen,et al.  Source digital camcorder identification using sensor photo response non-uniformity , 2007, Electronic Imaging.

[18]  Per-Erik Forssén,et al.  Efficient Video Rectification and Stabilisation for Cell-Phones , 2012, International Journal of Computer Vision.

[19]  Michael Gleicher,et al.  Content-preserving warps for 3D video stabilization , 2009, ACM Trans. Graph..

[20]  Roberto Caldelli,et al.  Dealing with video source identification in social networks , 2017, Signal Process. Image Commun..

[21]  Paolo Bestagini,et al.  Blind Detection and Localization of Video Temporal Splicing Exploiting Sensor-Based Footprints , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[22]  Mo Chen,et al.  Determining Image Origin and Integrity Using Sensor Noise , 2008, IEEE Transactions on Information Forensics and Security.

[23]  Matthias Kirchner,et al.  Patch-Based Desynchronization of Digital Camera Sensor Fingerprints , 2016, Media Watermarking, Security, and Forensics.

[24]  Paolo Bestagini,et al.  Forensic Camera Model Identification: Highlights from the IEEE Signal Processing Cup 2018 Student Competition [SP Competitions] , 2018, IEEE Signal Processing Magazine.

[25]  Irfan A. Essa,et al.  Auto-directed video stabilization with robust L1 optimal camera paths , 2011, CVPR 2011.

[26]  A. Piva,et al.  overview paper An overview on video forensics , 2012 .

[27]  비벡 크와트라,et al.  Cascaded camera motion estimation, rolling shutter detection, and camera shake detection for video stabilization , 2014 .

[28]  Prasant Mohapatra,et al.  Live Video Forensics: Source Identification in Lossy Wireless Networks , 2015, IEEE Transactions on Information Forensics and Security.

[29]  Nasir D. Memon,et al.  Source camera attribution using stabilized video , 2016, 2016 IEEE International Workshop on Information Forensics and Security (WIFS).

[30]  Jessica J. Fridrich,et al.  Camera identification from cropped and scaled images , 2008, Electronic Imaging.

[31]  Marco Fontani,et al.  A Hybrid Approach to Video Source Identification , 2017, ArXiv.

[32]  Nasir D. Memon,et al.  Video copy detection based on source device characteristics: a complementary approach to content-based methods , 2008, MIR '08.

[33]  Chang-Tsun Li Large-Scale Image Clustering Based on Camera Fingerprints , 2017, IEEE Transactions on Information Forensics and Security.