Video alignment for phylogenetic analysis

The possibility of studying multiple objects at once for forensic analysis has paved the way to the development of multimedia phylogeny algorithms. Concerning video phylogeny, a fundamental step at the base of many applications is multiple video alignment. This is, given a pool of near-duplicate video sequences partially overlapping in the temporal domain, find the relative time delay between all of them. As phylogeny methods typically takes into account huge quantities of data, the used alignment algorithms must be computationally efficient. In this paper, we propose a solution for multiple video alignment based on the minimisation of a least-square cost function. The proposed solution can be computed in closed form with reduced computational complexity. Moreover, we propose two possible solutions for refining the estimated alignment based on the removal of outlier measurements.

[1]  Paolo Bestagini,et al.  Video recapture detection based on ghosting artifact analysis , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Cordelia Schmid,et al.  Circulant Temporal Encoding for Video Retrieval and Temporal Alignment , 2015, International Journal of Computer Vision.

[3]  A. Piva,et al.  overview paper An overview on video forensics , 2012 .

[4]  Weihong Wang,et al.  Detecting Re-projected Video , 2008, Information Hiding.

[5]  Paolo Bestagini,et al.  Multiple compression detection for video sequences , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[6]  Lily Lee,et al.  Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Paolo Bestagini,et al.  Near-duplicate detection and alignment for multi-view videos , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[8]  R. Schmidt Least squares range difference location , 1996, IEEE Transactions on Aerospace and Electronic Systems.

[9]  Paolo Bestagini,et al.  Phylogeny reconstruction for misaligned and compressed video sequences , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[10]  David Vazquez-Padin,et al.  Localization of forgeries in MPEG-2 video through GOP size and DQ analysis , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[11]  Zi Huang,et al.  Efficient and Continuous Near-duplicate Video Detection , 2010, 2010 12th International Asia-Pacific Web Conference.

[12]  Paolo Bestagini,et al.  Who is my parent? Reconstructing video sequences from partially matching shots , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[13]  Anderson Rocha,et al.  Video Phylogeny: Recovering near-duplicate video relationships , 2011, 2011 IEEE International Workshop on Information Forensics and Security.

[14]  Davide Cozzolino,et al.  Video forgery detection and localization based on 3D patchmatch , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[15]  Pier Luigi Dragotti,et al.  Video jitter analysis for automatic bootleg detection , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[16]  Cordelia Schmid,et al.  Action Recognition with Improved Trajectories , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Paolo Bestagini,et al.  Local tampering detection in video sequences , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[18]  Paolo Bestagini,et al.  Codec and GOP Identification in Double Compressed Videos , 2016, IEEE Transactions on Image Processing.

[19]  Cordelia Schmid,et al.  Event Retrieval in Large Video Collections with Circulant Temporal Encoding , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  24th European Signal Processing Conference, EUSIPCO 2016, Budapest, Hungary, August 29 - September 2, 2016 , 2016, European Signal Processing Conference.

[21]  Kiriakos N. Kutulakos,et al.  Linear Sequence-to-Sequence Alignment , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Rabab Kreidieh Ward,et al.  A Robust and Fast Video Copy Detection System Using Content-Based Fingerprinting , 2011, IEEE Transactions on Information Forensics and Security.

[23]  David Vazquez-Padin,et al.  Detection of video double encoding with GOP size estimation , 2012, 2012 IEEE International Workshop on Information Forensics and Security (WIFS).