Multimedia Analysis for Content Identification

Multimedia content identification methods create a compact bitstream representation of the underlying content that is robust against common signal processing operations while being sensitive to the content. The robustness and sensitivity of the bitstream representation are conflicting requirements. In this chapter, we examine three issues in the context of achieving the tradeoff between robustness and sensitivity. They are (i) the representation domain for content (spatial, time or transform), (ii) local versus global features in the representation domain, (iii) robust hash of features (the first two of these directly relate to multimedia content analysis). We review the algorithms proposed in literature with these three issues in mind. Finally, we present some applications of content identification technology that exist today in the market and discuss the remaining challenges for future applications.

[1]  Min Wu,et al.  Image hashing resilient to geometric and filtering operations , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[2]  Regunathan Radhakrishnan,et al.  Robust video fingerprints based on subspace embedding , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Peter N. Yianilos,et al.  Locally lifting the curse of dimensionality for nearest neighbor search (extended abstract) , 2000, SODA '00.

[4]  Changick Kim,et al.  Content-based image copy detection , 2003, Signal Process. Image Commun..

[5]  Regunathan Radhakrishnan,et al.  Content-based Video Signatures based on Projections of Difference Images , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[6]  Ton Kalker,et al.  A robust image fingerprinting system using the Radon transform , 2004, Signal Process. Image Commun..

[7]  Edith Cohen,et al.  Finding Interesting Associations without Support Pruning , 2001, IEEE Trans. Knowl. Data Eng..

[8]  Nasir D. Memon,et al.  Spatio–Temporal Transform Based Video Hashing , 2006, IEEE Transactions on Multimedia.

[9]  Shih-Fu Chang,et al.  A robust image authentication method distinguishing JPEG compression from malicious manipulation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[10]  Ramarathnam Venkatesan,et al.  New Iterative Geometric Methods for Robust Perceptual Image Hashing , 2001, Digital Rights Management Workshop.

[11]  Constantin Papaodysseus,et al.  On the automated recognition of seriously distorted musical recordings , 2001, IEEE Trans. Signal Process..

[12]  Ramarathnam Venkatesan,et al.  Robust image hashing , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[13]  Ramarathnam Venkatesan,et al.  A Perceptual Audio Hashing Algorithm: A Tool for Robust Audio Identification and Information Hiding , 2001, Information Hiding.

[14]  E. Batlle,et al.  Automatic Song Identification in Noisy Broadcast Audio , 2002 .

[15]  Vishal Monga,et al.  Robust and Secure Image Hashing via Non-Negative Matrix Factorizations , 2007, IEEE Transactions on Information Forensics and Security.

[16]  Ton Kalker,et al.  Visual hashing of digital video: applications and techniques , 2001, Optics + Photonics.

[17]  Shih-Fu Chang,et al.  A robust content based digital signature for image authentication , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[18]  Benoit M. Macq,et al.  A robust soft hash algorithm for digital image signature , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[19]  Jiri Fridrich,et al.  Robust hash functions for digital watermarking , 2000, Proceedings International Conference on Information Technology: Coding and Computing (Cat. No.PR00540).

[20]  Vishal Monga,et al.  Robust perceptual image hashing using feature points , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[21]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[22]  Shumeet Baluja,et al.  Audio Fingerprinting: Combining Computer Vision & Data Stream Processing , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[23]  Derek Hoiem,et al.  Computer vision for music identification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Jiwu Huang,et al.  Histogram-based image hashing scheme robust against geometric deformations , 2007, MM&Sec.

[25]  Vishal Monga,et al.  A clustering based approach to perceptual image hashing , 2006, IEEE Transactions on Information Forensics and Security.

[26]  Ingemar J. Cox,et al.  Audio Fingerprinting: Nearest Neighbor Search in High Dimensional Binary Spaces , 2005, J. VLSI Signal Process..

[27]  Nasir Memon,et al.  ROBUST AUDIO HASHING FOR CONTENT IDENTIFICATION , 2004 .

[28]  Chang Dong Yoo,et al.  Boosted Binary Audio Fingerprint Based on Spectral Subband Moments , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[29]  Ramarathnam Venkatesan,et al.  Robust perceptual image hashing via matrix invariants , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[30]  Jürgen Herre,et al.  AudioID: Towards Content-Based Identification of Audio Material , 2001 .

[31]  Parham Aarabi,et al.  Rotation Invariance in Images , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[32]  Regunathan Radhakrishnan,et al.  Audio Signature Extraction Based on Projections of Spectrograms , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[33]  Nasir D. Memon,et al.  Robust audio hashing for audio identification , 2004, 2004 12th European Signal Processing Conference.

[34]  Kannan Ramchandran,et al.  Dither-based secure image hashing using distributed coding , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[35]  Jesse D. Kornblum.  Identifying almost identical files using context triggered piecewise hashing , 2006, Digit. Investig..

[36]  M. Brand,et al.  Fast low-rank modifications of the thin singular value decomposition , 2006 .

[37]  Chun-Shien Lu,et al.  Robust mesh-based hashing for copy detection and tracing of images , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[38]  Shih-Hsuan Yang,et al.  Robust image hashing based on SPIHT , 2005, ITRE 2005. 3rd International Conference on Information Technology: Research and Education, 2005..

[39]  Ton Kalker,et al.  A Highly Robust Audio Fingerprinting System , 2002, ISMIR.

[40]  John C. Platt,et al.  Distortion discriminant analysis for audio fingerprinting , 2003, IEEE Trans. Speech Audio Process..