Multimedia content analysis for consumer electronics

The last few years have seen an explosion not only in the amount of content produced but also in the amount of content available. However, while it is great that users can watch virtually anything they want, it becomes increasingly difficult to find content that is actually relevant to the user. This "curse" of content availability is very important for consumer electronic devices since they are as valuable as the value they add to a user's life: if the only thing they do is to increase exponentially the users' choices of what to watch, listen to or consume in any way, then they add, paradoxically, more complication to their lives. Content analysis can be used to help the user select what to watch and is thus essential in modern multimedia devices. However, there are technical and human restrictions to the technology developed for such devices. In this paper we discuss these restrictions and how they affect the work on content analysis done in an industrial research environment. We will present three case studies that show how these restrictions influence the choices made from the moment content analysis technology is designed, until the moment it is tested with users.

[1]  Shih-Fu Chang,et al.  Algorithms and system for segmentation and structure analysis in soccer video , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[2]  B. Zoetekouw,et al.  A fast and efficient highlight detector for soccer , 2008, 2008 Digest of Technical Papers - International Conference on Consumer Electronics.

[3]  Joseph V. Maschelli,et al.  The Five C's of Cinematography , 1965 .

[4]  M. Flynn,et al.  Highlight Scene Detection And Video Summarization for PVR-Enabled High-Definition Television Systems , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[5]  Wolfgang Effelsberg,et al.  Abstracting Digital Movies Automatically , 1996, J. Vis. Commun. Image Represent..

[6]  Nandan Parameswaran,et al.  Survey of Sports Video Analysis: Research Issues and Applications , 2003, VIP.

[7]  M. Barbieri,et al.  Browsing video recordings using movie-in-a-minute , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[8]  Gerard Hollemans User Satisfaction Measurement Methodolgies: Extending the User Satisfaction Questionnaire , 1999, HCI.

[9]  H. Zettl Sight, Sound, Motion: Applied Media Aesthetics , 1973 .

[10]  Riccardo Leonardi,et al.  Hidden Markov Models for Video Skim Generation , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[11]  Lie Lu,et al.  Highlight sound effects detection in audio stream , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).