Hyper Media News: a fully automated platform for large scale analysis, production and distribution of multimodal news content

This paper describes Hyper Media News (HMNews), a system for the automated aggregation and consumption of information streams from digital television and the Internet. TV newscasts are automatically segmented, annotated and indexed. Such information is then integrated with those available from Internet blogs, newspapers and press agencies. The end result is a set of innovative information services that supplies retrieval, recommendation and browsing of multi-modal news items across different production paradigms, ranging from traditional professional media, e.g. television and press, to new user-centric media platforms such as social networking sites, internet forums and blogs.

[1]  James Allan,et al.  Topic detection and tracking: event-based information organization , 2002 .

[2]  Ron Bekkerman,et al.  Multi-modal Clustering for Multimedia Collections , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Mario Vento,et al.  Unsupervised News Video Segmentation by Combined Audio-Video Analysis , 2006, MRCS.

[4]  Jean-Gabriel Ganascia,et al.  Information fusion in a TV program recommendation system , 2008, 2008 11th International Conference on Information Fusion.

[5]  Jiahui Liu,et al.  Personalized news recommendation based on click behavior , 2010, IUI '10.

[6]  Yasufumi Takama,et al.  Profile Generation for TV Program Recommendation Based on Utterance Analysis , 2009, J. Adv. Comput. Intell. Intell. Informatics.

[7]  Werner Bailer,et al.  Deliverable D15.3 Mds3 State of the Art of Content Analysis Tools for Video, Audio and Speech , 2022 .

[8]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[9]  Hugh E. Williams,et al.  RMIT University at TRECVID 2004 , 2004, TRECVID.

[10]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[11]  Richard Chbeir,et al.  Relating RSS News/Items , 2009, ICWE.

[12]  Dimitrios Gunopulos,et al.  Locally adaptive metrics for clustering high dimensional data , 2007, Data Mining and Knowledge Discovery.

[13]  Omar Javed,et al.  University of Central Florida at TRECVID 2004 , 2003, TRECVID.

[14]  Keiichiro Hoashi,et al.  Shot Boundary Determination on MPEC Compressed Domain and Story Segmentation Experiments for TRECVID 2003 , 2003, TRECVID.

[15]  Fabio Brugnara,et al.  A system for the segmentation and transcription of Italian Audio News , 2000, RIAO.

[16]  Alan F. Smeaton,et al.  News story segmentation in the Fischlar video indexing system , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[17]  Hsin-Chia Fu,et al.  Constructing and Application of Multimedia TV News Archives , 2007, MCAM.

[18]  Alberto Messina,et al.  ANTS: A Complete System for Automatic News Programme Annotation Based on Multimodal Analysis , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[19]  Roberto Basili,et al.  RitroveRAI: A Web Application for Semantic Indexing and Hyperlinking of Multimedia News , 2005, SEMWEB.

[20]  Ronald P. S. Mahler,et al.  Statistical Multisource-Multitarget Information Fusion , 2007 .

[21]  Ah-Hwee Tan,et al.  A self-organizing neural model for multimedia information fusion , 2008, 2008 11th International Conference on Information Fusion.

[22]  Masanobu Abe,et al.  Personalized TV-program recommendations based on life log , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[23]  Xin Li,et al.  A novel clustering-based RSS aggregator , 2007, WWW '07.

[24]  Hideo Miyahara,et al.  A TV News Recommendation System with Automatic Recomposition , 1998, AMCP.

[25]  Grigorios Tsoumakas,et al.  An adaptive personalized news dissemination system , 2009, Journal of Intelligent Information Systems.

[26]  Shih-Fu Chang,et al.  Story boundary detection in large broadcast news video archives: techniques, experience and trends , 2004, MULTIMEDIA '04.

[27]  Alberto Messina,et al.  Use of Probabilistic Clusters Supports for Broadcast News Segmentation , 2008, 2008 19th International Workshop on Database and Expert Systems Applications.

[28]  Marie-Francine Moens,et al.  Finding the Best Picture: Cross-Media Retrieval of Content , 2008, ECIR.

[29]  Flavius Frasincar,et al.  Ontology-based news recommendation , 2010, EDBT '10.

[30]  Paul Over,et al.  Boundary Error Analysis and Categorization in the TRECVID News Story Segmentation Task , 2005, CIVR.

[31]  Mireia Farrús,et al.  Histogram Equalization in SVM Multimodal Person Verification , 2007, ICB.

[32]  Alberto Messina,et al.  A generalised cross-modal clustering method applied to multimedia news semantic indexing and retrieval , 2009, WWW '09.

[33]  Jérôme Gensel,et al.  CLIPS LIS LSR LABRI Experiments in TREC Video Retrieval 2004 , 2004 .

[34]  Jing Peng,et al.  Composite kernels for semi-supervised clustering , 2011, Knowledge and Information Systems.

[35]  Paul Deléglise,et al.  The LIUM speech transcription system: a CMU Sphinx III-based system for French broadcast news , 2005, INTERSPEECH.

[36]  Changsheng Xu,et al.  A Novel Framework for Semantic Annotation and Personalized Retrieval of Sports Video , 2008, IEEE Transactions on Multimedia.

[37]  Alberto Messina,et al.  Heterogeneous Data Co-Clustering by Pseudo-Semantic Affinity Functions , 2011, IIR.

[38]  Monika Henzinger,et al.  Query-Free News Search , 2003, WWW '03.

[39]  Somnath Banerjee,et al.  Clustering short texts using wikipedia , 2007, SIGIR.

[40]  Tobun Dorbin Ng,et al.  Informedia at TRECVID 2003 : Analyzing and Searching Broadcast News Video , 2003, TRECVID.

[41]  Paul Over,et al.  TRECVID 2004 - An Overview , 2004, TRECVID.

[42]  Georgios Paliouras,et al.  PNS: A Personalized News Aggregator on the Web , 2008 .

[43]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.