Multimedia Documentation Lab

In this paper we describe the Multimedia Documentation Lab (MDL), a system which is capable of processing vast amounts of data typically gathered from open sources in unstructured form and in diverse formats. A sequence of processing steps analyzing the audio, video and textual content of the input is carried out. The resulting output is made available for search and retrieval, analysis and visualization on a next generation media server. The system can serve as a search platform across open, closed or secured networks. MDL can be used as a tool for situational awareness, information sharing or risk assessment, allowing the integration of multimedia content into the analysis process of security relevant affairs.

[1]  Nobuyuki Yagi,et al.  Shot Boundary Detection at TRECVID 2007 , 2007, TRECVID.

[2]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[3]  Daben Liu,et al.  Fast speaker change detection for broadcast news transcription and indexing , 1999, EUROSPEECH.

[4]  Daben Liu,et al.  Online speaker clustering , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[5]  Long Nguyen,et al.  Multiple-Pass Search Strategies , 1996 .

[6]  Paul Over,et al.  The TREC-2002 Video Track Report , 2002, TREC.

[7]  Sanghoon Kim,et al.  Robust Face Recognition using AAM and Gabor Features , 2007 .

[8]  Richard M. Schwartz,et al.  Nymble: a High-Performance Learning Name-finder , 1997, ANLP.

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[10]  Craig A. Knoblock,et al.  Identifying Maps on the World Wide Web , 2008, GIScience.

[11]  Shaogang Gong,et al.  Dynamic Vision - From Images to Face Recognition , 2000 .

[12]  Rama Chellappa,et al.  Face Tracking and Recognition in Video , 2011, Handbook of Face Recognition.

[13]  Thomas Keays,et al.  Semantic Web for the Working Ontologist , 2008 .

[14]  Juan Chen,et al.  Determination of Shot Boundary in MPEG Videos for TRECVID 2007 , 2007, TRECVID.

[15]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[16]  Dunja Mladenic,et al.  Semantic Knowledge Management , 2009 .

[17]  Felix Stalder,et al.  Open Source Intelligence , 2002, First Monday.

[18]  Takeo Kanade,et al.  The Asymmetry of Image Registration and Its Application to Face Tracking , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jürgen Riedler,et al.  Fitting German into N-Gram Language Models , 2002, TSD.

[20]  Dunja Mladenic,et al.  Semantic Knowledge Management: Integrating Ontology Management, Knowledge Discovery, and Human Language Technologies , 2008 .