User transparent parallel processing of the 2004 NIST TRECVID data set

The Parallel-Horus framework, developed at the University of Amsterdam, is a unique software architecture that allows non-expert parallel programmers to develop fully sequential multimedia applications for efficient execution on homogeneous Beowulf-type commodity clusters. Previously obtained results for realistic, but relatively small-sized applications have shown the feasibility of the Parallel-Horus approach, with parallel performance consistently being found to be optimal with respect to the abstraction level of message passing programs. In this paper we discuss the most serious challenge Parallel-Horus has had to deal with so far: the processing of over 184 hours of video included in the 2004 NIST TRECVID evaluation, i.e. the de facto international standard benchmark for content-based video retrieval. Our results and experiences confirm that Parallel-Horus is a very powerful support-tool for state-of-the-art research and applications in multimedia processing.

[1]  Dennis Koelma,et al.  User transparency: a fully sequential programming model for efficient data parallel image processing: Research Articles , 2004 .

[2]  Andrew D. Bagdanov.  Style characterization of machine printed texts , 2004 .

[3]  Dennis Koelma,et al.  P-3PC: A Point-to-Point Communication Model for Automatic and Optimal Decomposition of Regular Domain Problems , 2002, IEEE Trans. Parallel Distributed Syst..

[4]  Jon A. Webb.  Implementation and performance of fast parallel multi-baseline stereo vision , 1993, 1993 Computer Architectures for Machine Perception.

[5]  Tobun Dorbin Ng,et al.  Informedia at TRECVID 2003 : Analyzing and Searching Broadcast News Video , 2003, TRECVID.

[6]  Dennis Koelma,et al.  User transparency: a fully sequential programming model for efficient data parallel image processing , 2004, Concurr. Pract. Exp..

[7]  Danny Crookes,et al.  A PVM Implementation of a Portable Parallel Image Processing Library , 1996, PVM.

[8]  Dennis Koelma,et al.  The MediaMill TRECVID 2008 Semantic Video Search Engine , 2008, TRECVID.

[9]  Robert L. Stevenson,et al.  Toolkit for parallel image processing , 1998, Optics & Photonics.

[10]  Arnold W. M. Smeulders,et al.  Color Invariance , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Cristina Nicolescu,et al.  EASY-PIPE - An "Easy to use" parallel image processing environment based on algorithmic skeletons , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[12]  Mounir Hamdi,et al.  Parallel Image Processing Applications on a Network of Workstations , 1995, Parallel Comput..

[13]  Arjan J. C. van Gemund,et al.  Spar: A Programming Language for Semi-Automatic Compilation of Parallel Programs , 1997, Concurr. Pract. Exp..

[14]  Srinivas Nedunuri.  The functional approach to programming , 2000, SOEN.

[15]  Juan Li,et al.  A software environment for parallel computer vision , 1992, Computer.

[16]  Rin-ichiro Taniguchi,et al.  Software platform for parallel image processing and computer vision , 1997, Optics & Photonics.

[17]  Danny Crookes,et al.  IAL: a parallel image processing programming language , 1990 .

[18]  Takeo Kanade,et al.  A multiple-baseline stereo , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Danny Crookes,et al.  Efficient implementation of a portable parallel programming model for image processing , 1999, Concurr. Pract. Exp..

[20]  Joseph N. Wilson,et al.  Handbook of computer vision algorithms in image algebra , 1996 .

[21]  Dennis Koelma,et al.  Finite state machine-based optimization of data parallel regular domain problems applied in low-level image processing , 2004, IEEE Transactions on Parallel and Distributed Systems.

[22]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[23]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Dennis Koelma,et al.  A software architecture for user transparent parallel image processing , 2002, Parallel Comput..

[25]  Rin-ichiro Taniguchi,et al.  Real-time image processing on IEEE1394-based PC cluster , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[26]  John R. Smith,et al.  IBM Research TRECVID-2009 Video Retrieval System , 2009, TRECVID.

[27]  Cherri M. Pancake,et al.  Do parallel languages respond to the needs of scientific programmers? , 1990, Computer.

[28]  Peter M. A. Sloot,et al.  The distributed ASCI Supercomputer project , 2000, OPSR.

[29]  Marcel Worring,et al.  Multimodal Video Indexing : A Review of the State-ofthe-art , 2001 .