Text-based search using video speech transcripts is a popular approach for granular video retrieval at the shot or story level. However, misalignment of speech and visual tracks, speech transcription errors, and other characteristics of video content pose unique challenges for this video retrieval approach. In this paper, we explore several automatic query refinement methods to address these issues. We consider two query expansion methods based on pseudo-relevance feedback and one query refinement method based on semantic text annotation. We evaluate these approaches in the context of the TRECVID 2005 video retrieval benchmark using a baseline approach without any refinement. To improve robustness, we also consider a query-independent fusion approach. We show that this combined approach can outperform the baseline for most query topics, with improvements of up to 40%. We also show that query-dependent fusion approaches can potentially improve the results further, leading to 18-75% gains when tuned with optimal fusion parameters
[1]
Jennifer Chu-Carroll,et al.
IBM's PIQUANT II in TREC 2004
,
2004,
TREC.
[2]
Ellen M. Voorhees,et al.
Query expansion using lexical-semantic relations
,
1994,
SIGIR '94.
[3]
W. Bruce Croft,et al.
Query expansion using local and global document analysis
,
1996,
SIGIR '96.
[4]
Gerard Salton,et al.
The SMART Retrieval System—Experiments in Automatic Document Processing
,
1971
.
[5]
Dragomir R. Radev,et al.
Question-answering by predictive annotation
,
2000,
SIGIR '00.
[6]
John R. Smith,et al.
IBM Research TRECVID-2009 Video Retrieval System
,
2009,
TRECVID.
[7]
Shih-Fu Chang,et al.
Automatic discovery of query-class-dependent models for multimodal search
,
2005,
MULTIMEDIA '05.
[8]
Eitan Farchi,et al.
Automatic query wefinement using lexical affinities with maximal information gain
,
2002,
SIGIR '02.