Dialogue-driven Search in Surveillance Videos

Video surveillance is a key tool for enabling security personnel to monitor complex and dangerous environments, and the access to the semantic content of surveillance video has become a challenging research area. In this paper we present a query-processing system for investigating human activities in surveillance videos. The interaction between the user and the system happens through a gesture-based dialogue, which implements a novel question-answering model to support users during the information-seeking process. We also present a visual interface devised to facilitate the query-specification

[1]  Andrzej Wiśniewski,et al.  The posing of questions , 1995 .

[2]  Edward A. Fox,et al.  Advanced feedback methods in information retrieval , 1985, J. Am. Soc. Inf. Sci..

[3]  Andreas Girgensohn,et al.  Interface Components for Monitoring Security Video , 2006 .

[4]  Andrzej Wiśniewski,et al.  The posing of questions : logical foundations of erotetic inferences , 1995 .

[5]  François Brémond,et al.  Video understanding for complex activity recognition , 2006, Machine Vision and Applications.

[6]  J. Hintikka.  Interrogative Logic as a General Theory of Reasoning , 1999 .

[7]  Michele Risi,et al.  A Multi-layer Parsing Strategy for On-line Recognition of Hand-drawn Diagrams , 2006, Visual Languages and Human-Centric Computing (VL/HCC'06).

[8]  Zhouyu Fu,et al.  Semantic-Based Surveillance Video Retrieval , 2007, IEEE Transactions on Image Processing.

[9]  Larry S. Davis,et al.  Background modeling and subtraction by codebook construction , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[10]  Douglas Walton,et al.  The Place of Dialogue Theory in Logic, Computer Science and Communication Studies , 2000, Synthese.

[11]  Ben Shneiderman,et al.  Interactively Exploring Hierarchical Clustering Results , 2002, Computer.

[12]  Rong Yan,et al.  Merging storyboard strategies and automatic retrieval for improving interactive video search , 2007, CIVR '07.

[13]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[14]  W. Eric L. Grimson,et al.  Answering Questions about Moving Objects in Surveillance Videos , 2003, New Directions in Question Answering.