Performance evaluation of event detection solutions: the CREDS experience

In video surveillance projects, automatic and real-time event detection solutions are required to guarantee an efficient and cost-effective use of the infrastructure. Many solutions have been proposed to automatically detect a variety of events of interest. However, not all solutions and technologies may satisfy all the requirements of the surveillance scenario. For this reason, performance evaluation of existing event detection solutions becomes an important step in the deployment of video surveillance projects. In this paper, we propose a practical approach that aims at minimizing the ground truth generation problem and the expertise required to evaluate and compare the results by introducing specific requirements of specific event detection scenarios. This approach is believed to be applicable for an initial evaluation of candidate solutions to a specific surveillance scenario before more exhaustive tests in an integrated environment. The proposed method is under evaluation in the framework of the challenge of real-time event detection solutions (CREDS).

[1]  Sergio A. Velastin,et al.  A real time surveillance system for metropolitan railways , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[2]  Carlo S. Regazzoni,et al.  Automatic detection of dangerous events for underground surveillance , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[3]  Christophe Seyve Metro railway security algorithms with real world experience adapted to the RATP dataset , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[4]  Karl Schwerdt,et al.  Target segmentation and event detection at video-rate: the EAGLE project , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..