TR2006-018

Performance Evaluation of Event Detection Solutions: the CREDS experience
Citation: Zilani, F.; Velastin, S.; Porikli, F.; Marcenaro, L.; Kelliher, T.; Cavallaro, A.; Bruneaut, P., "Performance Evaluation of Event Detection Solutions: The CREDS Experience", IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 201-206, September 2005 (IEEE Xplore)
Date:September 2005
MERL Contact:Fatih Porikli

In video surveillance projects, automatic and real-time event detection solutions are required to guarantee an efficient and cost-effective use of the infrastructure. Many solutions have been proposed to automatically detect a variety of events of interest. However, not all solutions and technologies may satisfy all the requirements of the surveillance scenario. For this reason, performance evaluation of existing event detection solutions becomes an important step in the deployment of video surveillance projects.
In this paper, we propose a practical approach that aims at minimizing the ground truth generation problem and the expertise required to evaluate and compare the results by introducing specific requirements of specific event detection scenarios. This approach is believed to be applicable for an initial evaluation of candidate solutions to a specific surveillance scenario before more exhaustive tests in an integrated environment.
The purposed method is under evaluation in the framework of the Challeng of Real-time Event Detection Solutions (CREDS).

 Read the full technical report (PDF: 540 kB)