Consistent detection and identification of individuals in a large camera network

In the wake of an increasing number of terrorist attacks, counter-terrorism measures are now a main focus of many research programmes. An important issue for the police is the ability to track individuals and groups reliably through underground stations, and in the case of post-event analysis, to be able to ascertain whether specific individuals have been at the station previously. While there exist many motion detection and tracking algorithms, the reliable deployment of them in a large network is still ongoing research. Specifically, to track individuals through multiple views, on multiple levels and between levels, consistent detection and labelling of individuals is crucial. In view of these issues, we have developed a change detection algorithm to work reliably in the presence of periodic movements, e.g. escalators and scrolling advertisements, as well as a content-based retrieval technique for identification. The change detection technique automatically extracts periodically varying elements in the scene using Fourier analysis, and constructs a Markov model for the process. Training is performed online, and no manual intervention is required, making this system suitable for deployment in large networks. Experiments on real data shows significant improvement over existing techniques. The content-based retrieval technique uses MPEG-7 descriptors to identify individuals. Given the environment under which the system operates, i.e. at relatively low resolution, this approach is suitable for short timescales. For longer timescales, other forms of identification such as gait, or if the resolution allows, face recognition, will be required.

[1]  S. Velastín,et al.  Fusion of Multiple Features for Identity Estimation , 2006 .

[2]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Chris Stauffer,et al.  Automated multi-camera planar tracking correspondence modeling , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[5]  Mathias Kölsch,et al.  Flocks of Features for Tracking Articulated Objects , 2005 .

[6]  Sergio A. Velastin,et al.  Markov models of periodically varying backgrounds for change detection , 2007 .

[7]  Dimitrios Makris,et al.  Bridging the gaps between cameras , 2004, CVPR 2004.

[8]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[9]  R. Streit,et al.  Probabilistic Multi-Hypothesis Tracking , 1995 .

[10]  Andrew Layman XML Syntax Recommendation for Serializing Graphs of Data , 1998, QL.

[11]  G. Thiel Automatic CCTV surveillance-towards the VIRTUAL GUARD , 2000 .

[12]  Gregory Dudek,et al.  Topology inference for a vision-based sensor network , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[13]  Chris Stauffer,et al.  Learning to Track Objects Through Unobserved Regions , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[14]  B. S. Manjunath,et al.  Introduction to mpeg-7 , 2002 .