Color Based Tracing in Real-Life Surveillance Data

For post incident investigation a complete reconstruction of an event is needed based on surveillance footage of the crime scene and surrounding areas. Reconstruction of the whereabouts of the people in the incident requires the ability to follow persons within a camera's field-of-view (tracking) and between different cameras (tracing). In constrained situations a combination of shape and color information is shown to be best at discriminating between persons. In this paper we focus on person tracing between uncalibrated cameras with non-overlapping field-of-view. In these situations standard image matching techniques perform badly due to large, uncontrolled variations in viewpoint, light source, background and shading. We show that in these unconstrained real-life situations, tracing results are very dependent on the appearance of the subject.

[1]  Frédéric Jurie,et al.  Learning Visual Similarity Measures for Comparing Never Seen Objects , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Jake K. Aggarwal,et al.  Object tracking in an outdoor environment using fusion of features and cameras , 2006, Image Vis. Comput..

[3]  W. R. Howard.  Biometric System and Data Analysis: Design, Evaluation, and Data Mining , 2009 .

[4]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[5]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[6]  Léon J. M. Rothkrantz,et al.  Multimodal workbench for automatic surveillance applications , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Tim J. Ellis,et al.  Multi camera image tracking , 2006, Image Vis. Comput..

[8]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[9]  Frédéric Jurie,et al.  Creating efficient codebooks for visual recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Marcel Worring,et al.  Multi-target tracking in time-lapse video forensics , 2009, MiFor '09.

[12]  W. Förstner,et al.  A Metric for Covariance Matrices , 2003 .

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[14]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[16]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[17]  Asok Ray,et al.  Review and comparative evaluation of symbolic dynamic filtering for detection of anomaly patterns , 2009, 2008 American Control Conference.

[18]  Koen E. A. van de Sande,et al.  Evaluation of color descriptors for object and scene recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[20]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[21]  Ingeborg Tastl,et al.  Gamut Constrained Illuminant Estimation , 2006, International Journal of Computer Vision.

[22]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[23]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[24]  Marcel Worring,et al.  A Multi-Camera Visual Surveillance System for Tracking of Reoccurrences of People , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[25]  Hai Tao,et al.  Evaluating Appearance Models for Recognition, Reacquisition, and Tracking , 2007 .

[26]  Bastian Leibe,et al.  Interleaved Object Categorization and Segmentation , 2003, BMVC.

[27]  G. Buchsbaum.  A spatial processor model for object colour perception , 1980 .

[28]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[29]  Simone Calderara,et al.  HECOL: Homography and epipolar-based consistent labeling for outdoor park surveillance , 2008, Comput. Vis. Image Underst..

[30]  Dariu M. Gavrila,et al.  Audio-video sensor fusion for aggression detection. , 2007 .

[31]  Axel Pinz,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[32]  Pierre Vandergheynst,et al.  Cascade of descriptors to detect and track objects across any network of cameras , 2010, Comput. Vis. Image Underst..