Distributed wide-area multi-object tracking with non-overlapping camera views

We present a distributed system for wide-area multi-object tracking across disjoint camera views. Every camera in the system performs multi-object tracking, and keeps its own trackers and trajectories. The data from multiple features are exchanged between adjacent cameras for object matching. We employ a probabilistic Petri Net-based approach to account for the uncertainties of the vision algorithms (such as unreliable background subtraction, and tracking failure) and to incorporate the available domain knowledge. We combine appearance features of objects as well as the travel-time evidence for target matching and consistent labeling across disjoint camera views. 3D color histogram, histogram of oriented gradients, local binary patterns, object size and aspect ratio are used as the appearance features. The distribution of the travel time is modeled by a Gaussian mixture model. Multiple features are combined by the weights, which are assigned based on the reliability of the features. By incorporating the domain knowledge about the camera configurations and the information about the received packets from other cameras, certain transitions are fired in the probabilistic Petri net. The system is trained to learn different parameters of the matching process, and updated online. We first present wide-area tracking of vehicles, where we used three non-overlapping cameras. The first and the third cameras are approximately 150 m apart from each other with two intersections in the blind region. We also present an example of applying our method to a people-tracking scenario. The results show the success of the proposed method. A comparison between our work and related work is also presented.

[1]  Luis Salgado,et al.  Color-based 3D particle filtering for robust tracking in heterogeneous environments , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[2]  Massimo Piccardi,et al.  A framework for track matching across disjoint cameras using robust shape and appearance features , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[3]  R. Jacobs What determines visual cue reliability? , 2002, Trends in Cognitive Sciences.

[4]  Gernot A. Fink,et al.  Calibration-free camera hand-over for fast and reliable person tracking in multi-camera setups , 2008, 2008 19th International Conference on Pattern Recognition.

[5]  Dimitrios Makris,et al.  Bridging the gaps between cameras , 2004, CVPR 2004.

[6]  Surendra Ranganath,et al.  Multi-Camera Target Tracking in Blind Regions of Cameras with Non-overlapping Fields of View , 2004, BMVC.

[7]  Alois Knoll,et al.  Speeding Up HOG and LBP Features for Pedestrian Detection by Multiresolution Techniques , 2010, ISVC.

[8]  Mustafa Cenk Gursoy,et al.  Distributed wide-area multi-object tracking with non-overlapping camera views , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[9]  Yunqian Ma,et al.  Associating Moving Objects Across Non-overlapping Cameras: A Query-by-Example Approach , 2008, 2008 IEEE Conference on Technologies for Homeland Security.

[10]  Tim J. Ellis,et al.  Bridging the gaps between cameras , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Rita Cucchiara,et al.  3DPeS: 3D people dataset for surveillance and forensics , 2011, J-HGBU '11.

[12]  Gérard G. Medioni,et al.  Persistent Objects Tracking Across Multiple Non Overlapping Cameras , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[13]  Senem Velipasalar,et al.  Light-weight salient foreground detection for embedded smart cameras , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[14]  Tieniu Tan,et al.  Human appearance matching across multiple non-overlapping cameras , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  Andrea Cavallaro,et al.  Trajectory Association and Fusion across Partially Overlapping Cameras , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[16]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[17]  Christopher O. Jaynes,et al.  Object matching in disjoint cameras using a color transfer approach , 2007, Machine Vision and Applications.

[18]  Eduardo Monari,et al.  A Robust and Efficient Approach for Human Tracking in Multi-camera Systems , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[19]  Tiziana D'Orazio,et al.  Color Brightness Transfer Function evaluation for non overlapping multi camera tracking , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[20]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[21]  Trevor Darrell,et al.  Simultaneous calibration and tracking with a network of non-overlapping sensors , 2004, CVPR 2004.

[22]  Xuelong Li,et al.  Vehicle Detection and Motion Analysis in Low-Altitude Airborne Video Under Urban Environment , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Senem Velipasalar,et al.  Light-weight salient foreground detection for embedded smart cameras , 2010, Comput. Vis. Image Underst..

[24]  Jaswinder Singh,et al.  A Scalable Clustered Camera System for Multiple Object Tracking , 2008, EURASIP J. Image Video Process..

[25]  Massimo Piccardi,et al.  Mitigating the Effects of Variable Illumination for Tracking across Disjoint Camera Views , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[26]  Stuart J. Russell,et al.  Object Identification: A Bayesian Analysis with Application to Traffic Surveillance , 1998, Artif. Intell..

[27]  Shaogang Gong,et al.  Multi-camera Matching using Bi-Directional Cumulative Brightness Transfer Functions , 2008, BMVC.

[28]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Jochen Triesch,et al.  Democratic Integration: Self-Organized Integration of Adaptive Cues , 2001, Neural Computation.

[31]  Simone Calderara,et al.  Consistent Labeling for Multi-camera Object Tracking , 2005, ICIAP.

[32]  Tadao Murata,et al.  Petri nets: Properties, analysis and applications , 1989, Proc. IEEE.

[33]  Fatih Murat Porikli,et al.  Inter-camera color calibration by correlation model function , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[34]  Rama Chellappa,et al.  A Constrained Probabilistic Petri Net Framework for Human Activity Detection in Video* , 2008, IEEE Transactions on Multimedia.

[35]  Horst Bischof,et al.  Tracking across non-overlapping views via geometry , 2008, 2008 19th International Conference on Pattern Recognition.

[36]  Mubarak Shah,et al.  Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  W. Eric L. Grimson,et al.  Recovering Non-overlapping Network Topology Using Far-field Vehicle Tracking Data , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[39]  Jen-Hui Chuang,et al.  Probabilistic Modeling of Dynamic Traffic Flow across Non-overlapping Camera Views , 2010, 2010 20th International Conference on Pattern Recognition.

[40]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[41]  René David,et al.  Petri nets for modeling of dynamic systems: A survey , 1994, Autom..

[42]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[43]  James Black,et al.  Multi view image surveillance and tracking , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..