Association of Moving Objects Across Visual Sensor Networks

We present a novel inter-camera trajectory association algorithm for partially overlapping visual sensor networks. The approach consists of three steps, namely Extraction, Representation and Association. Firstly, we extract trajectory segments in each camera view independently. These local trajectory segments are then projected on a common-plane. Next, we learn dynamic motion models of the projected trajectory segments using Modified Consistent Akaike’s Information Criterion (MCAIC). These models help in removing noisy observations from a segment and hence perform smoothing efficiently. Then, each smoothed trajectory is represented by its curvature. Finally, we use normalized cross correlation, as a proximity measure, to establish correspondence among trajectories that are observed in multiple views. We evaluated the performance of the proposed approach on a simulated and real scenarios with simultaneous moving objects observed by multiple cameras and compared it with state-of-the-art algorithms. Convincing results are observed in favor of the proposed approach.

[1]  Andrea Cavallaro,et al.  Global trajectory reconstruction from distributed visual sensors , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[2]  W. Eric L. Grimson,et al.  Correspondence-free multi-camera activity analysis and scene modeling , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Andrea Cavallaro,et al.  Trajectory Association and Fusion across Partially Overlapping Cameras , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[4]  Daniel P. W. Ellis,et al.  Ground-truth transcriptions of real music from force-aligned MIDI syntheses , 2003, ISMIR.

[5]  Ramin Zabih,et al.  Bayesian multi-camera surveillance , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[7]  Emilio Maggio,et al.  Multi-feature Graph-Based Object Tracking , 2006, CLEAR.

[8]  H. Akaike A new look at the statistical model identification , 1974 .

[9]  Andrea Cavallaro,et al.  Multi-camera track-before-detect , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[10]  Rama Chellappa,et al.  Multicamera Tracking of Articulated Human Motion Using Shape and Motion Cues , 2009, IEEE Transactions on Image Processing.

[11]  Kim L. Boyer,et al.  An information theoretic robust sequential procedure for surface model order selection in noisy range data , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Michael J. Brooks,et al.  A Stochastic Approach to Tracking Objects Across Multiple Cameras , 2004, Australian Conference on Artificial Intelligence.

[13]  Stuart J. Russell,et al.  Object identification in a Bayesian context , 1997, IJCAI 1997.

[14]  Andrew J. Chosak,et al.  OVVV: Using Virtual Worlds to Design and Evaluate Surveillance Systems , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Rangasami L. Kashyap,et al.  Optimal Choice of AR and MA Parts in Autoregressive Moving Average Models , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Andrea Cavallaro,et al.  Content and task-based view selection from multiple video streams , 2009, Multimedia Tools and Applications.

[17]  Yaser Sheikh,et al.  Trajectory Association across Multiple Airborne Cameras , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.