Camera handoff with adaptive resource management for multi-camera multi-object tracking

Camera handoff is a crucial step to obtain a continuously tracked and consistently labeled trajectory of the object of interest in multi-camera surveillance systems. Most existing camera handoff algorithms concentrate on data association, namely consistent labeling, where images of the same object are identified across different cameras. However, there exist many unsolved questions in developing an efficient camera handoff algorithm. In this paper, we first design a trackability measure to quantitatively evaluate the effectiveness of object tracking so that camera handoff can be triggered timely and the camera to which the object of interest is transferred can be selected optimally. Three components are considered: resolution, distance to the edge of the camera's field of view (FOV), and occlusion. In addition, most existing real-time object tracking systems see a decrease in the frame rate as the number of tracked objects increases. To address this issue, our handoff algorithm employs an adaptive resource management mechanism to dynamically allocate cameras' resources to multiple objects with different priorities so that the required minimum frame rate is maintained. Experimental results illustrate that the proposed camera handoff algorithm can achieve a substantially improved overall tracking rate by 20% in comparison with the algorithm presented by Khan and Shah.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Pascal Fua,et al.  Multicamera People Tracking with a Probabilistic Occupancy Map , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  David S. Doermann,et al.  An appearance-based approach for consistent labeling of humans and objects in video , 2004, Pattern Analysis and Applications.

[4]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Rada Y. Chirkova,et al.  Queuing Systems , 2018, Encyclopedia of Database Systems.

[6]  Simone Calderara,et al.  Bayesian-Competitive Consistent Labeling for People Surveillance , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Ramesh C. Jain,et al.  An architecture for multiple perspective interactive video , 1995, MULTIMEDIA '95.

[9]  Leonard Kleinrock,et al.  Theory, Volume 1, Queueing Systems , 1975 .

[10]  Tieniu Tan,et al.  Principal axis-based correspondence between multiple cameras for people tracking , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Suchendra M. Bhandarkar,et al.  Multiple object tracking using elastic matching , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[12]  Kiyoharu Aizawa,et al.  Video handover for retrieval in a ubiquitous environment using floor sensor data , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[13]  Gérard G. Medioni,et al.  Persistent Objects Tracking Across Multiple Non Overlapping Cameras , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[14]  Mongi A. Abidi,et al.  Sensor planning for automated and persistent object tracking with multiple cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  M. Munot,et al.  Research Methodology , 2019, Storytelling with Data in Healthcare.

[16]  Horst Bischof,et al.  Multiple Object Tracking Using Local PCA , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[17]  Jae-Young Choi,et al.  Improved Tracking of Multiple Vehicles Using Invariant Feature-Based Matching , 2007, PReMI.

[18]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Tele Tan,et al.  Non-overlapping Distributed Tracking System Utilizing Particle Filter , 2007, J. VLSI Signal Process..

[20]  Suya You,et al.  Globally optimum multiple object tracking , 2005 .

[21]  Lei Huang,et al.  Adaptive resource allocation for multimedia QoS management in wireless networks , 2004, IEEE Transactions on Vehicular Technology.

[22]  Gérard G. Medioni,et al.  Continuous tracking within and across camera streams , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[23]  Chung-Lin Huang,et al.  Multi-view-based Cooperative Tracking of Multiple Human Objects in Cluttered Scenes , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[24]  Yi Yao,et al.  Video-based multi-camera automated surveillance of high value assets in nuclear facilities , 2007 .

[25]  Sadiye Guler,et al.  Tracking and handoff between multiple perspective camera views , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[26]  Alexei A. Efros,et al.  Recovering Occlusion Boundaries from a Single Image , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[27]  Mongi A. Abidi,et al.  3D Target Scale Estimation for Size Preserving in PTZ Video Tracking , 2006, 2006 International Conference on Image Processing.

[28]  Kishor S. Trivedi Probability and Statistics with Reliability, Queuing, and Computer Science Applications , 1984 .

[29]  Mongi A. Abidi,et al.  Fusion of Omnidirectional and PTZ Cameras for Accurate Cooperative Tracking , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[30]  Mubarak Shah,et al.  Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Mei Han,et al.  An algorithm for multiple object trajectory tracking , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[32]  Mubarak Shah,et al.  Machine Vision and Applications Understanding Human Behavior from Motion Imagery , 2003 .

[33]  Lily Lee,et al.  Monitoring Activities from Multiple Video Streams: Establishing a Common Coordinate Frame , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  T. Kobayashi,et al.  Statistical characteristics of pedestrians' motion and effects on teletraffic of mobile communication networks , 2005, Second IFIP International Conference on Wireless and Optical Communications Networks, 2005. WOCN 2005..

[35]  Simone Calderara,et al.  Consistent Labeling for Multi-camera Object Tracking , 2005, ICIAP.