Online-Learning-Based Human Tracking Across Non-Overlapping Cameras

Due to the expanding scale of camera networks, Multiple Camera Tracking (MCT) of humans has received increased attention in recent years. In this paper, we present a novel approach to tracking each human within a single camera and across multiple disjoint cameras. Our framework includes a multi-object tracking and segmentation system, a two-phase feature extractor, and an online-learning-based camera link model estimation. For tracking within a single camera, we apply tracking by segmentation and local object detection with multi-kernel feedback to adaptively improve the robustness of the algorithm. In inter-camera tracking, we introduce an effective integration of appearance and context features. Couples are automatically detected, and the couple feature is also integrated with existing features. The proposed algorithm is scalable by a fully unsupervised online-learning framework. In our experiments, the proposed method outperforms all of the state-of-the-art methods in the benchmark National Laboratory of Pattern Recognition (NLPR)_MCT dataset.

[1]  Mubarak Shah,et al.  Modeling inter-camera space-time and appearance relationships for tracking across non-overlapping views , 2008, Comput. Vis. Image Underst..

[2]  Jian-Huang Lai,et al.  Matching of Tracked Pedestrians Across Disjoint Camera Views Using CI-DLBP , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Gérard G. Medioni,et al.  Exploring context information for inter-camera multiple target tracking , 2014, IEEE Winter Conference on Applications of Computer Vision.

[5]  Shaogang Gong,et al.  Multi-camera Matching using Bi-Directional Cumulative Brightness Transfer Functions , 2008, BMVC.

[6]  Jen-Hui Chuang,et al.  Probabilistic Modeling of Dynamic Traffic Flow across Non-overlapping Camera Views , 2010, 2010 20th International Conference on Pattern Recognition.

[7]  Tim J. Ellis,et al.  Bridging the gaps between cameras , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[8]  Kaiqi Huang,et al.  A novel solution for multi-camera object tracking , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[9]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[10]  Supun Samarasekera,et al.  Vehicle tracking across nonoverlapping cameras using joint kinematic and appearance features , 2011, CVPR 2011.

[11]  Mario Sznaier,et al.  Dynamic Appearance Modeling for Human Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Jenq-Neng Hwang,et al.  Human tracking by adaptive Kalman filtering and multiple kernels tracking with projected gradients , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[13]  Huang-Chia Shih,et al.  Automatic Reference Color Selection for Adaptive Mathematical Morphology and Application in Image Segmentation , 2016, IEEE Transactions on Image Processing.

[14]  Jenq-Neng Hwang,et al.  Tracking Human Under Occlusion Based on Adaptive Multiple Kernels With Projected Gradients , 2013, IEEE Transactions on Multimedia.

[15]  Shishir K. Shah,et al.  Subject centric group feature for person re-identification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  Yi-Ping Hung,et al.  An adaptive learning method for target tracking across multiple cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Jen-Hui Chuang,et al.  Regularized Background Adaptation: A Novel Learning Rate Control Scheme for Gaussian Mixture Modeling , 2011, IEEE Transactions on Image Processing.

[18]  Kaiqi Huang,et al.  An Equalized Global Graph Model-Based Approach for Multicamera Object Tracking , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Ramakant Nevatia,et al.  Multiple Target Tracking by Learning-Based Hierarchical Association of Detection Responses , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[23]  Guillaume-Alexandre Bilodeau,et al.  Improving background subtraction using Local Binary Similarity Patterns , 2014, IEEE Winter Conference on Applications of Computer Vision.

[24]  Andrew Gilbert,et al.  Tracking Objects Across Cameras by Incrementally Learning Inter-camera Colour Calibration and Patterns of Activity , 2006, ECCV.

[25]  James M. Rehg,et al.  Real-time human detection using contour cues , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[27]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[28]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Ramakant Nevatia,et al.  Inter-camera Association of Multi-target Tracks by On-Line Learned Appearance Affinity Models , 2010, ECCV.

[30]  Xiaojing Chen,et al.  An Online Learned Elementary Grouping Model for Multi-target Tracking , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Gerhard Rigoll,et al.  Background segmentation with feedback: The Pixel-Based Adaptive Segmenter , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[32]  Anil K. Jain,et al.  Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Tiziana D'Orazio,et al.  Color Brightness Transfer Function evaluation for non overlapping multi camera tracking , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[34]  Jenq-Neng Hwang,et al.  Combined estimation of camera link models for human tracking across nonoverlapping cameras , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[35]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[36]  Stefan Roth,et al.  MOT16: A Benchmark for Multi-Object Tracking , 2016, ArXiv.

[37]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Xiaojing Chen,et al.  Integrating Social Grouping for Multitarget Tracking Across Cameras in a CRF Model , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Tieniu Tan,et al.  Rapid and robust human detection and tracking based on omega-shape features , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[40]  Jenq-Neng Hwang,et al.  Fully Unsupervised Learning of Camera Link Models for Tracking Humans Across Nonoverlapping Cameras , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Alessandro Perina,et al.  Person re-identification by symmetry-driven accumulation of local features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[42]  Yi-Ping Hung,et al.  Multi-Cue Integration for Multi-Camera Tracking , 2010, 2010 20th International Conference on Pattern Recognition.

[43]  Kaiqi Huang,et al.  An Adaptive Combination of Multiple Features for Robust Tracking in Real Scene , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[44]  Jenq-Neng Hwang,et al.  Multiple-kernel adaptive segmentation and tracking (MAST) for robust object tracking , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[45]  Tieniu Tan,et al.  Object tracking across non-overlapping views by learning inter-camera transfer models , 2014, Pattern Recognit..

[46]  Guillaume-Alexandre Bilodeau,et al.  SuBSENSE: A Universal Change Detection Method With Local Adaptive Sensitivity , 2015, IEEE Transactions on Image Processing.

[47]  Jenq-Neng Hwang,et al.  An Ensemble of Invariant Features for Person Reidentification , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[48]  Ramakant Nevatia,et al.  High performance object detection by collaborative learning of Joint Ranking of Granules features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  Ramakant Nevatia,et al.  Robust Object Tracking by Hierarchical Association of Detection Responses , 2008, ECCV.

[50]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[51]  Ehud Rivlin,et al.  Color Invariants for Person Reidentification , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.