Tracking Vehicles Through Shadows and Occlusions in Wide-Area Aerial Video

We present a new approach for simultaneous tracking and segmentation of multiple targets in low frame rate aerial video. We focus on building an accurate background model that accounts for both global camera motion and moving objects in the scene. We then apply a probabilistic framework for simultaneous tracking and segmentation that incorporates this background model. By using a background model, we are able to track the object through dramatic appearance changes caused by shadows and lighting changes. Furthermore, the incorporation of segmentation into the tracking algorithm reduces the impact of common tracking problems, such as drift and partial occlusion. Results are shown for the Columbus Large Image Format (CLIF) 2007 data set, demonstrating successful tracking under significant occlusions, target appearance changes, and near similar moving objects.

[1]  Geoffrey J. McLachlan,et al.  Robust mixture modelling using the t distribution , 2000, Stat. Comput..

[2]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[3]  Jeremy MG Taylor,et al.  Robust Statistical Modeling Using the t Distribution , 1989 .

[4]  Stephen M. Smith,et al.  ASSET-2: real-time motion segmentation and shape tracking , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  Haroon Idrees,et al.  Detection and Tracking of Large Number of Targets in Wide Area Surveillance , 2010, ECCV.

[6]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[7]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Patrick Bouthemy,et al.  Region-Based Tracking Using Affine Motion Models in Long Image Sequences , 1994 .

[9]  Noah Snavely.  Photo Tourism : Exploring image collections in 3D , 2006 .

[10]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Avinash C. Kak,et al.  Computer Vision and Pattern Recognition 2010 A Probabilistic Framework for Joint Segmentation and Tracking , 2022 .

[12]  Xuelong Li,et al.  Vehicle Detection and Motion Analysis in Low-Altitude Airborne Video Under Urban Environment , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Samuel Kotz,et al.  Estimation Methods for the Multivariate t Distribution , 2008 .

[14]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[15]  Mubarak Shah,et al.  COCOA: tracking in aerial imagery , 2006, SPIE Defense + Commercial Sensing.

[16]  Harpreet S. Sawhney,et al.  Vehicle detection and tracking in wide field-of-view aerial video , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[18]  Suman K. Mitra,et al.  Background Subtraction in Videos using Bayesian Learning with Motion Information , 2008, BMVC.

[19]  Michael P. Dessauer,et al.  Low-resolution vehicle tracking using dense and reduced local gradient features maps , 2010, Defense + Commercial Sensing.

[20]  A. McNeil.  Multivariate t Distributions and Their Applications , 2006 .

[21]  Guoliang Fan,et al.  Generative Model for Maneuvering Target Tracking , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[22]  Eero P. Simoncelli.  4.7 – Statistical Modeling of Photographic Images , 2005 .

[23]  Keith Redmill,et al.  Aerial image registration incorporating GPS/IMU data , 2009, Defense + Commercial Sensing.

[24]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Robert T. Collins,et al.  An Open Source Tracking Testbed and Evaluation Web Site , 2005 .