Detecting independently moving objects and their interactions in georeferenced airborne video

In airborne video, objects are tracked from a moving camera and often imaged at very low resolution. The camera movement makes it difficult to determine whether or not an object is in motion; the low-resolution imagery makes it difficult to classify the objects and their activities. When comparable, the object's georeferenced trajectory contains useful information for the solution of both of these problems. We describe a novel technique for detecting independent movement by analyzing georeferenced object motion relative to the trajectory of the camera. The method is demonstrated on over a hundred objects and parallax artifacts, and its performance is analyzed relative to difficult object behavior and camera model errors. We also describe a new method for classifying objects and events using features of georeferenced trajectories, such as duration of acceleration, measured at key phases of the events. These features, combined with the periodicity of the image motion, are successfully used classify events in the domain of person-vehicle interactions.

[1]  Chandra Shekhar Semi-automatic video-to-site registration for aerial monitoring , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[4]  Hai Tao,et al.  Dynamic layer representation with applications to tracking , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Harpreet S. Sawhney,et al.  Independent motion detection in 3D scenes , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Lambert E. Wixson,et al.  Image alignment for precise camera fixation and aim , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[7]  Larry S. Davis,et al.  Monitoring human and vehicle activities using airborne video , 2000, Applied Imaging Pattern Recognition.

[8]  P. Anandan,et al.  A Unified Approach to Moving Object Detection in 2D and 3D Scenes , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Robert Pless,et al.  Detecting Independent Motion: The Statistics of Temporal Continuity , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..