Statistical analysis of trajectories on Riemannian manifolds: Bird migration, hurricane tracking and video surveillance

We consider the statistical analysis of trajectories on Riemannian manifolds that are observed under arbitrary temporal evolutions. Past methods rely on cross-sectional analysis, with the given temporal registration, and consequently may lose the mean structure and artificially inflate observed variances. We introduce a quantity that provides both a cost function for temporal registration and a proper distance for comparison of trajectories. This distance is used to define statistical summaries, such as sample means and covariances, of synchronized trajectories and "Gaussian-type" models to capture their variability at discrete times. It is invariant to identical time-warpings (or temporal reparameterizations) of trajectories. This is based on a novel mathematical representation of trajectories, termed transported square-root vector field (TSRVF), and the $\mathbb{L}^2$ norm on the space of TSRVFs. We illustrate this framework using three representative manifolds---$\mathbb{S}^2$, $\mathrm {SE}(2)$ and shape space of planar contours---involving both simulated and real data. In particular, we demonstrate: (1) improvements in mean structures and significant reductions in cross-sectional variances using real data sets, (2) statistical modeling for capturing variability in aligned trajectories, and (3) evaluating random trajectories under these models. Experimental results concern bird migration, hurricane tracking and video surveillance.

[1]  P. Jupp,et al.  Fitting Smooth Paths to Spherical Data , 1987 .

[2]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[3]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[4]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[5]  Alain Trouvé,et al.  On a Class of Diffeomorphic Matching Problems in One Dimension , 2000, SIAM J. Control. Optim..

[6]  Huiling Le,et al.  The Fréchet mean shape and the shape of the means , 2000, Advances in Applied Probability.

[7]  Gary E. Christensen,et al.  Consistent image registration , 2001, IEEE Transactions on Medical Imaging.

[8]  Huiling Le,et al.  Unrolling Shape Curves , 2003 .

[9]  H. Müller,et al.  Functional Convex Averaging and Synchronization for Time-Warped Random Curves , 2004 .

[10]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[11]  Jayant Shah type Riemannian metrics on the space of planar curves , 2005 .

[12]  D. Mumford,et al.  An overview of the Riemannian metrics on spaces of curves using the Hamiltonian approach , 2006, math/0605009.

[13]  I. Dryden,et al.  Shape-space smoothing splines for planar landmark data , 2007 .

[14]  D. Mumford,et al.  A Metric on Shape Space with Explicit Geodesics , 2007, 0706.4299.

[15]  F. Moore,et al.  Swainson’s thrushes in migratory disposition exhibit reduced immune function , 2008, Journal of Ethology.

[16]  J. Ramsay,et al.  Combining Registration and Fitting for Functional Models , 2008 .

[17]  Rama Chellappa,et al.  Rate-Invariant Recognition of Humans and Their Activities , 2009, IEEE Transactions on Image Processing.

[18]  I. Dryden,et al.  Shape curves and geodesic modelling , 2010 .

[19]  J. Marron,et al.  Registration of Functional Data Using Fisher-Rao Metric , 2011, 1103.3817.

[20]  Wei Wu,et al.  Signal Estimation Under Random Time-Warpings and Nonlinear Signal Alignment , 2011, NIPS.

[21]  Anuj Srivastava,et al.  Shape Analysis of Elastic Curves in Euclidean Spaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Stefano Soatto,et al.  A New Geometric Metric in the Space of Curves, and Applications to Tracking Deforming Objects by Prediction and Filtering , 2011, SIAM J. Imaging Sci..

[23]  Wei Wu,et al.  Generative models for functional data using phase and amplitude separation , 2012, Comput. Stat. Data Anal..

[24]  Anuj Srivastava,et al.  Statistical Shape Analysis , 2014, Computer Vision, A Reference Guide.