Differential geometric representations and algorithms for some pattern recognition and computer vision problems

Abstract Scene geometry, imaging laws, as well as computational mechanisms generate mathematical constraints on both raw data and computed features. In many cases, these constraints place the patterns on geometrically well-defined spaces, described as manifolds. In such cases, we argue that exploiting the geometry of these manifolds is important to our understanding of the objects and semantics in the imagery. Statistics and algorithms accounting for manifolds also yield improved performance in many vision applications. We justify these arguments by presenting our recent research efforts based on manifold theory for addressing a variety of pattern recognition and computer vision problems, including hashing on manifolds for efficient search, statistical modeling on Grassmann/Stiefel manifolds for activity recognition, discriminative learning for group motion recognition, stochastic optimization for spatio-temporal alignment, and shape matching. We also discuss the manifolds of re-parameterizations and elastic shapes, as well as applications of manifolds to face recognition and unsupervised adaptation of classification model from one domain to another.

[1]  David Mumford,et al.  2D-Shape Analysis Using Conformal Mapping , 2004, CVPR.

[2]  Dong Liu,et al.  Robust visual domain adaptation with low-rank reconstruction , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[4]  Pan Pan,et al.  Regressed Importance Sampling on Manifolds for Efficient Object Tracking , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[5]  Xavier Pennec,et al.  Intrinsic Statistics on Riemannian Manifolds: Basic Tools for Geometric Measurements , 2006, Journal of Mathematical Imaging and Vision.

[6]  Anuj Srivastava,et al.  Optimal linear representations of images for object recognition , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  John Blitzer,et al.  Domain Adaptation with Coupled Subspaces , 2011, AISTATS.

[8]  Rama Chellappa,et al.  Statistical Analysis on Manifolds and Its Applications to Video Analysis , 2010, Video Search and Mining.

[9]  Stefano Soatto,et al.  Recognition of human gaits , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Yuri Ivanov,et al.  Fast Approximate Nearest Neighbor Methods for Non-Euclidean Manifolds with Applications to Human Activity Analysis in Videos , 2010, ECCV.

[12]  Nicole Immorlica,et al.  Locality-sensitive hashing scheme based on p-stable distributions , 2004, SCG '04.

[13]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[14]  Hanqing Lu,et al.  Probabilistic tracking on Riemannian manifolds , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  Rama Chellappa,et al.  Nearest-neighbor search algorithms on non-Euclidean manifolds for computer vision applications , 2010, ICVGIP '10.

[16]  Anuj Srivastava,et al.  Looking for Shapes in Two-Dimensional Cluttered Point Clouds , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Daniel D. Lee,et al.  Extended Grassmann Kernels for Subspace-Based Learning , 2008, NIPS.

[18]  Irfan A. Essa,et al.  Detecting regions of interest in dynamic scenes with camera motions , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Rama Chellappa,et al.  Towards view-invariant expression analysis using analytic shape manifolds , 2011, Face and Gesture 2011.

[20]  Rama Chellappa,et al.  A Blur-Robust Descriptor with Applications to Face Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Anoop Cherian,et al.  Efficient similarity search for covariance matrices via the Jensen-Bregman LogDet Divergence , 2011, 2011 International Conference on Computer Vision.

[23]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.

[24]  Anuj Srivastava,et al.  Riemannian Analysis of Probability Density Functions with Applications in Vision , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Koby Crammer,et al.  Learning Bounds for Domain Adaptation , 2007, NIPS.

[26]  H. Karcher Riemannian center of mass and mollifier smoothing , 1977 .

[27]  Trevor Darrell,et al.  Nearest-Neighbor Methods in Learning and Vision: Theory and Practice (Neural Information Processing) , 2006 .

[28]  Anuj Srivastava,et al.  On Shape of Plane Elastic Curves , 2007, International Journal of Computer Vision.

[29]  Yishay Mansour,et al.  Domain Adaptation: Learning Bounds and Algorithms , 2009, COLT.

[30]  Rama Chellappa,et al.  A system identification approach for video-based face recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[31]  Anuj Srivastava,et al.  Geodesics Between 3D Closed Curves Using Path-Straightening , 2006, ECCV.

[32]  M. Spivak A comprehensive introduction to differential geometry , 1979 .

[33]  Robert Mahony,et al.  Optimization On Manifolds: Methods And Applications , 2010 .

[34]  Kyoung Mu Lee,et al.  Visual tracking via geometric particle filtering on the affine group with optimal importance functions , 2009, CVPR.

[35]  R. Vidal,et al.  Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Rama Chellappa,et al.  Spatiotemporal Alignment of Visual Signals on a Special Manifold , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Rama Chellappa,et al.  A Grassmann manifold-based domain adaptation approach , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[38]  Rama Chellappa,et al.  Domain adaptation for object recognition: An unsupervised approach , 2011, 2011 International Conference on Computer Vision.

[39]  Rama Chellappa,et al.  Age Estimation and Face Verification Across Aging Using Landmarks , 2012, IEEE Transactions on Information Forensics and Security.

[40]  Dong Xu,et al.  Exploiting web images for event recognition in consumer videos: A multiple source domain adaptation approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Anuj Srivastava,et al.  Bayesian and geometric subspace tracking , 2004, Advances in Applied Probability.

[42]  R. Kass,et al.  Geometrical Foundations of Asymptotic Inference: Kass/Geometrical , 1997 .

[43]  Anuj Srivastava,et al.  Shape Analysis of Elastic Curves in Euclidean Spaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  John M. Lee Introduction to Smooth Manifolds , 2002 .

[45]  W. Rossmann Lie Groups: An Introduction through Linear Groups , 2002 .

[46]  James J. Jiang A Literature Survey on Domain Adaptation of Statistical Classifiers , 2007 .

[47]  Rama Chellappa,et al.  Statistical analysis on Stiefel and Grassmann manifolds with applications in computer vision , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Rama Chellappa,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Matching Shape Sequences in Video with Applications in Human Movement Analysis. Ieee Transactions on Pattern Analysis and Machine Intelligence 2 , 2022 .

[49]  D. Kendall,et al.  The Riemannian Structure of Euclidean Shape Spaces: A Novel Environment for Statistics , 1993 .

[50]  W. Boothby An introduction to differentiable manifolds and Riemannian geometry , 1975 .

[51]  Michael Werman,et al.  Affine Invariance Revisited , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[52]  David J. Kriegman,et al.  Illumination cones for recognition under variable lighting: faces , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[53]  Daniel Marcu,et al.  Domain Adaptation for Statistical Classifiers , 2006, J. Artif. Intell. Res..

[54]  D. Kendall SHAPE MANIFOLDS, PROCRUSTEAN METRICS, AND COMPLEX PROJECTIVE SPACES , 1984 .

[55]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[56]  Rama Chellappa,et al.  Recognizing Interactive Group Activities Using Temporal Interaction Matrices and Their Riemannian Statistics , 2012, International Journal of Computer Vision.

[57]  Ramesh C. Jain,et al.  Invariant surface characteristics for 3D object recognition in range images , 1985, Comput. Vis. Graph. Image Process..

[58]  Rama Chellappa,et al.  Rate-Invariant Recognition of Humans and Their Activities , 2009, IEEE Transactions on Image Processing.

[59]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[60]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.