Robust Unsupervised Learning of Temporal Dynamic Interactions

Robust representation learning of temporal dynamic interactions is an important problem in robotic learning in general and automated unsupervised learning in particular. Temporal dynamic interactions can be described by (multiple) geometric trajectories in a suitable space over which unsupervised learning techniques may be applied to extract useful features from raw and high-dimensional data measurements. Taking a geometric approach to robust representation learning for temporal dynamic interactions, it is necessary to develop suitable metrics and a systematic methodology for comparison and for assessing the stability of an unsupervised learning method with respect to its tuning parameters. Such metrics must account for the (geometric) constraints in the physical world as well as the uncertainty associated with the learned patterns. In this paper we introduce a model-free metric based on the Procrustes distance for robust representation learning of interactions, and an optimal transport based distance metric for comparing between distributions of interaction primitives. These distance metrics can serve as an objective for assessing the stability of an interaction learning algorithm. They are also used for comparing the outcomes produced by different algorithms. Moreover, they may also be adopted as an objective function to obtain clusters and representative interaction primitives. These concepts and techniques will be introduced, along with mathematical properties, while their usefulness will be demonstrated in unsupervised learning of vehicle-to-vechicle interactions extracted from the Safety Pilot database, the world's largest database for connected vehicles.

[1]  Shimon Whiteson,et al.  Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning , 2017, ICML.

[2]  M. B. Stegmann,et al.  A Brief Introduction to Statistical Shape Analysis , 2002 .

[3]  Kazushi Ikeda,et al.  Modeling and Prediction of Driving Behaviors Using a Nonparametric Bayesian Method With AR Models , 2016, IEEE Transactions on Intelligent Vehicles.

[4]  Arnaud Doucet,et al.  Fast Computation of Wasserstein Barycenters , 2013, ICML.

[5]  W. Kabsch A discussion of the solution for the best rotation to relate two sets of vectors , 1978 .

[6]  Xianfeng Tang,et al.  Learning from Multiple Cities: A Meta-Learning Approach for Spatial-Temporal Prediction , 2019, WWW.

[7]  Affan Pervez,et al.  Learning deep movement primitives using convolutional neural networks , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[8]  Tadahiro Taniguchi,et al.  Sequence Prediction of Driving Behavior Using Double Articulation Analyzer , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Wenshuo Wang,et al.  Multi-Vehicle Interaction Scenarios Generation with Interpretable Traffic Primitives and Gaussian Process Regression , 2019, 2020 IEEE Intelligent Vehicles Symposium (IV).

[10]  Stewart Worrall,et al.  An Unsupervised Approach for Inferring Driver Behavior From Naturalistic Driving Data , 2015, IEEE Transactions on Intelligent Transportation Systems.

[11]  Wenshuo Wang,et al.  Extracting Traffic Primitives Directly From Naturalistically Logged Data for Self-Driving Applications , 2017, IEEE Robotics and Automation Letters.

[12]  Junqiang Xi,et al.  Driving Style Analysis Using Primitive Driving Patterns With Bayesian Nonparametric Approaches , 2017, IEEE Transactions on Intelligent Transportation Systems.

[13]  Guillaume Carlier,et al.  Barycenters in the Wasserstein Space , 2011, SIAM J. Math. Anal..

[14]  K. Dill,et al.  Using quaternions to calculate RMSD , 2004, J. Comput. Chem..

[15]  W. Kabsch A solution for the best rotation to relate two sets of vectors , 1976 .

[16]  Jerry M. Mendel,et al.  IEEE Press Series on Computational Intelligence , 2014 .

[17]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[18]  C. Villani Topics in Optimal Transportation , 2003 .

[19]  I. Daubechies,et al.  Continuous Procrustes Distance Between Two Surfaces , 2011, 1106.4588.

[20]  Albert S. Huang,et al.  A Bayesian nonparametric approach to modeling motion patterns , 2011, Auton. Robots.

[21]  Siva Sivaganesan,et al.  Global and Local Robustness Approaches: Uses and Limitations , 2000 .

[22]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[23]  Wenshuo Wang,et al.  Learning V2V interactive driving patterns at signalized intersections , 2019, Transportation Research Part C: Emerging Technologies.

[24]  Lior Rokach,et al.  Clustering Methods , 2005, The Data Mining and Knowledge Discovery Handbook.

[25]  Tadahiro Taniguchi,et al.  Unsupervised Hierarchical Modeling of Driving Behavior and Prediction of Contextual Changing Points , 2015, IEEE Transactions on Intelligent Transportation Systems.

[26]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[27]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[28]  David Pollard,et al.  Quantization and the method of k -means , 1982, IEEE Trans. Inf. Theory.

[29]  Dinh Q. Phung,et al.  Multilevel Clustering via Wasserstein Means , 2017, ICML.

[30]  Munther A. Dahleh,et al.  Maneuver-based motion planning for nonlinear systems with symmetries , 2005, IEEE Transactions on Robotics.

[31]  Anuj Srivastava,et al.  Functional and Shape Data Analysis , 2016 .

[32]  Wenshuo Wang,et al.  Modeling Multi-Vehicle Interaction Scenarios Using Gaussian Random Field , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[33]  J. Gower Generalized procrustes analysis , 1975 .

[34]  J. Ibrahim,et al.  Bayesian influence analysis: a geometric approach. , 2011, Biometrika.

[35]  Sridhar Mahadevan,et al.  Manifold alignment using Procrustes analysis , 2008, ICML '08.

[36]  T. Warren Liao,et al.  Clustering of time series data - a survey , 2005, Pattern Recognit..

[37]  Michael I. Jordan,et al.  The Sticky HDP-HMM: Bayesian Nonparametric Hidden Markov Models with Persistent States , 2009 .

[38]  Wenshuo Wang,et al.  Multi-Vehicle Trajectories Generation for Vehicle-to-Vehicle Encounters , 2018, ArXiv.

[39]  Yingjie Tian,et al.  A Comprehensive Survey of Clustering Algorithms , 2015, Annals of Data Science.

[40]  S. Graf,et al.  Foundations of Quantization for Probability Distributions , 2000 .

[41]  Paul Gustafson,et al.  Local Robustness in Bayesian Analysis , 2000 .

[42]  Wenshuo Wang,et al.  Probabilistic Trajectory Prediction for Autonomous Vehicles with Attentive Recurrent Neural Process , 2019, ArXiv.