Convex Nonparametric Formulation for Identification of Gradient Flows

We develop a nonparametric identification method for nonlinear gradient-flow dynamics. In these systems, the vector field is the gradient field of a potential energy function. This fundamental fact about the dynamics is a structural prior knowledge and a constraint in the proposed identification method. While the nature of the identification problem is an estimation in the space of functions, we derive an equivalent finite dimensional formulation, which is a convex optimization in the form of a quadratic program. This provides scalability and the opportunity for utilizing recently developed large-scale optimization solvers. The central idea is representing the energy function as a difference of two convex functions and learning these convex functions jointly. Based on necessary and sufficient conditions for function convexity, the identification problem is formulated, and then, the existence, uniqueness and smoothness of the solution is addressed. We also illustrate and evaluate the method numerically with two demonstrative examples.

[1]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[2]  Kaivalya Bakshi,et al.  On Mean Field Games for Agents With Langevin Dynamics , 2019, IEEE Transactions on Control of Network Systems.

[3]  Darwin G. Caldwell,et al.  Learning and Reproduction of Gestures by Imitation , 2010, IEEE Robotics & Automation Magazine.

[4]  B. Sen,et al.  A Computational Framework for Multivariate Convex Regression and Its Variants , 2015, Journal of the American Statistical Association.

[5]  Oussama Khatib,et al.  Learning potential functions from human demonstrations with encapsulated dynamic and compliant behaviors , 2017, Auton. Robots.

[6]  Marco Pavone,et al.  Learning stabilizable nonlinear dynamics with contraction-based regularization , 2019, Int. J. Robotics Res..

[7]  Vikas Sindhwani,et al.  Learning Contracting Vector Fields For Stable Imitation Learning , 2018, ArXiv.

[8]  Alan L. Yuille,et al.  The Concave-Convex Procedure , 2003, Neural Computation.

[9]  J. Aubin,et al.  Differential inclusions set-valued maps and viability theory , 1984 .

[10]  Mohammad Khosravi,et al.  Kernel-Based Identification of Positive Systems , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[11]  Yurii Nesterov,et al.  Lectures on Convex Optimization , 2018 .

[12]  Lennart Ljung,et al.  Kernel methods in system identification, machine learning and function estimation: A survey , 2014, Autom..

[13]  Kim C. Border,et al.  Infinite Dimensional Analysis: A Hitchhiker’s Guide , 1994 .

[14]  Samet Oymak,et al.  Non-asymptotic and Accurate Learning of Nonlinear Dynamical Systems , 2020, ArXiv.

[15]  Thomas B. Schön,et al.  Maximum likelihood identification of stable linear dynamical systems , 2018, Autom..

[16]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[17]  Bernhard Schölkopf,et al.  Learning Inverse Dynamics: a Comparison , 2008, ESANN.

[18]  Jun Nakanishi,et al.  Dynamical Movement Primitives: Learning Attractor Models for Motor Behaviors , 2013, Neural Computation.

[19]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[20]  Ping Yu,et al.  Robust Estimation of Derivatives Using Locally Weighted Least Absolute Deviation Regression , 2019, J. Mach. Learn. Res..

[21]  E Kaiser,et al.  Sparse identification of nonlinear dynamics for model predictive control in the low-data limit , 2017, Proceedings of the Royal Society A.

[22]  D. Lathrop Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering , 2015 .

[23]  Johan A. K. Suykens,et al.  Identification of positive real models in subspace identification by using regularization , 2003, IEEE Trans. Autom. Control..