Active Inference for Integrated State-Estimation, Control, and Learning

This work presents an approach for control, state-estimation and learning model (hyper)parameters for robotic manipulators. It is based on the active inference framework, prominent in computational neuroscience as a theory of the brain, where behaviour arises from minimizing variational free-energy. First, we show there is a direct relationship between active inference controllers, and classic methods such as PID control. We demonstrate its application for adaptive and robust behaviour of a robotic manipulator that rivals state-of-the-art. Additionally, we show that by learning specific hyperparameters, our approach can deal with unmodeled dynamics, damps oscillations, and is robust against poor initial parameters. The approach is validated on the ‘Franka Emika Panda’ 7 DoF manipulator. Finally, we highlight limitations of active inference controllers for robotic systems.

[1]  Karl J. Friston,et al.  Active Inference: A Process Theory , 2017, Neural Computation.

[2]  Bin Wei Adaptive Control Design and Stability Analysis of Robotic Manipulators , 2018, Actuators.

[3]  Karl J. Friston,et al.  Variational free energy and the Laplace approximation , 2007, NeuroImage.

[4]  Nick Hawes,et al.  Adaptive Manipulator Control using Active Inference with Precision Learning , 2020 .

[5]  Sami Haddadin,et al.  First-order-principles-based constructive network topologies: An application to robot inverse dynamics , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[6]  Li Ping,et al.  The Factor Graph Approach to Model-Based Signal Processing , 2007, Proceedings of the IEEE.

[7]  Karl J. Friston,et al.  Planning and navigation as active inference , 2017, Biological Cybernetics.

[8]  Simon McGregor,et al.  The free energy principle for action and perception: A mathematical review , 2017, 1705.09156.

[9]  W. Thomson Theory of vibration with applications , 1965 .

[10]  Stefan Schaal,et al.  A new data source for inverse dynamics learning , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Lorenzo Jamone,et al.  Incremental learning of context-dependent dynamic internal models for robot control , 2014, 2014 IEEE International Symposium on Intelligent Control (ISIC).

[12]  Gordon Cheng,et al.  Adaptive Robot Body Learning and Estimation Through Predictive Coding , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Matilde Santos Peñas,et al.  Wind and Payload Disturbance Rejection Control Based on Adaptive Neural Estimators: Application on Quadrotors , 2019, Complex..

[14]  Rafal Bogacz,et al.  A tutorial on the free-energy framework for modelling perception and learning , 2017, Journal of mathematical psychology.

[15]  Stephen J. Roberts,et al.  A tutorial on variational Bayesian inference , 2012, Artificial Intelligence Review.

[16]  Duy Nguyen-Tuong,et al.  Local Gaussian Process Regression for Real Time Online Model Learning , 2008, NIPS.

[17]  Gordon Cheng,et al.  Active inference body perception and action for humanoid robots , 2019, ArXiv.

[18]  Matteo Matteucci,et al.  ELeaRNT: Evolutionary Learning of Rich Neural Network Topologies , 2006 .

[19]  Hamed Khodadadi,et al.  Self-tuning PID controller design using fuzzy logic for half car active suspension system , 2018 .

[20]  Active inference for Robot control: A Factor Graph Approach , 2019 .

[21]  Marko Bacic,et al.  Model predictive control , 2003 .

[22]  Bustanul Arifin,et al.  The Lateral Control of Autonomous Vehicles: A Review , 2019, 2019 International Conference on Electrical Engineering and Computer Science (ICECOS).

[23]  Karl J. Friston,et al.  Hierarchical Active Inference: A Theory of Motivated Control , 2018, Trends in Cognitive Sciences.

[24]  Corrado Pezzato,et al.  A Novel Adaptive Controller for Robot Manipulators Based on Active Inference , 2020, IEEE Robotics and Automation Letters.

[25]  R. Walters,et al.  Application of a self-tuning pole-placement regulator to an industrial manipulator , 1982, 1982 21st IEEE Conference on Decision and Control.

[26]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[27]  Bai Yu,et al.  The study of excitation controller based on genetic algorithms and fuzzy PID , 2010, 2010 International Conference on Computer, Mechatronics, Control and Electronic Engineering.

[28]  Karl J. Friston,et al.  Active inference and robot control: a case study , 2016, Journal of The Royal Society Interface.

[29]  Bin Wei,et al.  A review on model reference adaptive control of robotic manipulators , 2017, Annu. Rev. Control..