Free Energy Principle for State and Input Estimation of a Quadcopter Flying in Wind

The free energy principle from neuroscience provides a brain-inspired perception scheme through a data-driven model learning algorithm called Dynamic Expectation Maximization (DEM). This paper aims at introducing an exper-imental design to provide the first experimental confirmation of the usefulness of DEM as a state and input estimator for real robots. Through a series of quadcopter flight experiments under unmodelled wind dynamics, we prove that DEM can leverage the information from colored noise for accurate state and input estimation through the use of generalized coordinates. We demonstrate the superior performance of DEM for state es-timation under colored noise with respect to other benchmarks like State Augmentation, SMIKF and Kalman Filtering through its minimal estimation error. We demonstrate the similarities in the performance of DEM and Unknown Input Observer (UIO) for input estimation. The paper concludes by showing the influence of prior beliefs in shaping the accuracy-complexity trade-off during DEM's estimation.

[1]  Jun Tani,et al.  Active Inference in Robotics and Artificial Agents: Survey and Challenges , 2021, ArXiv.

[2]  Ajith Anil Meera,et al.  Dynamic Expectation Maximization Algorithm for Estimation of Linear Systems with Colored Noise , 2021, Entropy.

[3]  Martijn Wisse,et al.  A Brain Inspired Learning Algorithm for the Perception of a Quadrotor in Wind , 2021, arXiv.org.

[4]  Tim Verbelen,et al.  Robot navigation as hierarchical active inference , 2021, Neural Networks.

[5]  Martijn Wisse,et al.  Free Energy Principle Based State and Input Observer Design for Linear Systems with Colored Noise , 2020, 2020 American Control Conference (ACC).

[6]  Riccardo M. G. Ferrari,et al.  A Novel Adaptive Controller for Robot Manipulators Based on Active Inference , 2019, IEEE Robotics and Automation Letters.

[7]  Gordon Cheng,et al.  Active inference body perception and action for humanoid robots , 2019, ArXiv.

[8]  Manuel Baltieri,et al.  PID Control as a Process of Active Inference with Linear Generative Models † , 2019, Entropy.

[9]  Yong Li,et al.  Critical Issues on Kalman Filter with Colored and Correlated System Noises , 2017 .

[10]  Simon McGregor,et al.  The free energy principle for action and perception: A mathematical review , 2017, 1705.09156.

[11]  Gamini Dissanayake,et al.  Model-aided state estimation for quadrotor micro air vehicles amidst wind disturbances , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Horacio J. Marquez,et al.  Observer design for discrete-time linear systems with unknown disturbances , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[13]  Bruce P. Gibbs,et al.  Advanced Kalman Filtering, Least-Squares and Modeling: A Practical Handbook , 2011 .

[14]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[15]  Karl J. Friston,et al.  The default-mode, ego-functions and free-energy: a neurobiological account of Freudian ideas , 2010, Brain : a journal of neurology.

[16]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[17]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[18]  Steven L. Waslander,et al.  Wind Disturbance Estimation and Rejection for Quadrotor Position Control , 2009 .

[19]  Karl J. Friston Hierarchical Models in the Brain , 2008, PLoS Comput. Biol..

[20]  Karl J. Friston,et al.  DEM: A variational treatment of dynamic systems , 2008, NeuroImage.

[21]  Karl J. Friston,et al.  Variational free energy and the Laplace approximation , 2007, NeuroImage.

[22]  Roland Siegwart,et al.  Design and control of an indoor micro quadrotor , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[23]  Y. Halevi,et al.  On partially augmented observers for systems with coloured noises , 1993 .

[24]  A. Bryson,et al.  Estimation using sampled data containing sequentially correlated noise. , 1967 .

[25]  R. Kálmán A new approach to linear filtering and prediction problems" transaction of the asme~journal of basic , 1960 .

[26]  M. Wisse,et al.  On the Convergence of DEM's Linear Parameter Estimator , 2021, PKDD/ECML Workshops.

[27]  D. Benders AR.Drone 2.0 state estimation using Dynamic Expectation Maximization: Bringing brain perception theory to practice , 2020 .

[28]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[29]  A. Bryson,et al.  Linear filtering for time-varying systems using measurements containing colored noise , 1965 .