Free Energy Principle Based State and Input Observer Design for Linear Systems with Colored Noise

The free energy principle from neuroscience provides a biologically plausible solution to the brain’s inference mechanism. This paper reformulates this theory to design a brain-inspired state and input estimator for a linear time-invariant state space system with colored noise. This reformulation for linear systems bridges the gap between the neuroscientific theory and control theory, therefore opening up the possibility of evaluating it under the hood of standard control approaches. Through rigorous simulations under colored noises, the observer is shown to outperform Kalman Filter and Unknown Input Observer with minimal error in state and input estimation. It is tested against a wide range of scenarios and the proof of concept is demonstrated by applying it on a real system.

[1]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[2]  Simon McGregor,et al.  The free energy principle for action and perception: A mathematical review , 2017, 1705.09156.

[3]  Heiner Kuhlmann KALMAN-FILTERING WITH COLOURED MEASUREMENT NOISE FOR DEFORMATION ANALYSIS , 2003 .

[4]  Karl J. Friston,et al.  DEM: A variational treatment of dynamic systems , 2008, NeuroImage.

[5]  Emilio Frazzoli,et al.  Simultaneous Input and State Estimation for Linear Time-Varying Continuous-Time Stochastic Systems , 2017, IEEE Transactions on Automatic Control.

[6]  A. E. Bryson,et al.  Estimation using sampled data containing sequentially correlated noise. , 1967 .

[7]  Jie Chen,et al.  Design of unknown input observers and robust fault detection filters , 1996 .

[8]  Gordon Cheng,et al.  Adaptive Robot Body Learning and Estimation Through Predictive Coding , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  J. Hohwy The Predictive Mind , 2013 .

[10]  Karl J. Friston,et al.  The default-mode, ego-functions and free-energy: a neurobiological account of Freudian ideas , 2010, Brain : a journal of neurology.

[11]  A. Bryson,et al.  Linear filtering for time-varying systems using measurements containing colored noise , 1965 .

[12]  D. Simon Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[13]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[14]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[15]  Karl J. Friston,et al.  Reinforcement Learning or Active Inference? , 2009, PloS one.

[16]  J. Junkins,et al.  Optimal Estimation of Dynamic Systems , 2004 .

[17]  Horacio J. Marquez,et al.  Observer design for discrete-time linear systems with unknown disturbances , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[18]  Yong Li,et al.  Practical Approaches to Kalman Filtering with Time-Correlated Measurement Errors , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[19]  Mohamed Darouach,et al.  Kalman filtering with unknown inputs via optimal state estimation of singular systems , 1995 .

[20]  Corrado Pezzato,et al.  A Novel Adaptive Controller for Robot Manipulators Based on Active Inference , 2020, IEEE Robotics and Automation Letters.

[21]  Jinguang Chen,et al.  Analysis of Kalman Filter with Correlated Noises under Different Dependence ? , 2010 .

[22]  Karl J. Friston Hierarchical Models in the Brain , 2008, PLoS Comput. Biol..