Online Continual Learning for Control of Mobile Robots

This work presents a novel approach which integrates deep learning, online learning and continual learning paradigms for adaptive control for robotic systems. Deep learning allows generalising knowledge about the robot, while online learning can adapt to variable operating conditions, and continual learning enables remembering previous knowledge. The proposed method approximates the inverse dynamics of the robot, which is formulated as a regression problem. With a minimum knowledge of the robot's dynamics, the proposed method shows its capability to reduce tracking errors online by continuously learning and compensating for internal and external changing conditions. Furthermore, the simulation results show that the proposed approach with online continual learning improves the control performance of ground and aerial mobile robots.

[1]  Savitha Ramasamy,et al.  Online Continual Learning Using Enhanced Random Vector Functional Link Networks , 2022, ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Simone Calderara,et al.  Avalanche: an End-to-End Library for Continual Learning , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  D. Bacciu,et al.  Continual Learning for Recurrent Neural Networks: an Empirical Evaluation , 2021, Neural Networks.

[4]  Hyunwoo J. Kim,et al.  Online Continual Learning in Image Classification: An Empirical Survey , 2021, Neurocomputing.

[5]  Bernhard Sick,et al.  CLeaR: An adaptive continual learning framework for regression tasks , 2021, AI Perspectives.

[6]  Ioannis Kanellos,et al.  A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks , 2020, Neural Networks.

[7]  Erdal Kayacan,et al.  Online Deep Fuzzy Learning for Control of Nonlinear Systems Using Expert Knowledge , 2020, IEEE Transactions on Fuzzy Systems.

[8]  Dogan Kircali,et al.  An Intelligent Hybrid Artificial Neural Network-Based Approach for Control of Aerial Robots , 2020, J. Intell. Robotic Syst..

[9]  Tinne Tuytelaars,et al.  A Continual Learning Survey: Defying Forgetting in Classification Tasks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  David Filliat,et al.  Continual Learning for Robotics , 2019, Inf. Fusion.

[11]  Erdal Kayacan,et al.  Online Deep Learning for Improved Trajectory Tracking of Unmanned Aerial Vehicles Using Expert Knowledge , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[12]  Erdal Kayacan,et al.  Knowledge Transfer Between Robots with Similar Dynamics for High-Accuracy Impromptu Trajectory Tracking , 2019, 2019 18th European Control Conference (ECC).

[13]  Marc'Aurelio Ranzato,et al.  Continual Learning with Tiny Episodic Memories , 2019, ArXiv.

[14]  Marc'Aurelio Ranzato,et al.  Efficient Lifelong Learning with A-GEM , 2018, ICLR.

[15]  Martin V. Butz,et al.  Learning, Planning, and Control in a Monolithic Neural Event Inference Architecture , 2018, Neural Networks.

[16]  Mohsen Guizani,et al.  Unmanned Aerial Vehicles (UAVs): A Survey on Civil Applications and Key Research Challenges , 2018, IEEE Access.

[17]  Stefan Wermter,et al.  Continual Lifelong Learning with Neural Networks: A Review , 2018, Neural Networks.

[18]  Steven C. H. Hoi,et al.  Online Learning: A Comprehensive Survey , 2018, Neurocomputing.

[19]  Philip H. S. Torr,et al.  Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence , 2018, ECCV.

[20]  Angela P. Schoellig,et al.  Design of deep neural networks as add-on blocks for improving impromptu trajectory tracking , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[21]  Ming Liu,et al.  Deep-learning in Mobile Robotics - from Perception to Control Systems: A Survey on Why and Why not , 2016, ArXiv.

[22]  Andrei A. Rusu,et al.  Overcoming catastrophic forgetting in neural networks , 2016, Proceedings of the National Academy of Sciences.

[23]  Erdal Kayacan,et al.  Y6 tricopter autonomous evacuation in an Indoor Environment using Q-learning algorithm , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[24]  Derek Hoiem,et al.  Learning without Forgetting , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Jürgen Schmidhuber,et al.  Training Very Deep Networks , 2015, NIPS.

[26]  Peter I. Corke,et al.  Multirotor Aerial Vehicles: Modeling, Estimation, and Control of Quadrotor , 2012, IEEE Robotics & Automation Magazine.

[27]  N. McClamroch,et al.  Published online in Wiley Online Library (wileyonlinelibrary.com) DOI: 10.1002/asjc.567 NONLINEAR ROBUST TRACKING CONTROL OF A QUADROTOR UAV ON SE(3) , 2022 .

[28]  Shweda Mohan,et al.  Decoupled Dynamic Control of Unicycle Robot Using Integral Linear Quadratic Regulator and Sliding Mode Controller , 2016 .

[29]  Alberto Isidori,et al.  Elementary Theory of Nonlinear Feedback for Multi-Input Multi-Output Systems , 1989 .