Reinforcement learning vibration control for a flexible hinged plate

Abstract A reinforcement learning (RL) vibration control method for a flexible hinged plate is developed, including combined bending and torsional vibrations. The experimental setup is constructed. Two laser displacement sensors are used as detection sensors, and two-channel piezoelectric actuators are used to suppress both bending and torsional vibrations simultaneously. A method combining finite element modeling (FEM) and experimental identification is applied to obtain an accurate model of the system. The obtained model is constructed as an RL environment, and a deep deterministic policy gradient (DDPG) RL algorithm based on the priority experience replay (PER) is designed to train modal controllers. The RL modal controllers were transferred to the real experimental system by using the parameter transfer method, and the vibration control experiments were conducted by combining the bending and torsional vibration control method. Simulation and experimental results demonstrate that the controller trained by the proposed deep RL algorithm has better control effects compared with PD control, especially for small amplitude vibration.

[1]  Wei Zhang,et al.  Adaptive Fuzzy Control for Attitude Stabilization of Spacecraft with Deployable Composite Laminated Solar Array , 2020, Complex..

[2]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[3]  Xiaoqiang Tang,et al.  Research on the configuration of cable-driven parallel robots for vibration suppression of spatial flexible structures , 2020 .

[4]  K. Chandrashekhara,et al.  Active buckling control of smart composite plates-finite-element analysis , 1993 .

[5]  Wail Gueaieb,et al.  Online model-free controller for flexible wing aircraft: a policy iteration-based reinforcement learning approach , 2019, International Journal of Intelligent Robotics and Applications.

[6]  W. Zhang,et al.  Vibration suppression of cantilevered piezoelectric laminated composite rectangular plate subjected to aerodynamic force in hygrothermal environment , 2020 .

[7]  Qiu Zhicheng,et al.  Fuzzy fast terminal sliding mode vibration control of a two-connected flexible plate using laser sensors , 2016 .

[8]  Ken Chen,et al.  Learning-based Variable Compliance Control for Robotic Assembly , 2018 .

[9]  Tom Schaul,et al.  Prioritized Experience Replay , 2015, ICLR.

[10]  Ye-Hwa Chen,et al.  Optimal Robust Position Control With Input Shaping for Flexible Solar Array Drive System: A Fuzzy-Set Theoretic Approach , 2019, IEEE Transactions on Fuzzy Systems.

[11]  Nemanja D. Zorić,et al.  Active vibration control of smart composite plates using optimized self-tuning fuzzy logic controller with optimization of placement, sizing and orientation of PFRC actuators , 2019, Journal of Sound and Vibration.

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Jinkun Liu,et al.  Adaptive neural network vibration control of a flexible aircraft wing system with input signal quantization , 2020 .

[14]  Okyay Kaynak,et al.  Dynamical Modeling and Boundary Vibration Control of a Rigid-Flexible Wing System , 2020, IEEE/ASME Transactions on Mechatronics.

[15]  Marcin Andrychowicz,et al.  Hindsight Experience Replay , 2017, NIPS.

[16]  Onur Avci,et al.  Active vibration control of flexible cantilever plates using piezoelectric materials and artificial neural networks , 2016 .

[17]  M. Azimi,et al.  Dynamic modeling and vibration control of a coupled rigid-flexible high-order structural system: A comparative study , 2020, Aerospace Science and Technology.

[18]  Meiyan Zhang,et al.  On-orbit modal identification for vibration suppression of flexible aerospace structure using reaction wheel actuator , 2020 .

[19]  Manu Sharma,et al.  Active structural vibration control: Robust to temperature variations , 2012 .

[20]  Wei He,et al.  Reinforcement Learning Control of a Flexible Two-Link Manipulator: An Experimental Investigation , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[21]  Jianjun Ma,et al.  Online integral reinforcement learning control for an uncertain highly flexible aircraft using state and output feedback , 2021 .

[22]  Bidyadhar Subudhi,et al.  Direct adaptive control of a flexible robot using reinforcement learning , 2010, 2010 International Conference on Industrial Electronics, Control and Robotics.

[23]  Z. Luo Direct strain feedback control of flexible robot arms: new theoretical and experimental results , 1993, IEEE Trans. Autom. Control..

[24]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[25]  Marco Amabili,et al.  Active vibration control of a sandwich plate by non-collocated positive position feedback , 2015 .

[26]  Bidyadhar Subudhi,et al.  Real-Time Adaptive Control of a Flexible Manipulator Using Reinforcement Learning , 2012, IEEE Transactions on Automation Science and Engineering.

[27]  Andrew Y. Ng,et al.  Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping , 1999, ICML.

[28]  Yuchen She,et al.  Constrained motion planning of free-float dual-arm space manipulator via deep reinforcement learning , 2021 .

[29]  Hui Shen,et al.  Secure Communication Scheme Based on a New 5D Multistable Four-Wing Memristive Hyperchaotic System with Disturbance Inputs , 2020, Complex..

[30]  Guo Chaoyong,et al.  Active control technology for flexible solar array disturbance suppression , 2020 .

[31]  T. S. Lee,et al.  A critical review of modelling methods for flexible and rigid link manipulators , 2020, Journal of the Brazilian Society of Mechanical Sciences and Engineering.

[32]  D. Asadi,et al.  Active flutter control of thin walled wing-engine system using piezoelectric actuators , 2020 .

[33]  Fang An,et al.  Dynamic behavior of time-delayed acceleration feedback controller for active vibration control of flexible structures , 2014 .