Reinforcement learning approach to learning human experience in tuning cavity filters

Owing to the rapid development of the communication industry, various kinds of radio frequency components are in great demand and put into mass production. Among them, passive devices such as microwave cavity filters, duplexers and combiners have experienced fast and unexpected upgrades. However, the tuning process of these products, which is always manually operated, still seems hard to be automatically replaced or improved because of the difficulties in extracting human experience. In this study, we make deep investigations into some previous automatic cavity filter tuning solutions, especially the ones using intelligent algorithms. In addition, we propose the method of intelligent tuning based on the reinforcement learning algorithm which dynamically extracts the human strategies during the tuning process. The experimental results prove the powerful performance of reinforcement learning in mastering human skills.

[1]  Raafat R. Mansour,et al.  Fully Automated RF/Microwave Filter Tuning by Extracting Human Experience Using Fuzzy Controllers , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[2]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[3]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[4]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[5]  Mateusz Mazur,et al.  Artificial Neural Network in Microwave Cavity Filter Tuning , 2012 .

[6]  C.F.N. Cowan,et al.  Intelligent alignment of waveguide filters using a machine learning approach , 1989 .

[7]  O. Moreira-Tamayo,et al.  Filter tuning system using fuzzy logic , 1994 .

[8]  R. Vahldieck,et al.  Automated computer-controlled tuning of waveguide filters using adaptive network models , 2001 .

[9]  Jin Huang,et al.  Influence and tuning of tunable screws for microwave filters using least squares support vector regression , 2010 .

[10]  H. L. Thai,et al.  Computer-Aided Filter Alignment and Diagnosis , 1978, 1978 IEEE-MTT-S International Microwave Symposium Digest.

[11]  Jerzy Julian Michalski.  ARTIFICIAL NEURAL NETWORKS APPROACH IN MICROWAVE FILTER TUNING , 2010 .

[12]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[13]  J. Dunsmore,et al.  Tuning band pass filters in the time domain , 1999, 1999 IEEE MTT-S International Microwave Symposium Digest (Cat. No.99CH36282).

[14]  Giuseppe Macchiarella,et al.  An Original Technique for Computer-Aided Tuning of Microwave Filters , 2001, 2001 31st European Microwave Conference.

[15]  L. Accatino.  Computer-Aided Tuning of Microwave Filters , 1986, 1986 IEEE MTT-S International Microwave Symposium Digest.