Markov Decision Process Based Design of SWIPT Systems: Non-Linear EH Circuits, Memory, and Impedance Mismatch

In this paper, we study simultaneous wireless information and power transfer (SWIPT) systems employing practical non-linear energy harvester (EH) circuits. Since the voltage across the reactive elements of realistic EH circuits cannot drop or rise instantaneously, EHs have memory which we model with a Markov decision process (MDP). Moreover, since an analytical model that accurately models all non-linear effects and the unavoidable impedance mismatch of EHs is not tractable, we propose a learning based model for the EH circuit. We optimize the input signal distribution for maximization of the harvested power under a constraint on the minimum mutual information between transmitter (TX) and information receiver (IR). We distinguish the cases where the MDP state is known and not known at TX and IR. When the MDP state is known, the formulated optimization problem for the harvested power is convex. In contrast, if TX and IR do not know the MDP state, the resulting optimization problem is non-convex and solved via alternating optimization, which is shown to yield a limit point of the problem. Our simulation results reveal that the rate-power region of the considered SWIPT system depends on the symbol duration, the EH input power level, the EH impedance mismatch, and the type of EH circuit. In particular, a shorter symbol duration enables higher bit rates at the expense of a significant decrease in the average harvested power. Furthermore, whereas half-wave rectifiers outperform full-wave rectifiers in the low and medium input power regimes, full-wave rectifiers are preferable if the input power at the EH is high.

[1]  Customer Contact,et al.  Keysight Technologies Inc. , 2022, Corporate Philanthropy Report.

[2]  Ekram Hossain,et al.  Statistical Performance Modeling of Solar and Wind-Powered UAV Communications , 2021, IEEE Transactions on Mobile Computing.

[3]  Jae-Mo Kang,et al.  Reinforcement Learning Based Adaptive Resource Allocation for Wireless Powered Communication Systems , 2020, IEEE Communications Letters.

[4]  Xinggan Zhang,et al.  Joint energy allocation and multiuser scheduling in SWIPT systems with energy harvesting , 2020, IET Commun..

[5]  Derrick Wing Kwan Ng,et al.  Robust and Secure Wireless Communications via Intelligent Reflecting Surfaces , 2019, IEEE Journal on Selected Areas in Communications.

[6]  Robert Schober,et al.  Rate-Power Region of SWIPT Systems Employing Nonlinear Energy Harvester Circuits with Memory , 2019, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[7]  Bruno Clerckx,et al.  Learning Modulation Design for SWIPT with Nonlinear Energy Harvester: Large and Small Signal Power Regimes , 2019, 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[8]  Yasser F. Al-Eryani Exact Performance of Wireless-Powered Communications with Maximum Ratio Combining , 2019, Wireless Personal Communications.

[9]  Derrick Wing Kwan Ng,et al.  Conditional Capacity and Transmit Signal Design for SWIPT Systems With Multiple Nonlinear Energy Harvesting Receivers , 2019, IEEE Transactions on Communications.

[10]  Saman Atapattu,et al.  Average Transmission Success Probability Bound for SWIPT Relay Networks , 2019, 2019 IEEE Wireless Communications and Networking Conference (WCNC).

[11]  Jie Xu,et al.  A Generic Receiver Architecture for MIMO Wireless Power Transfer With Nonlinear Energy Harvesting , 2018, IEEE Signal Processing Letters.

[12]  Jae-Mo Kang,et al.  Adaptive Rate and Energy Harvesting Interval Control Based on Reinforcement Learning for SWIPT , 2018, IEEE Communications Letters.

[13]  Bruno Clerckx,et al.  A Learning Approach to Wireless Information and Power Transfer Signal and System Design , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[15]  Jae-Mo Kang,et al.  Dynamic Power Splitting for SWIPT With Nonlinear Energy Harvesting in Ergodic Fading Channel , 2018, IEEE Internet of Things Journal.

[16]  Jae-Mo Kang,et al.  Joint Tx Power Allocation and Rx Power Splitting for SWIPT System With Multiple Nonlinear Energy Harvesting Circuits , 2018, IEEE Wireless Communications Letters.

[17]  H. Vincent Poor,et al.  Fundamentals of Wireless Information and Power Transfer: From RF Energy Harvester Models to Signal and System Designs , 2018, IEEE Journal on Selected Areas in Communications.

[18]  Jae-Mo Kang,et al.  Wireless Information and Power Transfer: Rate-Energy Tradeoff for Nonlinear Energy Harvesting , 2018, IEEE Transactions on Wireless Communications.

[19]  B. Hanin Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activations , 2017, Mathematics.

[20]  K. J. Ray Liu,et al.  Rate-Energy Region of SWIPT for MIMO Broadcasting Under Nonlinear Energy Harvesting Model , 2017, IEEE Transactions on Wireless Communications.

[21]  Bruno Clerckx,et al.  Wireless Information and Power Transfer: Nonlinearity, Waveform Design, and Rate-Energy Tradeoff , 2016, IEEE Transactions on Signal Processing.

[22]  Fabrice Rossi,et al.  Mean Absolute Percentage Error for regression models , 2016, Neurocomputing.

[23]  Derrick Wing Kwan Ng,et al.  Robust beamforming for SWIPT systems with non-linear energy harvesting model , 2016, 2016 IEEE 17th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[24]  K. J. Ray Liu,et al.  On Energy Harvesting Gain and Diversity Analysis in Cooperative Communications , 2015, IEEE Journal on Selected Areas in Communications.

[25]  Derrick Wing Kwan Ng,et al.  Practical Non-Linear Energy Harvesting Model and Resource Allocation for SWIPT Systems , 2015, IEEE Communications Letters.

[26]  Nabil Karami,et al.  Battery equivalent circuits and brief summary of components value determination of lithium ion: A review , 2015, 2015 Third International Conference on Technological Advances in Electrical, Electronics and Computer Engineering (TAEECE).

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Chengyong Si,et al.  On the equality constraints tolerance of Constrained Optimization Problems , 2014, Theor. Comput. Sci..

[29]  A. Collado,et al.  Optimal Waveforms for Efficient Wireless Power Transmission , 2014, IEEE Microwave and Wireless Components Letters.

[30]  Xinen Zhu,et al.  Theoretical Analysis of RF-DC Conversion Efficiency for Class-F Rectifiers , 2014, IEEE Transactions on Microwave Theory and Techniques.

[31]  D. Lupo,et al.  Printed Half-Wave and Full-Wave Rectifier Circuits Based on Organic Diodes , 2013, IEEE Transactions on Electron Devices.

[32]  Rui Zhang,et al.  Wireless Information and Power Transfer: Architecture Design and Rate-Energy Tradeoff , 2012, IEEE Transactions on Communications.

[33]  Rui Zhang,et al.  MIMO Broadcasting for Simultaneous Wireless Information and Power Transfer , 2011, IEEE Transactions on Wireless Communications.

[34]  Liang Hong,et al.  The Analysis of Impedance Matching Problem in RF Circuit Design , 2010, 2010 International Forum on Information Technology and Applications.

[35]  Anant Sahai,et al.  Shannon meets Tesla: Wireless information and power transfer , 2010, 2010 IEEE International Symposium on Information Theory.

[36]  Stephen P. Boyd,et al.  Convex Optimization , 2004, IEEE Transactions on Automatic Control.

[37]  Lav R. Varshney,et al.  Transporting information and energy simultaneously , 2008, 2008 IEEE International Symposium on Information Theory.

[38]  Kathrin Klamroth,et al.  Biconvex sets and optimization with biconvex functions: a survey and extensions , 2007, Math. Methods Oper. Res..

[39]  Andreas F. Molisch,et al.  Wireless Communications , 2005 .

[40]  David Tse,et al.  Fundamentals of Wireless Communication , 2005 .

[41]  Zhengzhu Feng,et al.  Dynamic Programming for Structured Continuous Markov Decision Problems , 2004, UAI.

[42]  Paul H. Siegel,et al.  Markov Processes Asymptotically Achieve the Capacity of Finite-State Intersymbol Interference Channels , 2004, IEEE Transactions on Information Theory.

[43]  James C. Bezdek,et al.  Some Notes on Alternating Optimization , 2002, AFSS.

[44]  L. Grippo,et al.  On the convergence of the block nonlinear Gauss-Seidel method under convex constraints , 2000, Oper. Res. Lett..

[45]  E. Altman Constrained Markov Decision Processes , 1999 .

[46]  Shlomo Shamai,et al.  The capacity of average and peak-power-limited quadrature Gaussian channels , 1995, IEEE Trans. Inf. Theory.

[47]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[48]  W. Graham Richards,et al.  Art of electronics , 1983, Nature.

[49]  Joel G. Smith,et al.  The Information Capacity of Amplitude- and Variance-Constrained Scalar Gaussian Channels , 1971, Inf. Control..

[50]  Symeon Chatzinotas,et al.  Cache-Aided Simultaneous Wireless Information and Power Transfer (SWIPT) With Relay Selection , 2019, IEEE Journal on Selected Areas in Communications.

[51]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[52]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[53]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[54]  A. Pugh The art of electronics. 2nd edn: By Paul Horowitz and Winfield Hill. Pp. 1125. Cambridge University Presss. 1989. £29.95, US$49.50 , 1990 .

[55]  Christoph Schenk,et al.  Advanced Electronic Circuits , 1978 .

[56]  D. Vere-Jones Markov Chains , 1972, Nature.