Markov Decision Process Based Design of SWIPT Systems: Non-linear EH Circuits, Memory, and Impedance Mismatch

In this paper, we study simultaneous wireless information and power transfer (SWIPT) systems employing practical non-linear energy harvester (EH) circuits. Since the voltage across the reactive elements of realistic EH circuits cannot drop or rise instantaneously, EHs have memory which we model with a Markov decision process (MDP). Moreover, since an analytical model that accurately models all non-linear effects and the unavoidable impedance mismatch of EHs is not tractable, we propose a learning based model for the EH circuit. We optimize the input signal distribution for maximization of the harvested power under a constraint on the minimum mutual information between transmitter (TX) and information receiver (IR). We distinguish the cases where the MDP state is known and not known at TX and IR. When the MDP state is known, the formulated optimization problem for the harvested power is convex. In contrast, if TX and IR do not know the MDP state, the resulting optimization problem is non-convex and solved via alternating optimization, which is shown to yield a stationary point of the problem. Our simulation results reveal that the rate-power region of the considered SWIPT system depends on the symbol duration, the EH input power level, the EH impedance mismatch, and the type of EH circuit. In particular, a shorter symbol duration enables higher bit rates at the expense of a significant decrease in the average harvested power. Furthermore, whereas half-wave rectifiers outperform full-wave rectifiers in the low and medium input power regimes, full-wave rectifiers are preferable if the input power at the EH is high.

[1]  K. J. Ray Liu,et al.  On Energy Harvesting Gain and Diversity Analysis in Cooperative Communications , 2015, IEEE Journal on Selected Areas in Communications.

[2]  Ekram Hossain,et al.  Statistical Performance Modeling of Solar and Wind-Powered UAV Communications , 2021, IEEE Transactions on Mobile Computing.

[3]  James C. Bezdek,et al.  Some Notes on Alternating Optimization , 2002, AFSS.

[4]  Fabrice Rossi,et al.  Mean Absolute Percentage Error for regression models , 2016, Neurocomputing.

[5]  D. Vere-Jones Markov Chains , 1972, Nature.

[6]  Robert Schober,et al.  Rate-Power Region of SWIPT Systems Employing Nonlinear Energy Harvester Circuits with Memory , 2019, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[7]  A. Pugh The art of electronics. 2nd edn: By Paul Horowitz and Winfield Hill. Pp. 1125. Cambridge University Presss. 1989. £29.95, US$49.50 , 1990 .

[8]  Jae-Mo Kang,et al.  Adaptive Rate and Energy Harvesting Interval Control Based on Reinforcement Learning for SWIPT , 2018, IEEE Communications Letters.

[9]  Joel G. Smith,et al.  The Information Capacity of Amplitude- and Variance-Constrained Scalar Gaussian Channels , 1971, Inf. Control..

[10]  Derrick Wing Kwan Ng,et al.  Robust beamforming for SWIPT systems with non-linear energy harvesting model , 2016, 2016 IEEE 17th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[11]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[12]  Nabil Karami,et al.  Battery equivalent circuits and brief summary of components value determination of lithium ion: A review , 2015, 2015 Third International Conference on Technological Advances in Electrical, Electronics and Computer Engineering (TAEECE).

[13]  Zhengzhu Feng,et al.  Dynamic Programming for Structured Continuous Markov Decision Problems , 2004, UAI.

[14]  Xinen Zhu,et al.  Theoretical Analysis of RF-DC Conversion Efficiency for Class-F Rectifiers , 2014, IEEE Transactions on Microwave Theory and Techniques.

[15]  C. Martin 2015 , 2015, Les 25 ans de l’OMC: Une rétrospective en photos.

[16]  Derrick Wing Kwan Ng,et al.  Robust and Secure Wireless Communications via Intelligent Reflecting Surfaces , 2020, IEEE Journal on Selected Areas in Communications.

[17]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[18]  Jie Xu,et al.  A Generic Receiver Architecture for MIMO Wireless Power Transfer With Nonlinear Energy Harvesting , 2018, IEEE Signal Processing Letters.

[19]  Boris Hanin,et al.  Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activations , 2017, Mathematics.

[20]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[21]  Bruno Clerckx,et al.  A Learning Approach to Wireless Information and Power Transfer Signal and System Design , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  D. Lupo,et al.  Printed Half-Wave and Full-Wave Rectifier Circuits Based on Organic Diodes , 2013, IEEE Transactions on Electron Devices.

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  A. Collado,et al.  Optimal Waveforms for Efficient Wireless Power Transmission , 2014, IEEE Microwave and Wireless Components Letters.

[25]  Bruno Clerckx,et al.  Learning Modulation Design for SWIPT with Nonlinear Energy Harvester: Large and Small Signal Power Regimes , 2019, 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[26]  Rui Zhang,et al.  Wireless Information and Power Transfer: Architecture Design and Rate-Energy Tradeoff , 2012, IEEE Transactions on Communications.

[27]  E. Altman Constrained Markov Decision Processes , 1999 .

[28]  Shlomo Shamai,et al.  The capacity of average and peak-power-limited quadrature Gaussian channels , 1995, IEEE Trans. Inf. Theory.

[29]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[30]  Rui Zhang,et al.  MIMO Broadcasting for Simultaneous Wireless Information and Power Transfer , 2011, IEEE Transactions on Wireless Communications.

[31]  Jae-Mo Kang,et al.  Joint Tx Power Allocation and Rx Power Splitting for SWIPT System With Multiple Nonlinear Energy Harvesting Circuits , 2018, IEEE Wireless Communications Letters.

[32]  Jae-Mo Kang,et al.  Reinforcement Learning Based Adaptive Resource Allocation for Wireless Powered Communication Systems , 2020, IEEE Communications Letters.

[33]  Jae-Mo Kang,et al.  Wireless Information and Power Transfer: Rate-Energy Tradeoff for Nonlinear Energy Harvesting , 2018, IEEE Transactions on Wireless Communications.

[34]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[35]  H. Vincent Poor,et al.  Fundamentals of Wireless Information and Power Transfer: From RF Energy Harvester Models to Signal and System Designs , 2018, IEEE Journal on Selected Areas in Communications.

[36]  Yasser F. Al-Eryani Exact Performance of Wireless-Powered Communications with Maximum Ratio Combining , 2019, Wireless Personal Communications.

[37]  Saman Atapattu,et al.  Average Transmission Success Probability Bound for SWIPT Relay Networks , 2019, 2019 IEEE Wireless Communications and Networking Conference (WCNC).

[38]  Derrick Wing Kwan Ng,et al.  Conditional Capacity and Transmit Signal Design for SWIPT Systems With Multiple Nonlinear Energy Harvesting Receivers , 2020, IEEE Transactions on Communications.

[39]  W. Graham Richards,et al.  Art of electronics , 1983, Nature.

[40]  Symeon Chatzinotas,et al.  Cache-Aided Simultaneous Wireless Information and Power Transfer (SWIPT) With Relay Selection , 2019, IEEE Journal on Selected Areas in Communications.

[41]  Kathrin Klamroth,et al.  Biconvex sets and optimization with biconvex functions: a survey and extensions , 2007, Math. Methods Oper. Res..

[42]  Paul H. Siegel,et al.  Markov Processes Asymptotically Achieve the Capacity of Finite-State Intersymbol Interference Channels , 2004, IEEE Transactions on Information Theory.

[43]  K. J. Ray Liu,et al.  Rate-Energy Region of SWIPT for MIMO Broadcasting Under Nonlinear Energy Harvesting Model , 2017, IEEE Transactions on Wireless Communications.

[44]  Abbas Jamalipour,et al.  Wireless communications , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[45]  Lav R. Varshney,et al.  Transporting information and energy simultaneously , 2008, 2008 IEEE International Symposium on Information Theory.

[46]  Chengyong Si,et al.  On the equality constraints tolerance of Constrained Optimization Problems , 2014, Theor. Comput. Sci..

[47]  Christoph Schenk,et al.  Advanced Electronic Circuits , 1978 .

[48]  Luigi Grippo,et al.  On the convergence of the block nonlinear Gauss-Seidel method under convex constraints , 2000, Oper. Res. Lett..

[49]  David Tse,et al.  Fundamentals of Wireless Communication , 2005 .

[50]  Xinggan Zhang,et al.  Joint energy allocation and multiuser scheduling in SWIPT systems with energy harvesting , 2020, IET Commun..

[51]  Bruno Clerckx,et al.  Wireless Information and Power Transfer: Nonlinearity, Waveform Design, and Rate-Energy Tradeoff , 2016, IEEE Transactions on Signal Processing.

[52]  Anant Sahai,et al.  Shannon meets Tesla: Wireless information and power transfer , 2010, 2010 IEEE International Symposium on Information Theory.

[53]  Liang Hong,et al.  The Analysis of Impedance Matching Problem in RF Circuit Design , 2010, 2010 International Forum on Information Technology and Applications.

[54]  Jae-Mo Kang,et al.  Dynamic Power Splitting for SWIPT With Nonlinear Energy Harvesting in Ergodic Fading Channel , 2018, IEEE Internet of Things Journal.

[55]  Yurii Nesterov,et al.  Interior-point polynomial algorithms in convex programming , 1994, Siam studies in applied mathematics.

[56]  Derrick Wing Kwan Ng,et al.  Practical Non-Linear Energy Harvesting Model and Resource Allocation for SWIPT Systems , 2015, IEEE Communications Letters.