Optimal Strategies for Communication and Remote Estimation With an Energy Harvesting Sensor

We consider a remote estimation problem with an energy harvesting sensor and a remote estimator. The sensor observes the state of a discrete-time source which may be a finite state Markov chain or a multidimensional linear Gaussian system. It harvests energy from its environment (say, for example, through a solar cell) and uses this energy for the purpose of communicating with the estimator. Due to randomness of the energy available for communication, the sensor may not be able to communicate all of the time. The sensor may also want to save its energy for future communications. The estimator relies on messages communicated by the sensor to produce real-time estimates of the source state. We consider the problem of finding a communication scheduling strategy for the sensor and an estimation strategy for the estimator that jointly minimizes the expected sum of communication and distortion costs over a finite time horizon. Our goal of joint optimization leads to a decentralized decision-making problem. By viewing the problem from the estimator's perspective, we obtain a dynamic programming characterization for the decentralized decision-making problem that involves optimization over functions. Under some symmetry assumptions on the source statistics and the distortion metric, we show that an optimal communication strategy is described by easily computable thresholds and that the optimal estimate is a simple function of the most recently received sensor observation.

[1]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[2]  Ashutosh Nayyar,et al.  Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach , 2012, IEEE Transactions on Automatic Control.

[3]  Wei Wu,et al.  Optimal Sensor Querying: General Markovian and LQG Models With Controlled Observations , 2008, IEEE Transactions on Automatic Control.

[4]  Emanuele Garone,et al.  Sensor scheduling for energy constrained estimation in multi-hop Wireless Sensor Networks , 2010, 49th IEEE Conference on Decision and Control (CDC).

[5]  Ashutosh Nayyar,et al.  Structural results and explicit solution for two-player LQG systems on a finite time horizon , 2013, 52nd IEEE Conference on Decision and Control.

[6]  Tamer Basar,et al.  Common Information Based Markov Perfect Equilibria for Stochastic Games With Asymmetric Information: Finite Games , 2014, IEEE Transactions on Automatic Control.

[7]  Anahí Gallardo Velázquez,et al.  Conference , 1969, Journal of Neuroscience Methods.

[8]  S. Puntanen Inequalities: Theory of Majorization and Its Applications, Second Edition by Albert W. Marshall, Ingram Olkin, Barry C. Arnold , 2011 .

[9]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[10]  Bruce E. Hajek,et al.  Paging and Registration in Cellular Networks: Jointly Optimal Policies and an Iterative Algorithm , 2007, IEEE Transactions on Information Theory.

[11]  Yu-Chi Ho Team decision theory and information structures , 1980, Proceedings of the IEEE.

[12]  George Atia,et al.  Sleep Control for Tracking in Sensor Networks , 2010, IEEE Transactions on Signal Processing.

[13]  Ashutosh Nayyar,et al.  Decentralized Detection with Signaling , 2010 .

[14]  Mingyan Liu,et al.  Measurement Scheduling for Soil Moisture Sensing: From Physical Models to Optimal Control , 2010, Proceedings of the IEEE.

[15]  Mingyan Liu,et al.  A Wireless Soil Moisture Smart Sensor Web Using Physics-Based Optimal Control: Concept and Initial Demonstrations , 2010, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Ashutosh Nayyar,et al.  Sequential Decision Making in Decentralized Systems , 2011 .

[17]  Dimitri P. Bertsekas,et al.  Stochastic optimal control : the discrete time case , 2007 .

[18]  Richard M. Murray,et al.  On a stochastic sensor selection algorithm with applications in sensor scheduling and sensor coverage , 2006, Autom..

[19]  Duncan S. Callaway,et al.  Consolidated Dynamic Pricing of Power System Regulation , 2013, IEEE Transactions on Power Systems.

[20]  Ashutosh Nayyar,et al.  On globally optimal real-time encoding and decoding strategies in multi-terminal communication systems , 2008, 2008 47th IEEE Conference on Decision and Control.

[21]  T. Başar,et al.  Optimal Estimation with Limited Measurements , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[22]  Pravin Varaiya,et al.  Aggregate flexibility of a collection of loadsπ , 2013, 52nd IEEE Conference on Decision and Control.

[23]  José Claudio Geromel Global optimization of measurement strategies for linear stochastic systems , 1989, Autom..

[24]  John S. Baras,et al.  Adaptive Sampling for Linear State Estimation , 2009, SIAM J. Control. Optim..

[25]  Nuno C. Martins,et al.  Remote State Estimation With Communication Costs for First-Order LTI Systems , 2011, IEEE Transactions on Automatic Control.

[26]  Kameshwar Poolla,et al.  Dynamic pricing in consolidated ancillary service markets , 2013, 2013 European Control Conference (ECC).

[27]  Yu-Chi Ho,et al.  Team decision theory and information structures , 1980 .

[28]  Tamer Basar,et al.  Dynamic stochastic games with asymmetric information , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[29]  Ashutosh Nayyar,et al.  A sequential problem in decentralized detection with communication , 2009, 2009 7th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks.

[30]  Tamer Basar,et al.  Communication scheduling and remote estimation with energy harvesting sensor , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[31]  Jing Yang,et al.  Optimal Packet Scheduling in an Energy Harvesting Communication System , 2010, IEEE Transactions on Communications.

[32]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[33]  Ashutosh Nayyar,et al.  The Common-Information Approach to Decentralized Stochastic Control , 2014 .

[34]  M. Athans On the Determination of Optimal Costly Measurement Strategies for Linear Stochastic Systems , 1972 .

[35]  Tamer Basar,et al.  A dynamic transmitter-jammer game with asymmetric information , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[36]  J.P. Hespanha,et al.  Optimal communication logics in networked control systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[37]  Jing Yang,et al.  Transmission with Energy Harvesting Nodes in Fading Wireless Channels: Optimal Policies , 2011, IEEE Journal on Selected Areas in Communications.

[38]  George Atia,et al.  Sensor Scheduling for Energy-Efficient Target Tracking in Sensor Networks , 2010, IEEE Transactions on Signal Processing.

[39]  Ashutosh Nayyar,et al.  On the Structure of Real-Time Encoders and Decoders in a Multi-Terminal Communication System , 2009, ArXiv.

[40]  A Nayyar,et al.  A structural result for delayed sharing information structures , 2010, Proceedings of the 2010 American Control Conference.

[41]  Ashutosh Nayyar,et al.  Optimal Control Strategies in Delayed Sharing Information Structures , 2010, IEEE Transactions on Automatic Control.

[42]  Michael Athans,et al.  1972 IFAC congress paper: On the determination of optimal costly measurement strategies for linear stochastic systems , 1972 .

[43]  Pravin Varaiya,et al.  A statistically robust payment sharing mechanism for an aggregate of renewable energy producers , 2013, 2013 European Control Conference (ECC).

[44]  Emanuele Garone,et al.  Stochastic Sensor Scheduling for Energy Constrained Estimation in Multi-Hop Wireless Sensor Networks , 2011, IEEE Transactions on Automatic Control.

[45]  Sumitra Purkayastha,et al.  Simple proofs of two results on convolutions of unimodal distributions , 1998 .