Sleep, Sense or Transmit: Energy-Age Tradeoff for Status Update With Two-Threshold Optimal Policy

Age-of-Information (AoI), or simply age, which measures the data freshness, is essential for realtime Internet-of-Things (IoT) applications. On the other hand, energy saving is urgently required by many energy-constrained IoT devices. This paper studies the energy-age tradeoff for status update from a sensor to a monitor over an error-prone channel. The sensor can sleep, sense and transmit a new update, or retransmit by considering both sensing energy and transmit energy. An infinite-horizon average cost problem is formulated as a Markov decision process (MDP) with the objective of minimizing the weighted sum of average AoI and average energy consumption. By solving the associated discounted cost problem and analyzing the Markov chain under the optimal policy, we prove that there exists a threshold optimal stationary policy with only two thresholds, i.e., one threshold on the AoI at the transmitter (AoIT) and the other on the AoI at the receiver (AoIR). Moreover, the two thresholds can be efficiently found by a line search. Numerical results show the performance of the optimal policies and the tradeoff curves with different parameters. Comparisons with the conventional policies show that considering sensing energy is of significant impact on the policy design, and introducing sleep mode greatly expands the tradeoff range. Index Terms Age-of-information, sleep mode, energy-age tradeoff, Markov decision process J. Gong, J. Zhu and X. Ma are with the School of Computer Science and Engineering, and the Guangdong Key Laboratory of Information Security Technology, Sun Yat-sen University, Guangzhou 510006, China. Emails: gongj26@mail.sysu.edu.cn, zhujh26@mail2.sysu.edu.cn, maxiao@mail.sysu.edu.cn. X. Chen is with the School of Electronics and Information Engineering, Sun Yat-sen University, Guangzhou 510006, China. Email: chenxiang@mail.sysu.edu.cn.

[1]  Zhisheng Niu,et al.  Traffic-Aware Base Station Sleeping Control and Power Matching for Energy-Delay Tradeoffs in Green Cellular Networks , 2013, IEEE Transactions on Wireless Communications.

[2]  Linn I. Sennott,et al.  Constrained Average Cost Markov Decision Chains , 1993, Probability in the Engineering and Informational Sciences.

[3]  Harpreet S. Dhillon,et al.  AoI-Optimal Joint Sampling and Updating for Wireless Powered Communication Systems , 2020, IEEE Transactions on Vehicular Technology.

[4]  Ying Wang,et al.  Age-Optimal HARQ Design for Freshness-Critical Satellite-IoT Systems , 2020, IEEE Internet of Things Journal.

[5]  H. Vincent Poor,et al.  Online Timely Status Updates with Erasures for Energy Harvesting Sensors , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[6]  Roy D. Yates,et al.  Status updates through M/G/1/1 queues with HARQ , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[7]  Harpreet S. Dhillon,et al.  A Reinforcement Learning Framework for Optimizing Age of Information in RF-Powered Communication Systems , 2019, IEEE Transactions on Communications.

[8]  Zhisheng Niu,et al.  Characterizing Energy–Delay Tradeoff in Hyper-Cellular Networks With Base Station Sleeping Control , 2015, IEEE Journal on Selected Areas in Communications.

[9]  Branka Vucetic,et al.  Timely Status Update in Internet of Things Monitoring Systems: An Age-Energy Tradeoff , 2019, IEEE Internet of Things Journal.

[10]  Linn I. Sennott,et al.  Average Cost Optimal Stationary Policies in Infinite State Markov Decision Processes with Unbounded Costs , 1989, Oper. Res..

[11]  Harpreet S. Dhillon,et al.  On the Role of Age of Information in the Internet of Things , 2018, IEEE Communications Magazine.

[12]  Roy D. Yates,et al.  Timely updates over an erasure channel , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[13]  Sennur Ulukus,et al.  Age minimization in energy harvesting communications: Energy-controlled delays , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[14]  Jingxian Wu,et al.  Optimum Energy Efficiency and Age-of-Information Tradeoff in Multicast Scheduling , 2018, 2018 IEEE International Conference on Communications (ICC).

[15]  Elif Uysal-Biyikoglu,et al.  Optimal status updating with a finite-battery energy harvesting source , 2019, Journal of Communications and Networks.

[16]  Elif Uysal-Biyikoglu,et al.  Age-Optimal Channel Coding Blocklength for an M/G/1 Queue with HARQ , 2018, 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[17]  Shahab Farazi,et al.  Age of Information in Energy Harvesting Status Update Systems: When to Preempt in Service? , 2018, 2018 IEEE International Symposium on Information Theory (ISIT).

[18]  Elif Uysal-Biyikoglu,et al.  Scheduling status updates to minimize age of information with an energy harvesting sensor , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[19]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[20]  H. Vincent Poor,et al.  Age-Minimal Transmission for Energy Harvesting Sensors With Finite Batteries: Online Policies , 2018, IEEE Transactions on Information Theory.

[21]  Roy D. Yates,et al.  Real-time status: How often should one update? , 2012, 2012 Proceedings IEEE INFOCOM.

[22]  Roy D. Yates,et al.  Update or wait: How to keep your data fresh , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[23]  Xiang Chen,et al.  Energy-Age Tradeoff in Status Update Communication Systems with Retransmission , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[24]  Deniz Gündüz,et al.  Reinforcement Learning to Minimize Age of Information with an Energy Harvesting Sensor with HARQ and Sensing Cost , 2019, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[25]  H. Vincent Poor,et al.  On Timely Channel Coding with Hybrid ARQ , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[26]  Eytan Modiano,et al.  Scheduling Algorithms for Minimizing Age of Information in Wireless Broadcast Networks with Random Arrivals , 2017, IEEE Transactions on Mobile Computing.

[27]  Elif Uysal-Biyikoglu,et al.  Age of information under energy replenishment constraints , 2015, 2015 Information Theory and Applications Workshop (ITA).

[28]  Omur Ozel Timely Status Updating Through Intermittent Sensing and Transmission , 2020, 2020 IEEE International Symposium on Information Theory (ISIT).

[29]  Roy D. Yates,et al.  Lazy is timely: Status updates by an energy harvesting source , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[30]  Kun Chen,et al.  Age-of-information in the presence of error , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[31]  Deniz Gündüz,et al.  Average age of information with hybrid ARQ under a resource constraint , 2017, 2018 IEEE Wireless Communications and Networking Conference (WCNC).

[32]  Xiao Ma,et al.  Age and Energy Analysis for LDPC Coded Status Update With and Without ARQ , 2020, IEEE Internet of Things Journal.

[33]  Hani Mehrpouyan,et al.  Energy Harvesting Wireless Sensor Networks: Delay Analysis Considering Energy Costs of Sensing and Transmission , 2015, IEEE Transactions on Wireless Communications.

[34]  M. Cenk Gursoy,et al.  Age-Energy Tradeoff in Fading Channels with Packet-Based Transmissions , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[35]  Branka Vucetic,et al.  Real-Time Remote Estimation With Hybrid ARQ in Wireless Networked Control , 2019, IEEE Transactions on Wireless Communications.

[36]  Parimal Parag,et al.  On Real-Time Status Updates over Symbol Erasure Channels , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[37]  Shahab Farazi,et al.  Average age of information for status update systems with an energy harvesting server , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[38]  Guowang Miao,et al.  Base-Station Sleeping Control and Power Matching for Energy–Delay Tradeoffs With Bursty Traffic , 2016, IEEE Transactions on Vehicular Technology.