Minimum-Latency FEC Design With Delayed Feedback: Mathematical Modeling and Efficient Algorithms

In this paper, we consider the packet-level forward error correction (FEC) code design, without feedback or with delayed feedback, for achieving the minimum <italic>end-to-end latency</italic>, i.e., the latency between the time that packet is generated at the source and its <italic>in-order delivery</italic> to the application layer of the destination. We first show that the minimum-latency FEC design problem can be modeled as a partially observable Markov decision process (POMDP), and hence the optimal code construction can be obtained by solving the corresponding POMDP. However, solving the POMDP optimally is in general difficult unless its state and action space is very small. To this end, we propose an efficient heuristic algorithm, namely the majority vote policy, for obtaining a high quality approximate solution. We also derive the tight lower and upper bounds of the optimal state values of this POMDP, based on which a more sophisticated <inline-formula> <tex-math notation="LaTeX">$D$ </tex-math></inline-formula>-step search algorithm can be implemented for obtaining near-optimal solutions. The simulation results show that the proposed code designs via solving the POMDP, either with the majority vote policy or the <inline-formula> <tex-math notation="LaTeX">$D$ </tex-math></inline-formula>-step search algorithm, strictly outperform the existing schemes, for both cases, without or with only delayed feedback.

[1]  Joelle Pineau,et al.  Online Planning Algorithms for POMDPs , 2008, J. Artif. Intell. Res..

[2]  Devavrat Shah,et al.  Feedback-Based Online Network Coding , 2009, IEEE Transactions on Information Theory.

[3]  Edward J. Sondik,et al.  The optimal control of par-tially observable Markov processes , 1971 .

[4]  Yalin Evren Sagduyu,et al.  Adaptive network coding for scheduling real-time traffic with hard deadlines , 2012, MobiHoc '12.

[5]  Chenyang Yang,et al.  Radio Resource Management for Ultra-Reliable and Low-Latency Communications , 2017, IEEE Communications Magazine.

[6]  Muriel Médard,et al.  Design of FEC for Low Delay in 5G , 2017, IEEE Journal on Selected Areas in Communications.

[7]  Anthony Ephremides,et al.  Reliable Spectrum Sensing and Opportunistic Access in Network-Coded Communications , 2014, IEEE Journal on Selected Areas in Communications.

[8]  Ramón Agüero,et al.  Joint Scheduling and Coding for Low In-Order Delivery Delay Over Lossy Paths With Delayed Feedback , 2018, IEEE/ACM Transactions on Networking.

[9]  Dong Nguyen,et al.  Network coding-based wireless media transmission using POMDP , 2009, 2009 17th International Packet Video Workshop.

[10]  Devavrat Shah,et al.  Network Coding Meets TCP , 2008, IEEE INFOCOM 2009.

[11]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[12]  Xiaoli Xu,et al.  Batched Network Coding With Adaptive Recoding for Multi-Hop Erasure Channels With Memory , 2018, IEEE Transactions on Communications.

[13]  Andy Sutton,et al.  Next Generation Protocols – Market Drivers and Key Scenarios , 2016 .

[14]  Nikos A. Vlassis,et al.  Perseus: Randomized Point-based Value Iteration for POMDPs , 2005, J. Artif. Intell. Res..

[15]  Edward J. Sondik,et al.  The Optimal Control of Partially Observable Markov Processes over a Finite Horizon , 1973, Oper. Res..

[16]  Branka Vucetic,et al.  Short Block-Length Codes for Ultra-Reliable Low Latency Communications , 2019, IEEE Communications Magazine.

[17]  Muriel Médard,et al.  A coded generalization of selective repeat ARQ , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[18]  David Tse,et al.  Analysis on packet resequencing for reliable network protocols , 2005, Perform. Evaluation.

[19]  Muriel Médard,et al.  Tiny Codes for Guaranteeable Delay , 2018, IEEE Journal on Selected Areas in Communications.

[20]  IMT Vision – Framework and overall objectives of the future development of IMT for 2020 and beyond M Series Mobile , radiodetermination , amateur and related satellite services , 2015 .

[21]  Xiaoli Xu,et al.  Two-Phase Cooperative Broadcasting Based on Batched Network Code , 2015, IEEE Transactions on Communications.

[22]  Frank H. P. Fitzek,et al.  Caterpillar RLNC With Feedback (CRLNC-FB): Reducing Delay in Selective Repeat ARQ Through Coding , 2018, IEEE Access.

[23]  Leslie Pack Kaelbling,et al.  Learning Policies for Partially Observable Environments: Scaling Up , 1997, ICML.