Markov decision process and network coding for reliable data transmission in wireless sensor and actor networks

Abstract In delay sensitive applications of Wireless Sensor and Actor Networks (WSANs), achieving reliable data collection in the presence of a faulty region is a challenging issue. Sensed data may not be relayed to an actor due to fluctuations of wireless links in faulty regions. In this paper, a reliable data transmission mechanism using opportunistic encoding has been proposed for a WSAN with faulty nodes. A network coding approach has been designed by considering link loss rates and appropriate level of redundancy to achieve reliable data delivery. Further, a Markov Decision Process (MDP) has been proposed for opportunistic network coding decisions. The proposed mechanism determines the level of packet redundancy adaptively in the network coding process to improve reliable data collection and to reduce the number of data transmissions. Moreover, the state of a link changes with dynamic adverse environmental conditions, such as rainfall, fog and high temperature. The proposed mechanism analyzes the quality of link states and determines the applicability of network coding to improve the data transmission reliability and to reduce the number of data transmissions. Further, efficacy of the proposed mechanism has been shown through simulation results by considering number of data transmissions, average delivery delay, energy consumptions and network lifetime.

[1]  Rashmi Ranjan Rout,et al.  Adaptive buffering using Markov Decision Process in tree-based Wireless Sensor and Actor Networks , 2017, Comput. Electr. Eng..

[2]  Lei Shi,et al.  A Compressive Sensing-Based Approach to End-to-End Network Traffic Reconstruction , 2020, IEEE Transactions on Network Science and Engineering.

[3]  Sudip Misra,et al.  Detection of dumb nodes in a stationary wireless sensor network , 2014, 2014 Annual IEEE India Conference (INDICON).

[4]  Sudip Misra,et al.  Reliable and Efficient Data Acquisition in Wireless Sensor Networks in the Presence of Transfaulty Nodes , 2016, IEEE Transactions on Network and Service Management.

[5]  Athanasios V. Vasilakos,et al.  Real-time data report and task execution in wireless sensor and actuator networks using self-aware mobile actuators , 2013, Comput. Commun..

[6]  Houbing Song,et al.  Rethinking Behaviors and Activities of Base Stations in Mobile Cellular Networks Based on Big Data Analysis , 2020, IEEE Transactions on Network Science and Engineering.

[7]  Koushik Kar,et al.  Dynamic node activation in networks of rechargeable sensors , 2005, IEEE/ACM Transactions on Networking.

[8]  Soumya K. Ghosh,et al.  Adaptive data aggregation and energy efficiency using network coding in a clustered wireless sensor network: An analytical approach , 2014, Comput. Commun..

[9]  Christina Fragouli,et al.  SenseCode: Network coding for reliable sensor networks , 2013, TOSN.

[10]  Wei Shen,et al.  PriorityMAC: A Priority-Enhanced MAC Protocol for Critical Traffic in Industrial Wireless Sensor and Actuator Networks , 2014, IEEE Transactions on Industrial Informatics.

[11]  Sajal K. Das,et al.  Energy-Efficient Randomized Switching for Maximizing Lifetime in Tree-Based Wireless Sensor Networks , 2015, IEEE/ACM Transactions on Networking.

[12]  Mohammad S. Obaidat,et al.  Existence of dumb nodes in stationary wireless sensor networks , 2014, J. Syst. Softw..

[13]  Yacine Challal,et al.  Energy efficiency in wireless sensor networks: A top-down survey , 2014, Comput. Networks.

[14]  Peng Zhang,et al.  Energy-Efficient Multi-Constraint Routing Algorithm With Load Balancing for Smart City Applications , 2016, IEEE Internet of Things Journal.

[15]  Jörg Henkel,et al.  RDTS: A Reliable Erasure-Coding Based Data Transfer Scheme for Wireless Sensor Networks , 2011, 2011 IEEE 17th International Conference on Parallel and Distributed Systems.

[16]  Jie Li,et al.  APMD: A fast data transmission protocol with reliability guarantee for pervasive sensing data communication , 2017, Pervasive Mob. Comput..

[17]  Mohsen Sharifi,et al.  Connectivity Weakness Impacts on Coordination in Wireless Sensor and Actor Networks , 2013, IEEE Communications Surveys & Tutorials.

[18]  Kumpati S. Narendra,et al.  Learning Automata - A Survey , 1974, IEEE Trans. Syst. Man Cybern..

[19]  Soumya K. Ghosh,et al.  Enhancement of Lifetime using Duty Cycle and Network Coding in Wireless Sensor Networks , 2013, IEEE Transactions on Wireless Communications.

[20]  Ian F. Akyildiz,et al.  GARUDA: Achieving Effective Reliability for Downstream Communication in Wireless Sensor Networks , 2008, IEEE Transactions on Mobile Computing.

[21]  Athanasios V. Vasilakos,et al.  Learning Automata-Based Fault-Tolerant System for Dynamic Autonomous Unmanned Vehicular Networks , 2017, IEEE Systems Journal.

[22]  Hamed Yousefi,et al.  Score based reliable routing in wireless sensor networks , 2009, 2009 International Conference on Information Networking.

[23]  Dingde Jiang,et al.  Fine-granularity inference and estimations to network traffic for SDN , 2018, PloS one.

[24]  Rashmi Ranjan Rout,et al.  Markov Decision Process-Based Switching Algorithm for Sustainable Rechargeable Wireless Sensor Networks , 2016, IEEE Sensors Journal.

[25]  Zhihan Lv,et al.  Soft frequency reuse-based optimization algorithm for energy efficiency of multi-cell networks , 2018, Comput. Electr. Eng..

[26]  Winston Khoon Guan Seah,et al.  Reliability in wireless sensor networks: A survey and challenges ahead , 2015, Comput. Networks.

[27]  Sudip Misra,et al.  Connectivity Reestablishment in Self-Organizing Sensor Networks with Dumb Nodes , 2016, ACM Trans. Auton. Adapt. Syst..

[28]  Peng Zhang,et al.  QoS constraints-based energy-efficient model in cloud computing networks for multimedia clinical issues , 2016, Multimedia Tools and Applications.

[29]  Mohammad S. Obaidat,et al.  D3: distributed approach for the detection of dumb nodes in wireless sensor networks , 2017, Int. J. Commun. Syst..

[30]  Frederick S. Hillier,et al.  Introduction of Operations Research , 1967 .

[31]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[32]  Qi Zhang,et al.  An unequal redundancy level-based mechanism for reliable data collection in wireless sensor networks , 2016, EURASIP J. Wirel. Commun. Netw..

[33]  Zhihan Lv,et al.  A Joint Multi-Criteria Utility-Based Network Selection Approach for Vehicle-to-Infrastructure Networking , 2018, IEEE Transactions on Intelligent Transportation Systems.

[34]  Yusheng Ji,et al.  Coded packets over lossy links: A redundancy-based mechanism for reliable and fast data collection in sensor networks , 2014, Comput. Networks.

[35]  Peter I. Corke,et al.  ERTP: Energy-efficient and Reliable Transport Protocol for data streaming in Wireless Sensor Networks , 2009, Comput. Commun..

[36]  Mohammad S. Obaidat,et al.  Energy-efficient connectivity re-establishment in WSN in the presence of dumb nodes , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[37]  Soumya K. Ghosh,et al.  On Network Lifetime Expectancy With Realistic Sensing and Traffic Generation Model in Wireless Sensor Networks , 2013, IEEE Sensors Journal.

[38]  Lei Shi,et al.  A robust energy-efficient routing algorithm to cloud computing networks for learning , 2016, J. Intell. Fuzzy Syst..

[39]  Ian F. Akyildiz,et al.  Wireless sensor and actor networks: research challenges , 2004, Ad Hoc Networks.

[40]  P. S. Sastry,et al.  Varieties of learning automata: an overview , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[41]  Mohammad S. Obaidat,et al.  Markov decision process-based analysis of rechargeable nodes in wireless sensor networks , 2010, SpringSim.

[42]  A. Sprintson,et al.  Network Coding Decisions for Wireless Transmissions With Delay Consideration , 2014, IEEE Transactions on Communications.

[43]  Dingde Jiang,et al.  An energy-efficient cooperative multicast routing in multi-hop wireless networks for smart medical applications , 2017, Neurocomputing.