Artificial agent: The fusion of artificial intelligence and a mobile agent for energy-efficient traffic control in wireless sensor networks

Abstract Applications of wireless sensor networks are blooming for attacking some limits of social development, among which energy consumption and communication latency are fatal. Effective communication traffic control and management is a potential solution, so we propose a novel traffic-control system based on deep reinforcement learning, which regards traffic control as a strategy-learning process, to minimize energy consumption. Our algorithm utilizes deep neural network for learning, inputs the state of wireless sensor network as well as outputs the optimal route path. The simulation experiments demonstrate that our algorithm is feasible to control traffic in wireless sensor network and can reduce the energy consumption.

[1]  Min Chen,et al.  Wearable Affective Robot , 2018, IEEE Access.

[2]  Victor C. M. Leung,et al.  Software Agent-based Intelligence for Code-centric RFID Systems , 2010 .

[3]  Francisco Herrera,et al.  Cognitive Computing: Architecture, Technologies and Intelligent Applications , 2018, IEEE Access.

[4]  Min Chen,et al.  Cognitive Internet of Vehicles , 2018, Comput. Commun..

[5]  Lina Ni,et al.  CRPD: a novel clustering routing protocol for dynamic wireless sensor networks , 2018, Personal and Ubiquitous Computing.

[6]  Muhammad Faheem,et al.  Energy efficient and QoS-aware routing protocol for wireless sensor network-based smart grid applications in the context of industry 4.0 , 2017, Appl. Soft Comput..

[7]  Wei Li,et al.  Edge cognitive computing based smart healthcare system , 2018, Future Gener. Comput. Syst..

[8]  Victor C. M. Leung,et al.  From cloud-based communications to cognition-based communications: A computing perspective , 2018, Comput. Commun..

[9]  Ziming Zhao,et al.  Uncovering the Face of Android Ransomware: Characterization and Real-Time Detection , 2018, IEEE Transactions on Information Forensics and Security.

[10]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[11]  Jianxin Chen,et al.  When Computation Hugs Intelligence: Content-Aware Data Processing for Industrial IoT , 2018, IEEE Internet of Things Journal.

[12]  Guoliang Xue,et al.  DeyPoS: Deduplicatable Dynamic Proof of Storage for Multi-User Environments , 2016, IEEE Transactions on Computers.

[13]  Jing Chen,et al.  Dominating Set and Network Coding-Based Routing in Wireless Mesh Networks , 2015, IEEE Transactions on Parallel and Distributed Systems.

[14]  Wei Li,et al.  A Dynamic Service Migration Mechanism in Edge Cognitive Computing , 2018, ACM Trans. Internet Techn..

[15]  Min Chen,et al.  Label-less Learning for Traffic Control in an Edge Network , 2018, IEEE Network.

[16]  Victor C. M. Leung,et al.  Mobile Agent-Based Directed Diffusion in Wireless Sensor Networks , 2007, EURASIP J. Adv. Signal Process..

[17]  Zhengguo Sheng,et al.  An Adaptive Fusion Strategy for Distributed Information Estimation Over Cooperative Multi-Agent Networks , 2017, IEEE Transactions on Information Theory.

[18]  Xiaofei Wang,et al.  Hierarchical Edge Caching in Device-to-Device Aided Mobile Networks: Modeling, Optimization, and Design , 2018, IEEE Journal on Selected Areas in Communications.

[19]  Xiang Li,et al.  Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches , 2017, IEEE Communications Magazine.

[20]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[21]  Nei Kato,et al.  On Removing Routing Protocol from Future Wireless Networks: A Real-time Deep Learning Approach for Intelligent Traffic Control , 2018, IEEE Wireless Communications.

[22]  Xiaofei Wang,et al.  Cognitive-LPWAN: Towards Intelligent Wireless Services in Hybrid Low Power Wide Area Networks , 2018, IEEE Transactions on Green Communications and Networking.

[23]  Subramaniam Shamala,et al.  Multi-mobile agent itinerary planning algorithms for data gathering in wireless sensor networks: A review paper , 2017, Int. J. Distributed Sens. Networks.

[24]  Jianxin Chen,et al.  Greening the Smart Cities: Energy-Efficient Massive Content Delivery via D2D Communications , 2018, IEEE Transactions on Industrial Informatics.

[25]  Qian Zhang,et al.  Code-Centric RFID System Based on Software Agent Intelligence , 2010, IEEE Intelligent Systems.

[26]  Chao Cai,et al.  Smart Home Based on WiFi Sensing: A Survey , 2018, IEEE Access.

[27]  Tien Cao-hoang,et al.  Environment monitoring system for agricultural application based on wireless sensor network , 2017, 2017 Seventh International Conference on Information Science and Technology (ICIST).

[28]  Yangmin Lee,et al.  Classification of node degree based on deep learning and routing method applied for virtual route assignment , 2017, Ad Hoc Networks.

[29]  Jeng-Shyang Pan,et al.  An energy-aware routing protocol for wireless sensor network based on genetic algorithm , 2018, Telecommun. Syst..

[30]  Yang Xu,et al.  Application of Wireless Sensor Network in Water Quality Monitoring , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[31]  Xiaofei Wang,et al.  D2D Big Data: Content Deliveries over Wireless Device-to-Device Sharing in Large-Scale Mobile Networks , 2018, IEEE Wireless Communications.

[32]  Xu Chen,et al.  In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning , 2018, IEEE Network.

[33]  Nei Kato,et al.  Routing or Computing? The Paradigm Shift Towards Intelligent Computer Network Packet Transmission Based on Deep Learning , 2017, IEEE Transactions on Computers.

[34]  Victor C. M. Leung,et al.  Energy-Efficient Itinerary Planning for Mobile Agents in Wireless Sensor Networks , 2009, 2009 IEEE International Conference on Communications.

[35]  Samy Bengio,et al.  Neural Combinatorial Optimization with Reinforcement Learning , 2016, ICLR.

[36]  Xuelong Li,et al.  When Collaboration Hugs Intelligence: Content Delivery over Ultra-Dense Networks , 2017, IEEE Communications Magazine.

[37]  Victor C. M. Leung,et al.  Reliability-Oriented Optimization of Computation Offloading for Cooperative Vehicle-Infrastructure Systems , 2019, IEEE Signal Processing Letters.

[38]  Jaime Lloret,et al.  ELDC: An Artificial Neural Network Based Energy-Efficient and Robust Routing Scheme for Pollution Monitoring in WSNs , 2020, IEEE Transactions on Emerging Topics in Computing.