Secure Data Transmission in Smart Meters Using Q-Learning in Fog Computing Environment

With the advancement in technology and connectivity, the concept of smart grids with smart meters has significantly increased the interest of both electric consumers and power suppliers. Nowadays the smart cities are using the technology of smart meters in their household. Which can transfer the electrical data in a bi-directional way to consumers and smart grids. It consists of various internet-connected sensors, software applications, to connect different devices. This makes the smart grid network more complex which is further vulnerable to the cyber-attack. Moreover, it gives rise to various malicious attack such as false data injection (FDI) in smart meters which leads to incorrect decisions due to a large number of open access points in a network which is accessible to outside intruders. In smart meters, Home Area Network (HAN) and smart meter collectors are more vulnerable for cyber-attacks as they are directly involved in bi-directional communication between the devices such as smart grid, data connectors and smart meters. Since smart meters work in a distributed environment where fog computing (FC) placed at the edge of the networks can play a major role by integrating with blockchain for secure electric data transmission and to avoid the FDI in smart meters. Here FC nodes will act as miners to makes the decisions on the data transmission while monitoring the states of the system. Hence, we propose a novel solution for the above mention issue which consists of 3-tier FC-based blockchain architecture and Smart Meter-based Q-Learning Encryption (SMQE) algorithm to verify the system in FC environment. The algorithm performs the identification of FDI, and malicious attacks conducted on smart meters during data transmission. It opens a blockchain-based channel for secure data transmission in smart meters. The simulations tools used for this purpose are iFogSim, SimBlock, Python (Anaconda) with Geth version 1.8.23.

[1]  Tirza Routtenberg,et al.  Detection of False Data Injection Attacks in Smart Grids Based on Graph Signal Processing , 2018, IEEE Systems Journal.

[2]  Simon Parkinson,et al.  Fog computing security: a review of current applications and security solutions , 2017, Journal of Cloud Computing.

[3]  Ying Chen,et al.  Evaluation of Reinforcement Learning-Based False Data Injection Attack to Automatic Voltage Control , 2019, IEEE Transactions on Smart Grid.

[4]  Wajahat Ali Khan,et al.  Smart Meter Security: Vulnerabilities, Threat Impacts, and Countermeasures , 2019, IMCOM.

[5]  Keli Zhang,et al.  Blockchain-based anomaly detection of electricity consumption in smart grids , 2020, Pattern Recognit. Lett..

[6]  Vladimiro Sassone,et al.  A Blockchain-based Infrastructure for Reliable and Cost-effective IoT-aided Smart Grids , 2018, IoT 2018.

[7]  Yasin Kabalci,et al.  A survey on smart metering and smart grid communication , 2016 .

[8]  Mohd Fadzil Hassan,et al.  An analytical model to minimize the latency in healthcare internet-of-things in fog computing environment , 2019, PloS one.

[9]  George Michailidis,et al.  Adaptive statistical detection of false data injection attacks in smart grids , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[10]  Xinping Guan,et al.  Distributed detection and isolation of false data injection attacks in smart grids via nonlinear unknown input observers , 2019, International Journal of Electrical Power & Energy Systems.

[11]  Rong Zheng,et al.  Detecting Stealthy False Data Injection Using Machine Learning in Smart Grid , 2017, IEEE Syst. J..

[12]  Honest Christopher Kimaro,et al.  A Critical Review of Edge and Fog Computing for Smart Grid Applications , 2019, ICT4D.

[13]  Miodrag Forcan,et al.  Cloud-Fog-based approach for Smart Grid monitoring , 2020, Simul. Model. Pract. Theory.

[14]  Qi Li,et al.  False data injection attacks against smart gird state estimation: Construction, detection and defense , 2019, Science China Technological Sciences.

[15]  Ozgur Koray Sahingoz,et al.  Blockchain Based Secure Communication for IoT Devices in Smart Cities , 2019, 2019 7th International Istanbul Smart Grids and Cities Congress and Fair (ICSG).

[16]  Rong Zheng,et al.  Detecting Stealthy False Data Injection Using Machine Learning in Smart Grid , 2017, IEEE Systems Journal.

[17]  Madhusanka Liyanage,et al.  Performance Analysis of Blockchain based Smart Grids with Ethereum and Hyperledger Implementations , 2019, 2019 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS).

[18]  M. M. Sufyan Beg,et al.  Fog Computing for Internet of Things (IoT)-Aided Smart Grid Architectures , 2019, Big Data Cogn. Comput..

[19]  Rini Handayani,et al.  Blockchain for smart grid , 2020, J. King Saud Univ. Comput. Inf. Sci..

[20]  Resul Das,et al.  Cyber-security on smart grid: Threats and potential solutions , 2020, Comput. Networks.

[21]  Göran N Ericsson,et al.  Cyber Security and Power System Communication—Essential Parts of a Smart Grid Infrastructure , 2010, IEEE Transactions on Power Delivery.

[22]  S. M. Muyeen,et al.  Blockchain Applications in Smart Grid–Review and Frameworks , 2019, IEEE Access.

[23]  Vinay Chamola,et al.  Blockchain in Smart Grids: A Review on Different Use Cases , 2019, Sensors.

[24]  Marcel Antal,et al.  Blockchain Based Decentralized Management of Demand Response Programs in Smart Energy Grids , 2018, Sensors.

[25]  Jun Zhao,et al.  Blockchain for Future Smart Grid: A Comprehensive Survey , 2021, IEEE Internet of Things Journal.

[26]  Mingzhe Liu,et al.  A Blockchain Based Data Monitoring and Sharing Approach for Smart Grids , 2020 .