Newspaper article-based agent control in smart city simulations

The latest research on smart city technologies mainly focuses on utilizing cities’ resources to improve the quality of the lives of citizens. Diverse kinds of control signals from massive systems and devices such as adaptive traffic light systems in smart cities can be collected and utilized. Unfortunately, it is difficult to collect a massive dataset of control signals as doing so in the real-world requires significant effort and time. This paper proposes a deep generative model which integrates a long short-term memory model with generative adversarial network (LSTM-GAN) to generate agent control signals based on the words extracted from newspaper articles to solve the problem of collecting massive signals. The discriminatory network in the LSTM-GAN takes continuous word embedding vectors as inputs generated by a pre-trained Word2Vec model. The agent control signals of sequential actions are simultaneously predicted by the LSTM-GAN in real time. Specifically, to collect the training data of smart city simulations, the LSTM-GAN is trained based on the Corpus of Contemporary American English (COCA) newspaper dataset, which contains 5,317,731 sentences, for a total of 93,626,203 word tokens, from written texts. To verify the proposed method, agent control signals were generated and validated. In the training of the LSTM-GAN, the accuracy of the discriminator converged to 50%. In addition, the losses of the discriminator and the generator converged from 4527.04 and 4527.94 to 2.97 and 1.87, respectively.

[1]  Shailendra Rathore,et al.  CIoT-Net: a scalable cognitive IoT based smart city network architecture , 2019, Human-centric Computing and Information Sciences.

[2]  Jong Hyuk Park,et al.  A blockchain-based smart home gateway architecture for preventing data forgery , 2020, Human-centric Computing and Information Sciences.

[3]  Simon Elias Bibri,et al.  A foundational framework for smart sustainable city development: Theoretical, disciplinary, and discursive dimensions and their synergies , 2017 .

[4]  Arun Kumar Sangaiah,et al.  Energy Consumption in Point-Coverage Wireless Sensor Networks via Bat Algorithm , 2019, IEEE Access.

[5]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[6]  Youn-Hee Han,et al.  Time Series Classification of Cryptocurrency Price Trend Based on a Recurrent LSTM Neural Network , 2019, J. Inf. Process. Syst..

[7]  José Luis Galán García,et al.  An accelerated-time simulation for traffic flow in a smart city , 2014, J. Comput. Appl. Math..

[8]  Dipti Pawade,et al.  Story Scrambler - Automatic Text Generation Using Word Level RNN-LSTM , 2018, International Journal of Information Technology and Computer Science.

[9]  S. Vijayarani,et al.  Preprocessing Techniques for Text Mining-An Overview Dr , 2015 .

[10]  Sandeep Subramanian,et al.  Adversarial Generation of Natural Language , 2017, Rep4NLP@ACL.

[11]  Wei Yu,et al.  Smart city: The state of the art, datasets, and evaluation platforms , 2017, 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS).

[12]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[13]  Yunsick Sung,et al.  Automatic Melody Composition Using Enhanced GAN , 2019, Mathematics.

[14]  M. Shamim Hossain,et al.  Enforcing Position-Based Confidentiality With Machine Learning Paradigm Through Mobile Edge Computing in Real-Time Industrial Informatics , 2019, IEEE Transactions on Industrial Informatics.

[15]  Sergio Escalera,et al.  Beyond One-hot Encoding: lower dimensional target embedding , 2018, Image Vis. Comput..

[16]  Arun Kumar Sangaiah,et al.  Classification of ransomware families with machine learning based on N-gram of opcodes , 2019, Future Gener. Comput. Syst..

[17]  Rob Fergus,et al.  Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks , 2015, NIPS.

[18]  Yanqing Zhang,et al.  Using Word2Vec to process big text data , 2015, 2015 IEEE International Conference on Big Data (Big Data).

[19]  M. Shamim Hossain,et al.  Energy-Aware Green Adversary Model for Cyberphysical Security in Industrial System , 2020, IEEE Transactions on Industrial Informatics.

[20]  Gang Liu,et al.  Bidirectional LSTM with attention mechanism and convolutional layer for text classification , 2019, Neurocomputing.

[21]  Quan Pan,et al.  A Generative Model for category text generation , 2018, Inf. Sci..

[22]  Rui Mesquita,et al.  Model Based Simulation for a Smart City Project Based on LoRa , 2019, IECON 2019 - 45th Annual Conference of the IEEE Industrial Electronics Society.

[23]  Paulina Grnarova,et al.  Defending Against Adversarial Attacks by Leveraging an Entire GAN , 2018, ArXiv.

[24]  Olof Mogren,et al.  C-RNN-GAN: Continuous recurrent neural networks with adversarial training , 2016, ArXiv.

[25]  Matthew England,et al.  A Combined CNN and LSTM Model for Arabic Sentiment Analysis , 2018, CD-MAKE.

[26]  Sinan Toklu,et al.  A deep learning analysis on question classification task using Word2vec representations , 2020, Neural Computing and Applications.

[27]  Young-Sik Jeong,et al.  IoT and Smart City Technology: Challenges, Opportunities, and Solutions , 2019, J. Inf. Process. Syst..

[28]  Fabio Kon,et al.  Design and evaluation of a scalable smart city software platform with large-scale simulations , 2019, Future Gener. Comput. Syst..

[29]  Anil Pahwa,et al.  Modeling, Control, and Stability of Smart Loads Toward Grid of Nanogrids for Smart Cities , 2018, IECON 2018 - 44th Annual Conference of the IEEE Industrial Electronics Society.

[30]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[31]  Nina Narodytska,et al.  RelGAN: Relational Generative Adversarial Networks for Text Generation , 2019, ICLR.

[32]  Xinpan Yuan,et al.  SSF: Sentence Similar Function Based on word3vector Similar Elements , 2019, J. Inf. Process. Syst..

[33]  Phuong Minh Chu,et al.  Three-Dimensional Simulation for Training Autonomous Vehicles in Smart City Environments , 2019, 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[34]  Yunsick Sung,et al.  Long short-term memory-based Malware classification method for information security , 2019, Comput. Electr. Eng..