Social media sentiment analysis through parallel dilated convolutional neural network for smart city applications

Abstract Deep Learning is considered to leverage smart cities through social media sentiment analysis. The digital content in social media can be used for many smart city applications (SCAs) 1 . Classical convolutional neural networks (CNNs) are challenging to parallelize and insufficient to capture long term contextual semantic features for sentiment analysis. In this perspective, this paper initially proposes a domain-specific distributed word representation (DS-DWR) 2 with a considerably small corpus size induced from textual resources in social media. In DS-DWR, different Distributed Word Representations are concatenated to builds rich representations over the input sequence, which is worthwhile for infrequent and unseen terms. Second, a dilated convolutional neural network (D-CNN) 3 , which is composed of three parallel dilated convolutional neural network (PD-CNN) 4 layers and a global average pooling (GAP) 5 layer. Our considered parallel dilated convolution reduces dimension and incorporates an extension in the size of receptive fields without the loss of local information. Further, the long-term contextual semantic information is achieved by the use of different dilation rates. Experiments demonstrate that our architecture accomplishes comparable results with multiple hyperparameters tuning for better parallelism which leads to the minimized computational cost.

[1]  Wei-Yun Yau,et al.  Structured AutoEncoders for Subspace Clustering , 2018, IEEE Transactions on Image Processing.

[2]  Anthony Stefanidis,et al.  #Earthquake: Twitter as a Distributed Sensor System , 2013, Trans. GIS.

[3]  Ayoub Ait Lahcen,et al.  Towards a real-time processing framework based on improved distributed recurrent neural network variants with fastText for social big data analytics , 2020, Inf. Process. Manag..

[4]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[5]  Enrique Herrera-Viedma,et al.  Sentiment analysis: A review and comparative analysis of web services , 2015, Inf. Sci..

[6]  Higinio Mora,et al.  Analysis of Social Networking Service Data for Smart Urban Planning , 2018, Sustainability.

[7]  Wolfgang G. Stock,et al.  Looking for friends and followers: a global investigation of governmental social media use , 2015 .

[8]  Krys J. Kochut,et al.  A Brief Survey of Text Mining: Classification, Clustering and Extraction Techniques , 2017, ArXiv.

[9]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[10]  Alberto Maria Segre,et al.  The Use of Twitter to Track Levels of Disease Activity and Public Concern in the U.S. during the Influenza A H1N1 Pandemic , 2011, PloS one.

[11]  Wenpeng Yin,et al.  Multichannel Variable-Size Convolution for Sentence Classification , 2015, CoNLL.

[12]  Chenquan Gan,et al.  Sparse attention based separable dilated convolutional neural network for targeted sentiment analysis , 2020, Knowl. Based Syst..

[13]  Miltiadis D. Lytras,et al.  Enabling Technologies and Business Infrastructures for Next Generation Social Media: Big Data, Cloud Computing, Internet of Things and Virtual Reality , 2015, J. Univers. Comput. Sci..

[14]  Licia Capra,et al.  Urban Computing: Concepts, Methodologies, and Applications , 2014, TIST.

[15]  Li-Minn Ang,et al.  Big Sensor Data Systems for Smart Cities , 2017, IEEE Internet of Things Journal.

[16]  Zhang Yi,et al.  Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering , 2012, IEEE Transactions on Cybernetics.

[17]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[18]  Yonghui Wu,et al.  Exploring the Limits of Language Modeling , 2016, ArXiv.

[19]  Julio Navío-Marco,et al.  Governance and economics of smart cities: opportunities and challenges , 2018, Telecommunications Policy.

[20]  João Filipe Figueiredo Pereira,et al.  Social Media Text Processing and Semantic Analysis for Smart Cities , 2017, ArXiv.

[21]  Elise de Doncker,et al.  Twitter sentiment analysis with a deep neural network: An enhanced approach using user behavioral information , 2019, Cognitive Systems Research.

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  M. Lytras,et al.  Policy making for smart cities: innovation and social inclusive economic growth for sustainability , 2018, Journal of Science and Technology Policy Management.

[24]  Miltiadis D. Lytras,et al.  An emerging - Social and emerging computing enabled philosophical paradigm for collaborative learning systems: Toward high effective next generation learning systems for the knowledge society , 2015, Comput. Hum. Behav..

[25]  Luke S. Zettlemoyer,et al.  Deep Contextualized Word Representations , 2018, NAACL.

[26]  Tomas Mikolov,et al.  Enriching Word Vectors with Subword Information , 2016, TACL.

[27]  Ye Zhang,et al.  A Sensitivity Analysis of (and Practitioners’ Guide to) Convolutional Neural Networks for Sentence Classification , 2015, IJCNLP.

[28]  Alex Graves,et al.  Neural Machine Translation in Linear Time , 2016, ArXiv.

[29]  Miltiadis D. Lytras,et al.  Cognitive Computing Track Chairs' Welcome & Organization , 2018, WWW.

[30]  Kah Phooi Seng,et al.  Big Sensor Data Applications in Urban Environments , 2016, Big Data Res..

[31]  Gillian Rose,et al.  Seeing the smart city on Twitter: Colour and the affective territories of becoming smart: , 2019 .

[32]  Hui Chen,et al.  A literature survey on smart cities , 2015, Science China Information Sciences.

[33]  Bing Liu,et al.  Sentiment Analysis and Subjectivity , 2010, Handbook of Natural Language Processing.

[34]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[35]  Rogério Cid Bastos,et al.  Sustainable development of smart cities: a systematic review of the literature , 2017 .

[36]  Tong Zhang,et al.  Text Mining: Predictive Methods for Analyzing Unstructured Information , 2004 .

[37]  N. Komninos Intelligent cities: towards interactive and global innovation environments , 2009 .

[38]  Miltiadis D. Lytras,et al.  Annotation of Smart Cities Twitter Micro-Contents for Enhanced Citizen’s Engagement , 2019, IEEE Access.

[39]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[40]  Tianqi Chen,et al.  Empirical Evaluation of Rectified Activations in Convolutional Network , 2015, ArXiv.

[41]  Yutaka Matsuo,et al.  Tweet Analysis for Real-Time Event Detection and Earthquake Reporting System Development , 2013, IEEE Transactions on Knowledge and Data Engineering.

[42]  Amit P. Sheth,et al.  Citizen Sensing, Social Signals, and Enriching Human Experience , 2009, IEEE Internet Computing.

[43]  Arkaitz Zubiaga,et al.  A longitudinal assessment of the persistence of twitter datasets , 2017, J. Assoc. Inf. Sci. Technol..

[44]  Eleonora D'Andrea,et al.  Real-Time Detection of Traffic From Twitter Stream Analysis , 2015, IEEE Transactions on Intelligent Transportation Systems.

[45]  Chen Li,et al.  Sentiment analysis through recurrent variants latterly on convolutional neural network of Twitter , 2019, Future Gener. Comput. Syst..

[46]  Renata Vieira,et al.  Annotating Relations Between Named Entities with Crowdsourcing , 2018, NLDB.

[47]  Xiang Zhang,et al.  Character-level Convolutional Networks for Text Classification , 2015, NIPS.