Topic Detection and Tracking Techniques on Twitter: A Systematic Review

Social networks are real-time platforms formed by users involving conversations and interactions. ,is phenomenon of the new information era results in a very huge amount of data in different forms andmodalities such as text, images, videos, and voice.,e data with such characteristics are also known as big data with 5-V properties and in some cases are also referred to as social big data. To find useful information from such valuable data, many researchers tried to address different aspects of it for different modalities. In the case of text, NLP researchers conducted many research studies and scientific works to extract valuable information such as topics. Many enlightening works on different platforms of social media, like Twitter, tried to address the problem of finding important topics from different aspects and utilized it to propose solutions for diverse use cases. ,e importance of Twitter in this scope lies in its content and the behavior of its users. For example, it is also known as first-hand news reporting social media which has been a news reporting and informing platform even for political influencers or catastrophic news reporting. In this review article, we cover more than 50 research articles in the scope of topic detection from Twitter. We also address deep learning-based methods.

[1]  Bu-Sung Lee,et al.  Event Detection in Twitter , 2011, ICWSM.

[2]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[3]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[4]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[5]  Klaifer Garcia,et al.  Topic detection and sentiment analysis in Twitter content related to COVID-19 from Brazil and the USA , 2020, Applied Soft Computing.

[6]  Liang Zhao,et al.  Automatic targeted-domain spatiotemporal event detection in twitter , 2016, GeoInformatica.

[7]  James Allan,et al.  Introduction to topic detection and tracking , 2002 .

[8]  Yiannis Kompatsiaris,et al.  A soft frequent pattern mining approach for textual topic detection , 2014, WIMS '14.

[9]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[10]  Ugo Erra,et al.  Frequent Items Mining Acceleration Exploiting Fast Parallel Sorting on the GPU , 2012, ICCS.

[11]  James Allan,et al.  Topic Detection and Tracking , 2002, The Information Retrieval Series.

[12]  Cina Motamed,et al.  CWI: A multimodal deep learning approach for named entity recognition from social media using character, word and image features , 2020, Neural Computing and Applications.

[13]  Guandong Xu,et al.  Enhanced Heartbeat Graph for emerging event detection on Twitter using time series networks , 2019, Expert Syst. Appl..

[14]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[15]  Hikmat Ullah Khan,et al.  Twitter trends: A ranking algorithm analysis on real time data , 2021, Expert Syst. Appl..

[16]  James Allan,et al.  Text classification and named entities for new event detection , 2004, SIGIR '04.

[17]  Hendri Murfi,et al.  Deep Autoencoder-based Fuzzy C-Means for Topic Detection , 2021, Array.

[18]  Cícero Nogueira dos Santos,et al.  Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts , 2014, COLING.

[19]  Yiming Yang,et al.  Topic Detection and Tracking Pilot Study Final Report , 1998 .

[20]  Marco Morana,et al.  Real-time detection of twitter social events from the user's perspective , 2015, 2015 IEEE International Conference on Communications (ICC).

[21]  Nello Cristianini,et al.  Finding surprising patterns in textual data streams , 2010, 2010 2nd International Workshop on Cognitive Information Processing.

[22]  Michael Gertz,et al.  EvenTweet: Online Localized Event Detection from Twitter , 2013, Proc. VLDB Endow..

[23]  Ugo Erra,et al.  Approximate TF-IDF based on topic extraction from massive message stream using the GPU , 2015, Inf. Sci..

[24]  Ana-Maria Popescu,et al.  Extracting events and event descriptions from Twitter , 2011, WWW.

[25]  Mohamed Medhat Gaber,et al.  A rule dynamics approach to event detection in Twitter with its application to sports and politics , 2016, Expert Syst. Appl..

[26]  Nick Koudas,et al.  TwitterMonitor: trend detection over the twitter stream , 2010, SIGMOD Conference.

[27]  Din J. Wasem,et al.  Mining of Massive Datasets , 2014 .

[28]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[29]  Rui Li,et al.  TEDAS: A Twitter-based Event Detection and Analysis System , 2012, 2012 IEEE 28th International Conference on Data Engineering.

[30]  Miles Osborne,et al.  Streaming First Story Detection with application to Twitter , 2010, NAACL.

[31]  Shervin Minaee,et al.  COVID - TRANSFORMER : DETECTING TRENDING TOPICS ON TWITTER USING UNIVERSAL SENTENCE ENCODER , 2020 .

[32]  M. Osborne,et al.  Bieber no more : First Story Detection using Twitter and Wikipedia , 2012 .

[33]  Robert Muir,et al.  Apache Lucene 4 , 2012, OSIR@SIGIR.

[34]  Mohammad-Reza Feizi-Derakhshi,et al.  TopicBERT: A Transformer transfer learning based memory-graph approach for multimodal streaming social media topic detection , 2020, ArXiv.

[35]  Julio Gonzalo,et al.  Overview of RepLab 2013: Evaluating Online Reputation Monitoring Systems , 2013, CLEF.

[36]  Guandong Xu,et al.  Text Stream to Temporal Network - A Dynamic Heartbeat Graph to Detect Emerging Events on Twitter , 2018, PAKDD.

[37]  James Allan,et al.  Topic detection and tracking: event-based information organization , 2002 .

[38]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[39]  Nitin N. Patil,et al.  Topic detection using BNgram method and sentiment analysis on twitter dataset , 2015, 2015 4th International Conference on Reliability, Infocom Technologies and Optimization (ICRITO) (Trends and Future Directions).

[40]  Duen-Ren Liu,et al.  Mining the change of event trends for decision support in environmental scanning , 2009, Expert Syst. Appl..

[41]  Kazutoshi Sumiya,et al.  Measuring geographical regularities of crowd behaviors for Twitter-based geo-social event detection , 2010, LBSN '10.

[42]  Wu Yang,et al.  Discovering burst patterns of burst topic in twitter , 2017, Comput. Electr. Eng..

[43]  Roberto Frias,et al.  Twitter event detection: combining wavelet analysis and topic inference summarization , 2011 .

[44]  Ulrich Güntzer,et al.  Algorithms for association rule mining — a general survey and comparison , 2000, SKDD.

[45]  Ana M. García-Serrano,et al.  A step forward for Topic Detection in Twitter: An FCA-based approach , 2016, Expert Syst. Appl..

[46]  T. Murata,et al.  Breaking News Detection and Tracking in Twitter , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[47]  Sergei O. Kuznetsov,et al.  On stability of a formal concept , 2007, Annals of Mathematics and Artificial Intelligence.

[48]  Hila Becker,et al.  Beyond Trending Topics: Real-World Event Identification on Twitter , 2011, ICWSM.

[49]  Hanan Samet,et al.  TwitterStand: news in tweets , 2009, GIS.

[50]  Ee-Peng Lim,et al.  Analyzing feature trajectories for event detection , 2007, SIGIR.

[51]  Ming Zhou,et al.  Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification , 2014, ACL.

[52]  Charu C. Aggarwal,et al.  Frequent Pattern Mining , 2014, Springer International Publishing.

[53]  Ana-Maria Popescu,et al.  Detecting controversial events from twitter , 2010, CIKM.

[54]  Michael Grossniklaus,et al.  Editorial: Survey and Experimental Analysis of Event Detection Techniques for Twitter , 2016, Comput. J..

[55]  Jason J. Jung,et al.  Social big data: Recent achievements and new challenges , 2015, Information Fusion.