Predicting the Price of Bitcoin Using Sentiment-Enriched Time Series Forecasting

Recently, various methods to predict the future price of financial assets have emerged. One promising approach is to combine the historic price with sentiment scores derived via sentiment analysis techniques. In this article, we focus on predicting the future price of Bitcoin, which is currently the most popular cryptocurrency. More precisely, we propose a hybrid approach, combining time series forecasting and sentiment prediction from microblogs, to predict the intraday price of Bitcoin. Moreover, in addition to standard sentiment analysis methods, we are the first to employ a fine-tuned BERT model for this task. We also introduce a novel weighting scheme in which the weight of the sentiment of each tweet depends on the number of its creator’s followers. For evaluation, we consider periods with strongly varying ranges of Bitcoin prices. This enables us to assess the models w.r.t. robustness and generalization to varied market conditions. Our experiments demonstrate that BERT-based sentiment analysis and the proposed weighting scheme improve upon previous methods. Specifically, our hybrid models that use linear regression as the underlying forecasting algorithm perform best in terms of the mean absolute error (MAE of 2.67) and root mean squared error (RMSE of 3.28). However, more complicated models, particularly long short-term memory networks and temporal convolutional networks, tend to have generalization and overfitting issues, resulting in considerably higher MAE and RMSE scores.

[1]  Sören Karau Monetary Policy and Bitcoin , 2023, SSRN Electronic Journal.

[2]  A. Gregoriou,et al.  Predicting Bitcoin Prices Using Machine Learning , 2023, Entropy.

[3]  P. Vyas,et al.  RUemo - The Classification Framework for Russia-Ukraine War-Related Societal Emotions on Twitter through Machine Learning , 2023, Algorithms.

[4]  Christof Weinhardt,et al.  Machine Learning for Cryptocurrency Market Prediction and Trading , 2022, The Journal of Finance and Data Science.

[5]  Ke-wen Xia,et al.  Using Aspect-Level Sentiments for Calling App Recommendation with Hybrid Deep-Learning Models , 2022, Applied Sciences.

[6]  Mohamed Wiem Mkaouer,et al.  Sentiment analysis on Twitter data integrating TextBlob and deep learning models: The case of US airline industry , 2022, Knowl. Based Syst..

[7]  Bikash Sadhukhan,et al.  Effect of public sentiment on stock market movement prediction during the COVID-19 outbreak , 2022, Social Network Analysis and Mining.

[8]  L. Zou,et al.  VictimFinder: Harvesting rescue requests in disaster response from social media with BERT , 2022, Comput. Environ. Urban Syst..

[9]  Martin Reisslein,et al.  Automated Classification of Societal Sentiments on Twitter With Machine Learning , 2022, IEEE Transactions on Technology and Society.

[10]  J. Ellul,et al.  Bitcoin price change and trend prediction through twitter sentiment and data volume , 2022, Financial Innovation.

[11]  Zi Ye,et al.  A Stacking Ensemble Deep Learning Model for Bitcoin Price Prediction Using Twitter Comments on Bitcoin , 2022, Mathematics.

[12]  T. Swathi,et al.  An optimal deep learning-based LSTM for stock price prediction using twitter sentiment analysis , 2022, Applied Intelligence.

[13]  Mohammad J. Hamayel,et al.  A Novel Cryptocurrency Price Prediction Model Using GRU, LSTM and bi-LSTM Machine Learning Algorithms , 2021, AI.

[14]  Tomas Van Pottelbergh,et al.  Darts: User-Friendly Modern Machine Learning for Time Series , 2021, J. Mach. Learn. Res..

[15]  A. Aysan,et al.  Do Investor Sentiments Drive Cryptocurrency Prices , 2021 .

[16]  Rupali Verma,et al.  A review on sentiment analysis and emotion detection from text , 2021, Social Network Analysis and Mining.

[17]  Dian Zhang,et al.  Bitcoin price forecasting: A perspective of underlying blockchain transactions , 2021, Decis. Support Syst..

[18]  Neeraj Kumar,et al.  A Deep Learning-based Cryptocurrency Price Prediction Scheme for Financial Institutions , 2020, J. Inf. Secur. Appl..

[19]  D. Han,et al.  Comparison of Psychological Status and Investment Style Between Bitcoin Investors and Share Investors , 2020, Frontiers in Psychology.

[20]  Rasha Kashef,et al.  A Complete VADER-Based Sentiment Analysis of Bitcoin (BTC) Tweets during the Era of COVID-19 , 2020, Big Data Cogn. Comput..

[21]  Mohammad Hammoudeh,et al.  Time-series forecasting of Bitcoin prices using high-dimensional features: a machine learning approach , 2020, Neural Computing and Applications.

[22]  Timothy Peterson To the Moon: A History of Bitcoin Price Manipulation , 2020 .

[23]  Dat Quoc Nguyen,et al.  BERTweet: A pre-trained language model for English Tweets , 2020, EMNLP.

[24]  Krzysztof Wołk,et al.  Advanced social media sentiment analysis for short‐term cryptocurrency price prediction , 2020, Expert Syst. J. Knowl. Eng..

[25]  Michele Marchesi,et al.  Forecasting Bitcoin closing price series using linear regression and neural networks models , 2020, PeerJ Comput. Sci..

[26]  Constantin Gurdgiev,et al.  Herding and Anchoring in Cryptocurrency Markets: Investor Reaction to Fear and Uncertainty , 2020, Journal of Behavioral and Experimental Finance.

[27]  Jaydip Sen,et al.  A Robust Predictive Model for Stock Price Prediction Using Deep Learning and Natural Language Processing , 2019, SSRN Electronic Journal.

[28]  Everette S. Gardner,et al.  Fitting the damped trend method of exponential smoothing , 2018, J. Oper. Res. Soc..

[29]  Harald Uhlig,et al.  Some Simple Bitcoin Economics , 2018, Journal of Monetary Economics.

[30]  Yhlas Sovbetov Factors Influencing Cryptocurrency Prices: Evidence from Bitcoin, Ethereum, Dash, Litcoin, and Monero , 2018 .

[31]  Shuai Wang,et al.  Deep learning for sentiment analysis: A survey , 2018, WIREs Data Mining Knowl. Discov..

[32]  P. Ciaian,et al.  The economics of BitCoin price formation , 2014, 1405.4498.

[33]  Eric Gilbert,et al.  VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text , 2014, ICWSM.

[34]  G. Hommel,et al.  Linear regression analysis: part 14 of a series on evaluation of scientific publications. , 2010, Deutsches Arzteblatt international.

[35]  Hugo Zaragoza,et al.  The Probabilistic Relevance Framework: BM25 and Beyond , 2009, Found. Trends Inf. Retr..

[36]  Jürgen Schmidhuber,et al.  Applying LSTM to Time Series Predictable through Time-Window Approaches , 2000, ICANN.

[37]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[38]  N. Barberis,et al.  A Model of Investor Sentiment , 1997 .

[39]  Chris Chatfield,et al.  The Holt-Winters Forecasting Procedure , 1978 .

[40]  E. O. Brigham,et al.  The Fast Fourier Transform , 1967, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  Ernesto Lee,et al.  Sentiment Analysis and Emotion Detection on Cryptocurrency Related Tweets using Ensemble LSTM-GRU Model , 2022, IEEE Access.

[42]  Misbah Ul Hoque,et al.  Analyzing Tweeting Patterns and Public Engagement on Twitter During the Recognition Period of the COVID-19 Pandemic: A Study of Two U.S. States , 2022, IEEE Access.

[43]  Mazhar Javed Awan,et al.  Social Media and Stock Market Prediction: A Big Data Approach , 2021 .

[44]  S. Sarp,et al.  Sentiment Analysis Using State of the Art Machine Learning Techniques , 2021, Multimedia, Interaction, Design and Innovation.

[45]  Marouane Birjali,et al.  A comprehensive survey on sentiment analysis: Approaches, challenges and trends , 2021, Knowl. Based Syst..

[46]  Cheng Xu,et al.  Forecast Methods for Time Series Data: A Survey , 2021, IEEE Access.

[47]  Benjamin Lindemann,et al.  A survey on long short-term memory networks for time series prediction , 2021, Procedia CIRP.

[48]  M. Al-Shabi,et al.  Evaluating the performance of the most important Lexicons used to Sentiment analysis and opinions Mining , 2020 .

[49]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[50]  John Nelson,et al.  Cryptocurrency Price Prediction Using Tweet Volumes and Sentiment Analysis , 2018 .

[51]  Hazem M. Hajj,et al.  Comparative Evaluation of Sentiment Analysis Methods Across Arabic Dialects , 2017, ACLING.