Predictability of User Behavior in Social Media: Bottom-Up v. Top-Down Modeling

Recent work has attempted to capture the behavior of users on social media by modeling them as computational units processing information. We propose to extend this perspective by explicitly examining the predictive power of such a view. We consider a network of fifteen thousand users on Twitter over a seven week period. To evaluate the predictability of the users, we apply two contrasting modeling paradigms: computational mechanics and echo state networks. Computational mechanics seeks to construct the simplest model with the maximal predictive capability, while echo state networks relax from very complicated dynamics until predictive capability is reached. We demonstrate that the behavior of users on Twitter can be well-modeled as processes with self-feedback and compare the performance of models built with both the statistical and neural paradigms.

[1]  Colin Campbell,et al.  Kernel methods: a survey of current techniques , 2002, Neurocomputing.

[2]  Aram Galstyan,et al.  Latent Point Process Models for Spatial-Temporal Networks , 2013, ArXiv.

[3]  Muntsa Pradó,et al.  A named entity recognition system based on a finite automata , 2005 .

[4]  David Darmon,et al.  Understanding the Predictive Power of Computational Mechanics and Echo State Networks in Social Media , 2013, 1306.6111.

[5]  Cosma Rohilla Shalizi Optimal Nonlinear Prediction of Random Fields on Networks , 2003, DMCS.

[6]  Aram Galstyan,et al.  Information transfer in social media , 2011, WWW.

[7]  Patrick J. Wolfe,et al.  Point process modelling for directed interaction networks , 2010, ArXiv.

[8]  James P. Crutchfield,et al.  Computational Mechanics: Pattern and Prediction, Structure and Simplicity , 1999, ArXiv.

[9]  K. Marton,et al.  Entropy and the Consistent Estimation of Joint Distributions , 1993, Proceedings. IEEE International Symposium on Information Theory.

[10]  Peter Michael Young,et al.  A tighter bound for the echo state property , 2006, IEEE Transactions on Neural Networks.

[11]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[12]  Paul-Gerhard Plöger,et al.  Echo State Networks used for Motor Control , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[13]  S. Caires,et al.  On the Non-parametric Prediction of Conditionally Stationary Sequences , 2005 .

[14]  José Carlos Príncipe,et al.  Analysis and Design of Echo State Networks , 2007, Neural Computation.

[15]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[16]  Robert Haslinger,et al.  The Computational Structure of Spike Trains , 2009, Neural Computation.

[17]  Benjamin Schrauwen,et al.  An overview of reservoir computing: theory, applications and implementations , 2007, ESANN.

[18]  Camille Roth,et al.  Intertemporal topic correlations in online media , 2007 .

[19]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[20]  Garrison W. Cottrell,et al.  2007 Special Issue: Learning grammatical structure with Echo State Networks , 2007 .

[21]  Simon Dedeo,et al.  Evidence for Non-Finite-State Computation in a Human Social System , 2012, ArXiv.

[22]  Peter Tiño,et al.  Minimum Complexity Echo State Network , 2011, IEEE Transactions on Neural Networks.

[23]  Lluís Padró Cirera,et al.  A named entity recognition system based on a finite automata acquisition algorithm , 2005 .

[24]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[25]  C. Shalizi,et al.  Causal architecture, complexity and self-organization in time series and cellular automata , 2001 .

[26]  Cosma Rohilla Shalizi,et al.  Blind Construction of Optimal Nonlinear Recursive Predictors for Discrete Sequences , 2004, UAI.

[27]  H. Jaeger,et al.  Overview of Reservoir Recipes A survey of new RNN training methods that follow the Reservoir paradigm , 2007 .

[28]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[29]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.