Characterizing and Forecasting User Engagement with In-App Action Graph: A Case Study of Snapchat

While mobile social apps have become increasingly important in people's daily life, we have limited understanding on what motivates users to engage with these apps. In this paper, we answer the question whether users' in-app activity patterns help inform their future app engagement (e.g., active days in a future time window)? Previous studies on predicting user app engagement mainly focus on various macroscopic features (e.g., time-series of activity frequency), while ignoring fine-grained inter-dependencies between different in-app actions at the microscopic level. Here we propose to formalize individual user's in-app action transition patterns as a temporally evolving action graph, and analyze its characteristics in terms of informing future user engagement. Our analysis suggested that action graphs are able to characterize user behavior patterns and inform future engagement. We derive a number of high-order graph features to capture in-app usage patterns and construct interpretable models for predicting trends of engagement changes and active rates. To further enhance predictive power, we design an end-to-end, multi-channel neural model to encode both temporal action graphs, activity sequences, and other macroscopic features. Experiments on predicting user engagement for 150k Snapchat new users over a 28-day period demonstrate the effectiveness of the proposed prediction models. The analysis and prediction framework is also deployed at Snapchat to deliver real world business insights. Our proposed framework is also general and can be applied to any online platform.

[1]  Mingxuan Sun,et al.  A hazard based approach to user return time prediction , 2014, KDD.

[2]  Jaideep Srivastava,et al.  Churn Prediction in MMORPGs: A Social Influence Based Approach , 2009, 2009 International Conference on Computational Science and Engineering.

[3]  Aaron Halfaker,et al.  User Session Identification Based on Strong Regularities in Inter-activity Time , 2014, WWW.

[4]  Jie Li,et al.  Characterizing typical and atypical user sessions in clickstreams , 2008, WWW.

[5]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[6]  Ahmed Hassan Awadallah,et al.  Beyond DCG: user behavior as a predictor of a successful search , 2010, WSDM '10.

[7]  Jure Leskovec,et al.  Predicting Intent Using Activity Logs: How Goal Specificity and Temporal Range Affect User Behavior , 2017, WWW.

[8]  Mark S. Ackerman,et al.  Activity Lifespan: An Analysis of User Survival Patterns in Online Knowledge Sharing Communities , 2010, ICWSM.

[9]  Jure Leskovec,et al.  Understanding Behaviors that Lead to Purchasing: A Case Study of Pinterest , 2016, KDD.

[10]  Gang Wang,et al.  Clickstream User Behavior Models , 2017, ACM Trans. Web.

[11]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[12]  Ricardo A. Baeza-Yates,et al.  Modeling user search behavior , 2005, Third Latin American Web Congress (LA-WEB'2005).

[13]  Weicong Ding,et al.  Just One More: Modeling Binge Watching Behavior , 2016, KDD.

[14]  Xin Yao,et al.  A novel evolutionary data mining algorithm with applications to churn prediction , 2003, IEEE Trans. Evol. Comput..

[15]  Aristides Gionis,et al.  The query-flow graph: model and applications , 2008, CIKM '08.

[16]  Jiawei Han,et al.  I Know You'll Be Back: Interpretable New User Clustering and Churn Prediction on a Mobile Social Application , 2018, KDD.

[17]  Virgílio A. F. Almeida,et al.  Characterizing user behavior in online social networks , 2009, IMC '09.

[18]  Jure Leskovec,et al.  Donor Retention in Online Crowdfunding Communities: A Case Study of DonorsChoose.org , 2015, WWW.

[19]  Ravi Kumar,et al.  Modeling User Consumption Sequences , 2016, WWW.

[20]  Dario Taraborelli,et al.  MoodBar: Increasing New User Retention in Wikipedia through Lightweight Socialization , 2014, CSCW.

[21]  Jure Leskovec,et al.  I'll Be Back: On the Multiple Lives of Users of a Mobile Activity Tracking Application , 2018, WWW.

[22]  M. Tamer Özsu,et al.  A Web page prediction model based on click-stream tree representation of user behavior , 2003, KDD '03.