Exploiting Usage to Predict Instantaneous App Popularity

Popularity of mobile apps is traditionally measured by metrics such as the number of downloads, installations, or user ratings. A problem with these measures is that they reflect usage only indirectly. Indeed, retention rates, i.e., the number of days users continue to interact with an installed app, have been suggested to predict successful app lifecycles. We conduct the first independent and large-scale study of retention rates and usage trends on a dataset of app-usage data from a community of 339,842 users and more than 213,667 apps. Our analysis shows that, on average, applications lose 65% of their users in the first week, while very popular applications (top 100) lose only 35%. It also reveals, however, that many applications have more complex usage behaviour patterns due to seasonality, marketing, or other factors. To capture such effects, we develop a novel app-usage trend measure which provides instantaneous information about the popularity of an application. Analysis of our data using this trend filter shows that roughly 40% of all apps never gain more than a handful of users (Marginal apps). Less than 0.1% of the remaining 60% are constantly popular (Dominant apps), 1% have a quick drain of usage after an initial steep rise (Expired apps), and 6% continuously rise in popularity (Hot apps). From these, we can distinguish, for instance, trendsetters from copycat apps. We conclude by demonstrating that usage behaviour trend information can be used to develop better mobile app recommendations.

[1]  Andrew P. Bradley,et al.  The use of the area under the ROC curve in the evaluation of machine learning algorithms , 1997, Pattern Recognit..

[2]  Jiannong Cao,et al.  Understanding Mobile Users’ Privacy Expectations: A Recommendation-Based Method Through Crowdsourcing , 2019, IEEE Transactions on Services Computing.

[3]  James D. Hamilton Time Series Analysis , 1994 .

[4]  Evangelos P. Markatos,et al.  Rise of the planet of the apps: a systematic study of the mobile app ecosystem , 2013, Internet Measurement Conference.

[5]  Walid Maalej,et al.  User feedback in the appstore: An empirical study , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[6]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[7]  Alessandra Gorla,et al.  Checking app behavior against app descriptions , 2014, ICSE.

[8]  Xin Jin,et al.  K-Means Clustering , 2010, Encyclopedia of Machine Learning.

[9]  H. Akaike A new look at the statistical model identification , 1974 .

[10]  Min Chen,et al.  Measuring and Analyzing Third-Party Mobile Game App Stores in China , 2016, IEEE Transactions on Network and Service Management.

[11]  Eemil Lagerspetz,et al.  The company you keep: mobile malware infection rates and inexpensive risk indicators , 2013, WWW.

[12]  Sasu Tarkoma,et al.  Carat: collaborative energy diagnosis for mobile devices , 2013, SenSys '13.

[13]  Philip S. Yu,et al.  Mining Usage Traces of Mobile Apps for Dynamic Preference Prediction , 2013, PAKDD.

[14]  Antonio Krüger,et al.  A study on icon arrangement by smartphone users , 2013, CHI.

[15]  Kamal Ali,et al.  GetJar mobile application recommendations with very sparse datasets , 2012, KDD.

[16]  Florian Michahelles,et al.  AppAware: which mobile applications are hot? , 2010, Mobile HCI.

[17]  Wang-Chien Lee,et al.  App recommendation: a contest between satisfaction and temptation , 2013, WSDM.

[18]  Mark de Reuver,et al.  Smartphone Measurement: do People Use Mobile Applications as they Say they do? , 2012, ICMB.

[19]  Johannes Schöning,et al.  Falling asleep with Angry Birds, Facebook and Kindle: a large scale study on mobile application usage , 2011, Mobile HCI.

[20]  Fei Wang,et al.  A Cooperation Based Metric for Mobile Applications Recommendation , 2013, 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[21]  Florian Michahelles,et al.  Google play is not a long tail market: an empirical analysis of app adoption on the Google play app market , 2013, SAC '13.

[22]  Hui Xiong,et al.  Popularity Modeling for Mobile Apps: A Sequential Approach , 2015, IEEE Transactions on Cybernetics.

[23]  Roberto Turrin,et al.  Performance of recommender algorithms on top-n recommendation tasks , 2010, RecSys '10.

[24]  Yuanyuan Zhang,et al.  App store mining and analysis: MSR for app stores , 2012, 2012 9th IEEE Working Conference on Mining Software Repositories (MSR).

[25]  Christos Faloutsos,et al.  Why people hate your app: making sense of user feedback in a mobile app store , 2013, KDD.

[26]  Alexandros Karatzoglou,et al.  Climbing the app wall: enabling mobile app discovery through context-aware recommendations , 2012, CIKM '12.

[27]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[28]  Hee-Woong Kim,et al.  An Exploratory Study on the Determinants of Mobile Application Purchase , 2011 .

[29]  C. Nelson,et al.  Trends and random walks in macroeconmic time series: Some evidence and implications , 1982 .

[30]  David Martin,et al.  Computational Molecular Biology: An Algorithmic Approach , 2001 .

[31]  Jiannong Cao,et al.  When Privacy Meets Usability: Unobtrusive Privacy Permission Recommendation System for Mobile Apps Based on Crowdsourcing , 2018, IEEE Transactions on Services Computing.

[32]  Guanling Chen,et al.  AppJoy: personalized mobile application discovery , 2011, MobiSys '11.

[33]  Bing Liu,et al.  Opinion spam and analysis , 2008, WSDM '08.

[34]  Susan T. Dumais,et al.  Modeling and predicting behavioral dynamics on the web , 2012, WWW.

[35]  Juneyoung Park,et al.  AppTrends: A graph-based mobile app recommendation system using usage history , 2015, 2015 International Conference on Big Data and Smart Computing (BIGCOMP).

[36]  Nick Koudas,et al.  TwitterMonitor: trend detection over the twitter stream , 2010, SIGMOD Conference.

[37]  C. Lee Giles,et al.  Clustering and identifying temporal trends in document databases , 2000, Proceedings IEEE Advances in Digital Libraries 2000.

[38]  Jugal K. Kalita,et al.  Streaming trend detection in Twitter , 2013, Int. J. Web Based Communities.

[39]  Ye Xu,et al.  Preference, context and communities: a multi-faceted approach to predicting smartphone app usage patterns , 2013, ISWC '13.

[40]  Walid Maalej,et al.  How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[41]  Ratul Mahajan,et al.  AppInsight: Mobile App Performance Monitoring in the Wild , 2022 .

[42]  Xiaodong Wang,et al.  Multi-objective mobile app recommendation: A system-level collaboration approach , 2014, Comput. Electr. Eng..

[43]  Peter J. Bentley,et al.  Investigating Country Differences in Mobile App User Behavior and Challenges for Software Engineering , 2015, IEEE Transactions on Software Engineering.

[44]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[45]  Tat-Seng Chua,et al.  New and improved: modeling versions to improve app recommendation , 2014, SIGIR.

[46]  Ricardo Baeza-Yates,et al.  Predicting The Next App That You Are Going To Use , 2015, WSDM.

[47]  Sergei Vassilvitskii,et al.  K-means: algorithms, analyses, experiments , 2007 .

[48]  Ning Chen,et al.  AR-miner: mining informative reviews for developers from mobile app marketplace , 2014, ICSE.

[49]  Ahmed E. Hassan,et al.  What Do Mobile App Users Complain About? , 2015, IEEE Software.

[50]  Rishi Chandy,et al.  Identifying spam in the iOS app store , 2012, WebQuality '12.

[51]  Licia Capra,et al.  Temporal diversity in recommender systems , 2010, SIGIR.

[52]  Anindya Datta,et al.  Serendipitous Recommendation for Mobile Apps Using Item-Item Similarity Graph , 2013, AIRS.

[53]  Mario Cataldi,et al.  Emerging topic detection on Twitter based on temporal and social terms evaluation , 2010, MDMKDD '10.

[54]  Rehab Alnemr,et al.  Trend-based and reputation-versed personalized news network , 2011, SMUC '11.