Analyzing reviews guided by App descriptions for the software development and evolution

Reviews in App stores are a massive and fast‐growing data resource for developers to understand user experiences and their needs. Studies show that users often express their sentiments on App features in reviews, and this information is important for the development and evolution of Apps. To help developers gain such information efficiently, this paper proposes a method using App descriptions, another typical data in App stores, to guide the analysis of reviews. Firstly, we extract App features from descriptions, then summarize them to gain topics of App features as high‐level information; the results are formalized as a topic‐based domain model (TBDM). Secondly, we train classifiers of reviews based on the model to establish the relationships between user sentiments and App features. Finally, a quantified method is given to analyze the model based on developer preferences for recommending and summarizing reviews. To evaluate our approach, experiments were conducted using the App descriptions and reviews collected from Google Play. The results indicate that the approach can classify reviews to their related App features effectively (average F measure is 86.13%), and provides useful information for overall analyzing App features in a domain and identifying (dis)advantages of an App.

[1]  Yuanyuan Zhang,et al.  Feature lifecycles as they spread, migrate, remain, and die in App Stores , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[2]  Yuanyuan Zhang,et al.  App Store Analysis: Mining App Stores for Relationships between Customer, Business and Technical Characteristics , 2014 .

[3]  Gabriele Bavota,et al.  Release Planning of Mobile Apps Based on User Reviews , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[4]  Sebastian Thrun,et al.  Text Classification from Labeled and Unlabeled Documents using EM , 2000, Machine Learning.

[5]  David Buttler,et al.  Exploring Topic Coherence over Many Models and Many Topics , 2012, EMNLP.

[6]  Yinglin Wang,et al.  Extracting Software Functional Requirements from Free Text Documents , 2009, 2009 International Conference on Information and Multimedia Technology.

[7]  A. Hassan,et al.  What Do Mobile App Users Complain About ? A Study on Free iOS Apps , 2014 .

[8]  Harald C. Gall,et al.  How can i improve my app? Classifying user reviews for software maintenance and evolution , 2015, 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[9]  Mario Linares Vásquez,et al.  Auto-completing bug reports for Android applications , 2015, ESEC/SIGSOFT FSE.

[10]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[11]  Harald C. Gall,et al.  Recommending and Localizing Change Requests for Mobile Apps Based on User Reviews , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE).

[12]  Lei Liu,et al.  Mining domain knowledge from app descriptions , 2017, J. Syst. Softw..

[13]  Yuanyuan Zhang,et al.  App store mining and analysis: MSR for app stores , 2012, 2012 9th IEEE Working Conference on Mining Software Repositories (MSR).

[14]  Zarinah Mohd Kasirun,et al.  Extracting features from online software reviews to aid requirements reuse , 2016, Appl. Soft Comput..

[15]  Walid Maalej,et al.  How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[16]  Dragan Gasevic,et al.  Decision support for the software product line domain engineering lifecycle , 2011, Automated Software Engineering.

[17]  Harald C. Gall,et al.  What would users change in my app? summarizing app reviews for recommending software changes , 2016, SIGSOFT FSE.

[18]  Jane Cleland-Huang,et al.  Supporting Domain Analysis through Mining and Recommending Features from Online Product Listings , 2013, IEEE Transactions on Software Engineering.

[19]  Bernd Bruegge,et al.  Ensemble Methods for App Review Classification: An Approach for Software Evolution (N) , 2015, 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[20]  Tung Thanh Nguyen,et al.  Mining User Opinions in Mobile App Reviews: A Keyword-Based Approach (T) , 2015, 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[21]  Walid Maalej,et al.  Bug report, feature request, or simply praise? On automatically classifying app reviews , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[22]  Bijendra Patel,et al.  Evaluating trainee experience of surgical skills teaching , 2014 .

[23]  Tung Thanh Nguyen,et al.  Phrase-based extraction of user opinions in mobile app reviews , 2016, 2016 31st IEEE/ACM International Conference on Automated Software Engineering (ASE).

[24]  Francis R. Bach,et al.  Online Learning for Latent Dirichlet Allocation , 2010, NIPS.

[25]  Walid Maalej,et al.  SAFE: A Simple Approach for Feature Extraction from App Descriptions and App Reviews , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[26]  Jae-Gil Lee,et al.  Facilitating developer-user interactions with mobile app review digests , 2013, CHI Extended Abstracts.

[27]  Mark Harman,et al.  Causal impact analysis for app releases in google play , 2016, SIGSOFT FSE.

[28]  Christos Faloutsos,et al.  Why people hate your app: making sense of user feedback in a mobile app store , 2013, KDD.

[29]  Nadia Bouassida,et al.  Mining Feature Models from Functional Requirements , 2016, Comput. J..

[30]  Ning Chen,et al.  AR-miner: mining informative reviews for developers from mobile app marketplace , 2014, ICSE.

[31]  Ahmed E. Hassan,et al.  What Do Mobile App Users Complain About? , 2015, IEEE Software.

[32]  Jieming Zhu,et al.  PAID: Prioritizing app issues for developers by tracking user reviews over versions , 2015, 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE).

[33]  Dietmar Pfahl,et al.  Feature-based evaluation of competing apps , 2016, WAMA@SIGSOFT FSE.

[34]  Yuanyuan Zhang,et al.  A Survey of App Store Analysis for Software Engineering , 2017, IEEE Transactions on Software Engineering.

[35]  Xiaodong Gu,et al.  "What Parts of Your Apps are Loved by Users?" (T) , 2015, 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[36]  Walid Maalej,et al.  User feedback in the appstore: An empirical study , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[37]  Alessandra Gorla,et al.  Checking app behavior against app descriptions , 2014, ICSE.

[38]  Rachel Harrison,et al.  Retrieving and analyzing mobile apps feature requests from online reviews , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).