On Satisfying the Android OS Community: User Feedback Still Central to Developers' Portfolios

End-users play an integral role in identifying requirements, validating software features' usefulness, locating defects, and in software product evolution in general. Their role in these activities is especially prominent in online application distribution platforms (OADPs), where software is developed for many potential users, and for which the traditional processes of requirements gathering and negotiation with a single group of end-users do not apply. With such vast access to end-users, however, comes the challenge of how to prioritize competing requirements in order to satisfy previously unknown user groups, especially with early releases of a product. One highly successful product that has managed to overcome this challenge is the Android Operating System (OS). While the requirements of early versions of the Android OS likely benefited from market research, new features in subsequent releases appear to have benefitted extensively from user reviews. Thus, lessons learned about how Android developers have managed to satisfy the user community over time could usefully inform other software products. We have used data mining and natural language processing (NLP) techniques to investigate the issues that were logged by the Android community, and how Google's remedial efforts correlated with users' requests. We found very strong alignment between end-users' top feature requests and Android developers' responses, particularly for the more recent Android releases. Our findings suggest that effort spent responding to end-users' loudest calls may be integral to software systems' survival, and a product's overall success.

[1]  Yuanyuan Zhang,et al.  App Store Analysis: Mining App Stores for Relationships between Customer, Business and Technical Characteristics , 2014 .

[2]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[3]  Bing Liu,et al.  Sentiment Analysis and Subjectivity , 2010, Handbook of Natural Language Processing.

[4]  W. W. Daniel,et al.  Applied Nonparametric Statistics , 1978 .

[5]  Toshihiko Yamakami A Three-Dimension Analysis of Driving Factors for Mobile Application Stores: Implications of Open Mobile Business Engineering , 2011, 2011 IEEE Workshops of International Conference on Advanced Information Networking and Applications.

[6]  S. Parker Content Analysis for the Social Sciences and Humanities , 1970 .

[7]  Sherlock A. Licorish,et al.  The true role of active communicators: an empirical study of Jazz core developers , 2013, EASE '13.

[8]  Walid Maalej,et al.  User feedback in the appstore: An empirical study , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[9]  Ning Chen,et al.  AR-miner: mining informative reviews for developers from mobile app marketplace , 2014, ICSE.

[10]  Amy J. Ko,et al.  A case study of post-deployment user feedback triage , 2011, CHASE.

[11]  Kristina Winbladh,et al.  Analysis of user comments: An approach for software requirements evolution , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[12]  Walid Maalej,et al.  How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[13]  Björn Regnell,et al.  Market-Driven Requirements Engineering for Software Products , 2005 .

[14]  Alessandra Gorla,et al.  Checking app behavior against app descriptions , 2014, ICSE.

[15]  Rachel Harrison,et al.  Retrieving and analyzing mobile apps feature requests from online reviews , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[16]  Sherlock A. Licorish,et al.  Analyzing confidentiality and privacy concerns: insights from Android issue logs , 2015, EASE.

[17]  Bastin Tony Roy Savarimuthu,et al.  They'll Know It When They See It: Analyzing Post-Release Feedback from the Android Community , 2015, AMCIS.

[18]  Dan Klein,et al.  Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network , 2003, NAACL.

[19]  Margaret Butler,et al.  Android: Changing the Mobile Landscape , 2011, IEEE Pervasive Computing.

[20]  Saurabh Bagchi,et al.  Characterizing Failures in Mobile OSes: A Case Study with Android and Symbian , 2010, 2010 IEEE 21st International Symposium on Software Reliability Engineering.

[21]  A. Andrews,et al.  4 Requirements Prioritization , .

[22]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[23]  Sari Kujala,et al.  User involvement: A review of the benefits and challenges , 2003, Behav. Inf. Technol..

[24]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.