Awesome!: conveying satisfaction on the app store

In a competitive market like the App Store, high user perceived quality is paramount, especially due to the public review system offered. These reviews give developers feedback on their own apps, as well as help provide data for competitor analysis. However, given the size of the data set, manual analysis of reviews is unrealistic, especially given the need for a rapid response to changing market dynamics. Current research into mobile app reviews has provided an insight into the statistical distributions, but there is minimal knowledge about the content in these reviews. In particular, we do not know if the aggregated numerical rating is a reliable indicator of the information within a review. This work reports on an analysis of reviews to determine how closely aligned the numerical ratings are to the textual description. We observed that short user reviews mostly contain a small set of words, and the corresponding numerical rating matches the underlying sentiment.

[1]  Judith Gebauer,et al.  User requirements of mobile technology: results from a content analysis of user reviews , 2008, Inf. Syst. E Bus. Manag..

[2]  Kon Mouzakis,et al.  A preliminary analysis of mobile app user reviews , 2012, OZCHI.

[3]  Dale Goodhue,et al.  Understanding user evaluations of information systems , 1995 .

[4]  Ben Shneiderman,et al.  Research-Based Web Design & Usability Guidelines [2006 edition] , 2006 .

[5]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[6]  Michael W. Godfrey,et al.  The past, present, and future of software evolution , 2008, 2008 Frontiers of Software Maintenance.

[7]  Shahid A. Zia,et al.  Competitive Strategy: Techniques for Analyzing Industries & Competitors , 2013 .

[8]  I. Vermeulen,et al.  Tried and tested: The impact of online hotel reviews on consumer consideration , 2009 .

[9]  Bing Liu,et al.  Sentiment Analysis and Opinion Mining , 2012, Synthesis Lectures on Human Language Technologies.

[10]  Rajesh Vasa,et al.  An Analysis of the Mobile App Review Landscape: Trends and Implications , 2013 .

[11]  Chun-Yao Huang,et al.  An investigation into online reviewers' behavior , 2013 .

[12]  Kon Mouzakis,et al.  Socrates mobile app review dataset , 2013 .

[13]  Debbie Stone,et al.  User Interface Design and Evaluation , 2005 .

[14]  Bernard J. Jansen,et al.  Micro-blogging as online word of mouth branding , 2009, CHI Extended Abstracts.

[15]  Anthony I. Wasserman,et al.  Software engineering issues for mobile application development , 2010, FoSER '10.

[16]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[17]  Kon Mouzakis,et al.  A preliminary analysis of vocabulary in mobile app user reviews , 2012, OZCHI.

[18]  Andrew Whinston,et al.  The Dynamics of Online Word-of-Mouth and Product Sales: An Empirical Investigation of the Movie Industry , 2008 .