User Feedback in the App Store: A Cross-Cultural Study

App stores allow globally distributed users to submit user feedback, in the form of user reviews, about the apps they download. Previous research has found that many of these reviews contain valuable information for software evolution, such as bug reports or feature requests, and has designed approaches for automatically extracting this information. However, the diversity of the feedback submitted by users from diverse cultural backgrounds and the consequences this diversity might imply have not been studied so far. In this paper, we report on a cross-cultural study where we investigated cultural differences in app store reviews and identified correlations to cultural dimensions taken from a well-established cultural model. We analyzed 2,560 app reviews written by users from eight countries with diverse national culture. We contribute evidence about the influence of cultural factors on characteristics of app reviews. Our results also help developers of automated feedback analysis tools to avoid cultural bias when choosing their algorithms and the data for training and validating them.

[1]  Sydney Gregory,et al.  Culture's consequences: international differences in work-related values , 1982 .

[2]  Ning Chen,et al.  AR-miner: mining informative reviews for developers from mobile app marketplace , 2014, ICSE.

[3]  Katharina Reinecke,et al.  Participation Differences in Q&A Sites Across Countries: Opportunities for Cultural Adaptation , 2016, NordiCHI.

[4]  Ahmed E. Hassan,et al.  What Do Mobile App Users Complain About? , 2015, IEEE Software.

[5]  Harald C. Gall,et al.  Recommending and Localizing Change Requests for Mobile Apps Based on User Reviews , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE).

[6]  Walid Maalej,et al.  Bug report, feature request, or simply praise? On automatically classifying app reviews , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[7]  Alma T. Mintu Cultures and Organizations: Software of the Mind , 1992 .

[8]  Adam Tauman Kalai,et al.  Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings , 2016, NIPS.

[9]  Rajesh Vasa,et al.  An Analysis of the Mobile App Review Landscape: Trends and Implications , 2013 .

[10]  Harald C. Gall,et al.  What would users change in my app? summarizing app reviews for recommending software changes , 2016, SIGSOFT FSE.

[11]  Daniele Quercia,et al.  Twitter ain't without frontiers: economic, social, and cultural boundaries in international communication , 2014, CSCW.

[12]  Harald C. Gall,et al.  How can i improve my app? Classifying user reviews for software maintenance and evolution , 2015, 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[13]  Naji Habra,et al.  RESEARCH OUTPUTS / RÉSULTATS DE RECHERCHE , 2022 .

[14]  Yuanyuan Zhang,et al.  A Survey of App Store Analysis for Software Engineering , 2017, IEEE Transactions on Software Engineering.

[15]  Walid Maalej,et al.  User feedback in the appstore: An empirical study , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).

[16]  G. Hofstede Dimensionalizing cultures: The Hofstede model in context , 2011 .

[17]  G. Hofstede,et al.  Culture′s Consequences: International Differences in Work-Related Values , 1980 .

[18]  Bernd Brügge,et al.  User involvement in software evolution practice: A case study , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[19]  Gabriele Bavota,et al.  Release Planning of Mobile Apps Based on User Reviews , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[20]  Gayna Williams,et al.  Are you sure your software is gender-neutral? , 2014, INTR.

[21]  Kevin Quigley Trust: The social virtues and the creation of prosperity , 1996 .

[22]  Rachel Harrison,et al.  Retrieving and analyzing mobile apps feature requests from online reviews , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[23]  A. Kimball Romney,et al.  Variations in value orientations. , 1961 .

[24]  Kimberly A. Neuendorf,et al.  The Content Analysis Guidebook , 2001 .

[25]  Mohamed Ibrahim,et al.  Prioritizing User Feedback from Twitter: A Survey Report , 2017, 2017 IEEE/ACM 4th International Workshop on CrowdSourcing in Software Engineering (CSI-SE).

[26]  Norbert Seyff,et al.  A Needle in a Haystack: What Do Twitter Users Say about Software? , 2016, 2016 IEEE 24th International Requirements Engineering Conference (RE).

[27]  Hwan-Seung Yong,et al.  Distributed agile: project management in a global environment , 2010, Empirical Software Engineering.

[28]  Rishi Chandy,et al.  Identifying spam in the iOS app store , 2012, WebQuality '12.

[29]  Mohamed Ibrahim,et al.  A Little Bird Told Me: Mining Tweets for Requirements and Software Evolution , 2017, 2017 IEEE 25th International Requirements Engineering Conference (RE).

[30]  Katharina Reinecke,et al.  Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces , 2011, TCHI.

[31]  F. Strodtbeck,et al.  Variations in value orientations. , 1961 .

[32]  Pär J. Ågerfalk,et al.  Agile Practices Reduce Distance in Global Software Development , 2006, Inf. Syst. Manag..

[33]  Bernd Brügge,et al.  Retrieving Diverse Opinions from App Reviews , 2015, 2015 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM).

[34]  Jason Weston,et al.  A Neural Attention Model for Abstractive Sentence Summarization , 2015, EMNLP.

[35]  Bernd Bruegge,et al.  Ensemble Methods for App Review Classification: An Approach for Software Evolution (N) , 2015, 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[36]  Katharina Reinecke,et al.  Quantifying visual preferences around the world , 2014, CHI.

[37]  Walid Maalej,et al.  How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews , 2014, 2014 IEEE 22nd International Requirements Engineering Conference (RE).

[38]  Heiko Böck Internationalization and Localization , 2012 .

[39]  G. Hofstede,et al.  Cultures and Organizations: Software of the Mind , 1991 .

[40]  Evie McCrum-Gardner,et al.  Which is the correct statistical test to use? , 2008, The British journal of oral & maxillofacial surgery.