How Should I Improve the UI of My App?

UI (User Interface) is an essential factor influencing users’ perception of an app. However, it is hard for even professional designers to determine if the UI is good or not for end-users. Users’ feedback (e.g., user reviews in the Google Play) provides a way for app owners to understand how the users perceive the UI. In this article, we conduct an in-depth empirical study to analyze the UI issues of mobile apps. In particular, we analyze more than 3M UI-related reviews from 22,199 top free-to-download apps and 9,380 top non-free apps in the Google Play Store. By comparing the rating of UI-related reviews and other reviews of an app, we observe that UI-related reviews have lower ratings than other reviews. By manually analyzing a random sample of 1,447 UI-related reviews with a 95% confidence level and a 5% interval, we identify 17 UI-related issues types that belong to four categories (i.e., “Appearance,” “Interaction,” “Experience,” and “Others”). In these issue types, we find “Generic Review” is the most occurring one. “Comparative Review” and “Advertisement” are the most negative two UI issue types. Faced with these UI issues, we explore the patterns of interaction between app owners and users. We identify eight patterns of how app owners dialogue with users about UI issues by the review-response mechanism. We find “Apology or Appreciation” and “Information Request” are the most two frequent patterns. We find updating UI timely according to feedback is essential to satisfy users. Besides, app owners could also fix UI issues without updating UI, especially for issue types belonging to “Interaction” category. Our findings show that there exists a positive impact if app owners could actively interact with users to improve UI quality and boost users’ satisfactoriness about the UIs.

[1]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[2]  Pengzhou Zhang,et al.  Research on keyword extraction based on Word2Vec weighted TextRank , 2016, 2016 2nd IEEE International Conference on Computer and Communications (ICCC).

[3]  Harald C. Gall,et al.  ARdoc: app reviews development oriented classifier , 2016, SIGSOFT FSE.

[4]  Mark Harman,et al.  App Store Effects on Software Engineering Practices , 2019, IEEE Transactions on Software Engineering.

[5]  Theresa Neil,et al.  Mobile Design Pattern Gallery: UI Patterns for Smartphone Apps , 2014 .

[6]  Ding Li,et al.  Detecting Display Energy Hotspots in Android Apps , 2015, 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST).

[7]  Aaron Marcus,et al.  Human communications issues in advanced UIs , 1993, CACM.

[8]  Martin P. Robillard,et al.  Patterns of Knowledge in API Reference Documentation , 2013, IEEE Transactions on Software Engineering.

[9]  Mira Dontcheva,et al.  Rewire: Interface Design Assistance from Examples , 2018, CHI.

[10]  Cor-Paul Bezemer,et al.  A longitudinal study of popular ad libraries in the Google Play Store , 2019, Empirical Software Engineering.

[11]  Christos Faloutsos,et al.  Why people hate your app: making sense of user feedback in a mobile app store , 2013, KDD.

[12]  Yang Liu,et al.  From UI Design Image to GUI Skeleton: A Neural Machine Translator to Bootstrap Mobile GUI Implementation , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[13]  Lingling Fan,et al.  StoryDroid: Automated Generation of Storyboard for Android Apps , 2019, 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE).

[14]  Jerzy Grobelny,et al.  The role of background color, interletter spacing, and font size on preferences in the digital presentation of a product , 2015, Comput. Hum. Behav..

[15]  Andreas Zeller,et al.  Anatomy of Functionality Deletion: An Exploratory Study on Mobile Apps , 2018, 2018 IEEE/ACM 15th International Conference on Mining Software Repositories (MSR).

[16]  Gabriele Bavota,et al.  Optimizing energy consumption of GUIs in Android apps: a multi-objective approach , 2015, ESEC/SIGSOFT FSE.

[17]  A. Azzouz 2011 , 2020, City.

[18]  K. Roulston Data analysis and ‘theorizing as ideology’ , 2001 .

[19]  Robert Bringhurst,et al.  The Elements of Typographic Style , 1992 .

[20]  Harald C. Gall,et al.  Recommending and Localizing Change Requests for Mobile Apps Based on User Reviews , 2017, 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE).

[21]  Harald C. Gall,et al.  What would users change in my app? summarizing app reviews for recommending software changes , 2016, SIGSOFT FSE.

[22]  Aaron Marcus,et al.  Culture issues and mobile UI design , 2003, CHI Extended Abstracts.

[23]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[24]  Boyang Li,et al.  Automated Reporting of GUI Design Violations for Mobile Apps , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[25]  Ahmed E. Hassan,et al.  Prioritizing the devices to test your app on: a case study of Android game apps , 2014, SIGSOFT FSE.

[26]  Rachel Harrison,et al.  What are you complaining about?: a study of online reviews of mobile applications , 2013, BCS HCI.

[27]  Kristine Jørgensen,et al.  Do Players Prefer Integrated User Interfaces? A Qualitative Study of Game UI Design Issues , 2011 .

[28]  Atif M. Memon,et al.  Conceptualization and Evaluation of Component-Based Testing Unified with Visual GUI Testing: An Empirical Study , 2015, 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST).

[29]  刘亚平,et al.  Material Design:流动在不同屏幕问的质感 , 2014 .

[30]  Robert Feldt,et al.  Visual GUI testing in practice: challenges, problemsand limitations , 2015, Empirical Software Engineering.

[31]  Gustavo Pinto,et al.  Mining questions about software energy consumption , 2014, MSR 2014.

[32]  Cor-Paul Bezemer,et al.  Studying the dialogue between users and developers of free apps in the google play store , 2018, ICSE.

[33]  Gabriele Bavota,et al.  User reviews matter! Tracking crowdsourced reviews to support evolution of successful apps , 2015, 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[34]  Yuanyuan Zhang,et al.  A Survey of App Store Analysis for Software Engineering , 2017, IEEE Transactions on Software Engineering.

[35]  Ahmed E. Hassan,et al.  An empirical study of emergency updates for top android mobile apps , 2017, Empirical Software Engineering.

[36]  Phillip Isola,et al.  Mining Visual Evolution in 21 Years of Web Design , 2017, CHI Extended Abstracts.

[37]  Ahmed E. Hassan,et al.  Analyzing and automatically labelling the types of user issues that are raised in mobile app reviews , 2015, Empirical Software Engineering.

[38]  Tuan Anh Nguyen,et al.  Reverse Engineering Mobile Application User Interfaces with REMAUI (T) , 2015, 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[39]  Thomas F. Liu,et al.  Learning Design Semantics for Mobile Apps , 2018, UIST.

[40]  Rachel Harrison,et al.  Retrieving and analyzing mobile apps feature requests from online reviews , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[41]  Richard E. Boyatzis,et al.  Transforming Qualitative Information: Thematic Analysis and Code Development , 1998 .

[42]  Cor-Paul Bezemer,et al.  Studying Bad Updates of Top Free-to-Download Apps in the Google Play Store , 2020, IEEE Transactions on Software Engineering.

[43]  L Swadner Graphical User Interface , 2009, Encyclopedia of Biometrics.

[44]  Ying Zou,et al.  Winning the app production rally , 2018, ESEC/SIGSOFT FSE.

[45]  Cor-Paul Bezemer,et al.  An empirical study of game reviews on the Steam platform , 2018, Empirical Software Engineering.

[46]  Tony Beltramelli,et al.  pix2code: Generating Code from a Graphical User Interface Screenshot , 2017, EICS.

[47]  Michael R. Lyu,et al.  Online App Review Analysis for Identifying Emerging Issues , 2018, 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE).

[48]  David Lo,et al.  Perceptions, Expectations, and Challenges in Defect Prediction , 2020, IEEE Transactions on Software Engineering.

[49]  Toni Granollers,et al.  Investigating accessibility issues of UI mobile design patterns in online communities: a virtual ethnographic study , 2017, IHC.

[50]  Robert DeLine,et al.  Information Needs in Collocated Software Development Teams , 2007, 29th International Conference on Software Engineering (ICSE'07).

[51]  Harald C. Gall,et al.  How can i improve my app? Classifying user reviews for software maintenance and evolution , 2015, 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[52]  Gabriele Bavota,et al.  Release Planning of Mobile Apps Based on User Reviews , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[53]  Shari Lawrence Pfleeger,et al.  Personal Opinion Surveys , 2008, Guide to Advanced Empirical Software Engineering.

[54]  Yuanyuan Zhang,et al.  The App Sampling Problem for App Store Mining , 2015, 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories.

[55]  Jeffrey Nichols,et al.  Rico: A Mobile App Dataset for Building Data-Driven Design Applications , 2017, UIST.

[56]  Qi Xin,et al.  Seeking the user interface , 2014, Automated Software Engineering.

[57]  Rachel Harrison,et al.  Online Reviews as First Class Artifacts in Mobile App Development , 2013, MobiCASE.

[58]  Ding Li,et al.  An Empirical Study of the Energy Consumption of Android Applications , 2014, 2014 IEEE International Conference on Software Maintenance and Evolution.

[59]  Walt Scacchi,et al.  Process Models in Software Engineering , 2001 .

[60]  Alessandro Orso,et al.  GUIFetch: Supporting App Design and Development through GUI Search , 2018, 2018 IEEE/ACM 5th International Conference on Mobile Software Engineering and Systems (MOBILESoft).

[61]  Muhammad Asif,et al.  Towards Improving the Quality of Mobile App Reviews , 2015 .

[62]  David Lo,et al.  How Practitioners Perceive Coding Proficiency , 2019, 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE).

[63]  Hammad Khalid On identifying user complaints of iOS apps , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[64]  Yeliz Yesilada,et al.  Barriers common to mobile and disabled web users , 2011, Interact. Comput..

[65]  Chui Yin Wong,et al.  Usability and Design Issues of Smartphone User Interface and Mobile Apps for Older Adults , 2018 .

[66]  Shawn Lawton Henry,et al.  The role of accessibility in a universal web , 2014, W4A.

[67]  Mahdi H. Miraz,et al.  User interface (UI) design issues for multilingual users: a case study , 2014, Universal Access in the Information Society.

[68]  Christopher Vendome,et al.  Can Everyone use my app? An Empirical Study on Accessibility in Android Apps , 2019, 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[69]  Antonella De Angeli,et al.  Pick me!: Getting Noticed on Google Play , 2016, CHI.

[70]  Ahmed E. Hassan,et al.  Studying Ad Library Integration Strategies of Top Free-to-Download Apps , 2021, IEEE Transactions on Software Engineering.

[71]  Yingjun Lyu,et al.  Automated Energy Optimization of HTTP Requests for Mobile Applications , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE).

[72]  Ahmed E. Hassan,et al.  What Do Mobile App Users Complain About? , 2015, IEEE Software.

[73]  E. Gehan A GENERALIZED WILCOXON TEST FOR COMPARING ARBITRARILY SINGLY-CENSORED SAMPLES. , 1965, Biometrika.

[74]  Jiachi Chen,et al.  Defining Smart Contract Defects on Ethereum , 2019 .

[75]  Calton Pu,et al.  Evaluating User Satisfaction with Typography Designs via Mining Touch Interaction Data in Mobile Reading , 2018, CHI.

[76]  Walid Maalej,et al.  Bug report, feature request, or simply praise? On automatically classifying app reviews , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[77]  Robert Biddle,et al.  Agile Development Iterations and UI Design , 2007, Agile 2007 (AGILE 2007).

[78]  Klaus Miesenberger,et al.  Can We Improve App Accessibility with Advanced Development Methods? , 2018, ICCHP.

[79]  Ahmed E. Hassan,et al.  Examining the Rating System Used in Mobile-App Stores , 2016, IEEE Software.

[80]  N. Hoffart Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[81]  Denys Poshyvanyk,et al.  Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps , 2018, IEEE Transactions on Software Engineering.

[82]  Michael R. Lyu,et al.  Experience Report: Understanding Cross-Platform App Issues from User Reviews , 2016, 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE).

[83]  Ning Chen,et al.  AR-miner: mining informative reviews for developers from mobile app marketplace , 2014, ICSE.

[84]  Thomas Fritz,et al.  Using information fragments to answer the questions developers ask , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[85]  Jae-Gil Lee,et al.  Facilitating developer-user interactions with mobile app review digests , 2013, CHI Extended Abstracts.

[86]  D. Hinkle,et al.  Applied statistics for the behavioral sciences , 1979 .