How to Report App Feedback?: Analyzing Feedback Reporting Behavior

Users face various usability issues when interacting with mobile apps. While collecting quality in-situ feedback is extremely valuable for the developers for UX improvement, our understanding of user feedback reporting behavior and interface design is very limited. In this paper, we conducted a user study to solicit feedback from five mobile apps using think-aloud protocol with video recordings. Using the collected data, we investigated the attributes of usability issues related to feedback reporting behavior. We identified four key attributes of usability issues related to feedback reporting behavior, i.e., usability issue topics, origin of usability issues, types of actions, and content/context dynamicity. Our analysis will provide a useful foundation for building a feedback reporting system for end users.

[1]  Bernd Brügge,et al.  User involvement in software evolution practice: A case study , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[2]  Barry A. T. Brown,et al.  100 days of iPhone use: understanding the details of mobile device use , 2014, MobileHCI '14.

[3]  James A. Landay,et al.  MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones , 2007, MobiSys '07.

[4]  John T. Kelso,et al.  Remote evaluation: the network as an extension of the usability laboratory , 1996, CHI.

[5]  Carolyn Y. Wei,et al.  Towards the perfect infrastructure for usability testing on mobile devices , 2007, CHI Extended Abstracts.

[6]  Gail C. Murphy,et al.  Summarizing software artifacts: a case study of bug reports , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[7]  Muneera Bano,et al.  User involvement in software development and system success: a systematic literature review , 2013, EASE '13.

[8]  Christos Faloutsos,et al.  Why people hate your app: making sense of user feedback in a mobile app store , 2013, KDD.

[9]  Jesper Kjeldskov,et al.  Is It Worth the Hassle? Exploring the Added Value of Evaluating the Usability of Context-Aware Mobile Systems in the Field , 2004, Mobile HCI.

[10]  Brad A. Myers,et al.  A Linguistic Analysis of How People Describe Software Problems , 2006, Visual Languages and Human-Centric Computing (VL/HCC'06).

[11]  Thomas Zimmermann,et al.  Extracting structural information from bug reports , 2008, MSR '08.

[12]  Robin Jeffries,et al.  Usability testing vs. heuristic evaluation: was there a contest? , 1992, SGCH.

[13]  Krzysztof Czarnecki,et al.  Modelling the ‘hurried’ bug report reading process to summarize bug reports , 2012, 2012 28th IEEE International Conference on Software Maintenance (ICSM).

[14]  Steven M. Belz,et al.  The user action framework: a reliable foundation for usability engineering support tools , 2001, Int. J. Hum. Comput. Stud..

[15]  Deborah J. Mayhew,et al.  The usability engineering lifecycle , 1998, CHI Conference Summary.

[16]  Muneera Bano,et al.  Users' involvement in requirements engineering and system success , 2013, 2013 3rd International Workshop on Empirical Requirements Engineering (EmpiRE).

[17]  Karel Vredenburg,et al.  USER-CENTERED DESIGN PRACTICE , 2005 .

[18]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[19]  Karel Vredenburg,et al.  The state of user-centered design practice , 2005, IEEE Engineering Management Review.

[20]  Dennis G. Kafura,et al.  The Usability Problem Taxonomy: A Framework for Classification and Analysis , 1999, Empirical Software Engineering.

[21]  Sari Kujala,et al.  User involvement: A review of the benefits and challenges , 2003, Behav. Inf. Technol..

[22]  Chauncey E. Wilson,et al.  The whiteboard: Tracking usability issues: to bug or not to bug? , 2001, INTR.

[23]  Karel Vredenburg,et al.  A survey of user-centered design practice , 2002, CHI.

[24]  Jae-Gil Lee,et al.  Facilitating developer-user interactions with mobile app review digests , 2013, CHI Extended Abstracts.

[25]  Deborah Hix,et al.  Remote usability evaluation: can users report their own critical incidents? , 1998, CHI Conference Summary.

[26]  Thomas Zimmermann,et al.  What Makes a Good Bug Report? , 2008, IEEE Transactions on Software Engineering.

[27]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[28]  Frank Maurer,et al.  Requirements engineering and agile software development , 2003, WET ICE 2003. Proceedings. Twelfth IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, 2003..

[29]  Walid Maalej,et al.  User feedback in the appstore: An empirical study , 2013, 2013 21st IEEE International Requirements Engineering Conference (RE).