Modeling subjective metrics for mobile evaluation

There are several methods to evaluate mobile applications. The aim is to ensure that the applications are usable and satisfying users. Among the methods include lab test and field test.However, not many have focused on the quality characteristics should be used during the test.This study aims to develop subjective metrics for evaluation of mobile application using Goal Question Metric (GQM).To ensure the metrics we develop are reliable and useful, we conduct usability study that used the metrics we developed using GQM approach.The result indicates that the metrics can be used to evaluate mobile application in term of user satisfaction.Four test cases with different platforms employed in this study shows that the metrics are reliable to be used in mobile evaluation.

[1]  宋滟泓.  App Store开人民币付款先河 苹果中国本土化路上问题多 , 2011 .

[2]  Antonio Vallecillo,et al.  Measuring the usability of software components , 2006, J. Syst. Softw..

[3]  Henry Been-Lirn Duh,et al.  Usability evaluation for mobile device: a comparison of laboratory and field tests , 2006, Mobile HCI.

[4]  Stanley H. Caplan.  Using focus group methodology for ergonomic design , 1990 .

[5]  Constantinos K. Coursaris,et al.  A research agenda for mobile usability , 2007, CHI Extended Abstracts.

[6]  B.A. Kitchenham,et al.  Systematic Reviews , 2011, Diabetes Care.

[7]  P. Botella.  ISO / IEC 9126 in practice : what do we need to know ? , 2004 .

[8]  H. D. Rombach,et al.  The Goal Question Metric Approach , 1994 .

[9]  Steve Howard,et al.  Evaluating the usability of a mobile guide: The influence of location, participants and resources , 2005, Behav. Inf. Technol..

[10]  Kasper Hornbæk,et al.  Meta-analysis of correlations among usability measures , 2007, CHI.

[11]  Egon Berghout,et al.  The Goal/Question/Metric method: a practical guide for quality improvement of software development , 1999 .

[12]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[13]  Thierry Bodhuin,et al.  A framework for measuring business processes based on GQM , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[14]  Rex B. Kline,et al.  Usability measurement and metrics: A consolidated model , 2006, Software Quality Journal.

[15]  David Silverman,et al.  Qualitative research: meanings or practices? , 1998, Inf. Syst. J..

[16]  Anna L. Cox,et al.  Research Methods for Human-Computer Interaction , 2008 .

[17]  Jun Gong,et al.  GUIDELINES FOR HANDHELD MOBILE DEVICE INTERFACE DESIGN , 2004 .

[18]  Ben Shneiderman,et al.  Research-Based Web Design & Usability Guidelines [2006 edition] , 2006 .

[19]  Azham Hussain,et al.  Usability metric for mobile application: a goal question metric (GQM) approach , 2008, iiWAS.

[20]  Oleg Starostenko,et al.  Generation of usable interfaces for mobile devices , 2005, CLIHC '05.

[21]  Luigi Lavazza.  Providing Automated Support for the GQM Measurement Process , 2000, IEEE Softw..

[22]  Daniel Su Kuen Seong,et al.  Usability guidelines for designing mobile learning portals , 2006, Mobility '06.

[23]  Miles MacLeod,et al.  Usability measurement in context , 1994, Behav. Inf. Technol..

[24]  Dongsong Zhang,et al.  Challenges, Methodologies, and Issues in the Usability Testing of Mobile Applications , 2005, Int. J. Hum. Comput. Interact..

[25]  R. Hirschheim.  INFORMATION SYSTEMS EPISTEMOLOGY: AN HISTORICAL PERSPECTIVE , 2000 .

[26]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..