Usability user testing of selected web-based GIS applications

Web-based geographic information systems (WGIS) are focused on end-users who have only a very limited knowledge of GIS, if any. For this reason, WGIS applications have to be user-friendly. In the terms of a software quality, WGIS applications have to be usable. Lately, many various usability evaluation methods have been developed. Real users or their representatives are included in some of them. Other methods are based only on GIS experts' evaluation of applications. Advantage of deploying real users or at least their representatives is clear - they are able to identify some usability problems which could not be identified by experts. The problem is that usability evaluation in a real situation done by real users is quite difficult. Experimental user usability testing done by representatives of users is the next possibility. In this case, artificial environment is prepared in a laboratory and the whole experiment must be precisely conducted and controlled. In all cases usability testing method must be precisely proposed and/or adapted for the given situation and conditions. Aim of the paper is to propose a suitable experimental method based on usability user testing to identify the most serious usability problems of 14 equal WGIS applications (all applications are run by the Czech Regional Authorities and they are targeted at citizens and other end users). The proposed method is qualitative, so its main aim is to identify the most serious usability problems of the evaluated applications. The proposed method, results of testing and identified problems are described in the end of the paper.

[1]  Huabin Chen,et al.  An architecture for web-based DSS , 2007, ICSE 2007.

[2]  Catalin Boja,et al.  Optimization of distributed software , 2008, ICSE 2008.

[3]  Hareton K. N. Leung,et al.  Quality metrics for intranet applications , 2001, Inf. Manag..

[4]  Jitka Komarkova,et al.  Usability evaluation of web-based GIS: case study , 2009, iiWAS.

[5]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[6]  Motoei Azuma,et al.  Software products evaluation system: quality models, metrics and processes - International Standards and Japanese practice , 1996, Inf. Softw. Technol..

[7]  Paul H. Cheney,et al.  Organizational Factors Affecting the Success of End-User Computing , 1986, J. Manag. Inf. Syst..

[8]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[9]  Kwoting Fang,et al.  Predicting the continuance usage of information systems: A comparison of three alternative models , 2008 .

[10]  Jamal Ouadahi A qualitative analysis of factors associated with user acceptance and rejection of a new workplace information system in the public sector: a conceptual model , 2008 .

[11]  Yonglei Tao Automated Data Collection for Usability Evaluation in Early Stages of Application Development , 2008 .

[12]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[13]  Henning Sten Hansen,et al.  The Citizens in E-Participation , 2006, EGOV.

[14]  Miloslav Hub,et al.  Methodology of fuzzy usability evaluation of Information systems in Public administration , 2008 .

[15]  Debora Shaw,et al.  Handbook of usability testing: How to plan, design, and conduct effective tests , 1996 .

[16]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[17]  Miloslav Hub,et al.  Heuristic evaluation of Geoweb: case study , 2011 .

[18]  Elli Georgiadou,et al.  In search for a widely applicable and accepted software quality model for software quality engineering , 2007, Software Quality Journal.

[19]  John Ingham,et al.  Why do people use information technology? A critical review of the technology acceptance model , 2003, Inf. Manag..

[20]  WonGyu Lee,et al.  Usability Issues of Web-Based Assessment System for K-12 and Implementation of PAS System , 2007 .

[21]  Hung-Jen Yang,et al.  Developing a model of technology behavior intension on strategic web resource , 2006 .

[22]  Anol Bhattacherjee,et al.  Information Technology Continuance: A Theoretic Extension and Empirical Test , 2008, J. Comput. Inf. Syst..

[23]  Martin Novak,et al.  Usability of GeoWeb Sites: Case Study of Czech Regional Authorities Web Sites , 2007, BIS.

[24]  Balbir S. Dhillon,et al.  Engineering product usability: a review and analysis techniques , 2005 .