Visual Clarity Checker (VC2) to support heuristic evaluation: To what extent does VC2 help evaluators?

Visual clarity checking is one of the criteria to assess when performing heuristic evaluation (HE). HE, as we already aware, is a practice where the usability experts use their expertise and knowledge in assessing websites or systems. Whilst the practice is commonly performed manually, using tools in HE would theoretically assist the experts, but to what extent? This paper attempts to answer the posed question by performing a comparison study of a paired t-test or repeated measure t-test (within subject) between heuristic experts. They performed a HE on an e-commerce website under two conditions: normal HE method, and, HE assisted with Visual Clarity Checker (VC2) tool. The results of the experiment, shows the use of VC2 was helpful in issues compilation; as it does help the experts to at least find issues that are explicitly related to visual clarity of images and categorized them accordingly. But not all issues are incorporated in the final HE report, as the consideration is made by the experts. The feedback about the usage of the tool however are mixed, as the experts found it as time consuming to analyze the VC2 results.

[1]  Ashok Sivaji,et al.  Enhancing the Effectiveness of Usability Evaluation by Automated Heuristic Evaluation System , 2011, 2011 Third International Conference on Computational Intelligence, Communication Systems and Networks.

[2]  Rebecca Matson,et al.  Barriers to use: usability and content accessibility on the Web's most popular sites , 2000, CUU '00.

[3]  Agnes Koschmider,et al.  A Quality Model for Mashups , 2011, ICWE.

[4]  Marcel Bauer Web Application Design Handbook Best Practices For Web Based Software , 2016 .

[5]  Ashok Sivaji,et al.  Understanding, Enhancing and Automating HCI Work Practices: Malaysian Case Studies , 2013 .

[6]  Thomas S. Tullis,et al.  Efficiency, Trust, and Visual Appeal: Usability Testing through Eye Tracking , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[7]  Azween Abdullah,et al.  Usability Testing Methodology: Effectiveness of Heuristic Evaluation in E-Government Website Development , 2011, 2011 Fifth Asia Modelling Symposium.

[8]  Jakob Nielsen,et al.  Severity Ratings for Usability Problems , 2006 .

[9]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[10]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[11]  Laurence S. Dooley,et al.  Gestalt theory in visual screen design: a new look at an old subject , 2002 .

[12]  Helen Petrie,et al.  The relationship between accessibility and usability of websites , 2007, CHI.

[13]  Rex Black,et al.  Foundations of Software Testing ISTQB Certification , 2006 .

[14]  Susan Fowler,et al.  Web application design handbook - best practices for web-based software , 2004, The Morgan Kaufmann series in interactive technologies.

[15]  Majed A. Alshamari,et al.  Improving the Effectiveness of Developed Heuristic Evaluation Method , 2015 .

[16]  S. Coakes SPSS : analysis without anguish : version 20.0 for Windows , 2017 .