Development of Usability Guidelines: A Systematic Literature Review

Abstract Usability guideline is a well-established topic of study, with numerous guidelines developed over the years. There is a lack of study that provides a comprehensive overview of the development of usability guidelines. Motivated by this shortcoming, a systematic review was conducted to establish a body of knowledge on the development of usability guidelines to assist researchers working in the field. The systematic review was conducted by analyzing forty-three (43) research papers selected from seven (7) digital libraries and assessed to identify; the current state of research, specific domains, data collection techniques, development methods, and validation techniques. The results showed an increasing research trend in the development of usability guidelines. The development of usability guidelines was undertaken in many different domains, where the medical domain recorded the highest number of activities. Literature survey is the dominant data collection technique for developing usability guidelines, while usability evaluation is the most common technique for validating newly developed guidelines. The findings concluded that there is a lack of standardization for developing, implementing, and evaluating usability guidelines. Future work can be carried out to establish a methodology for developing and implementing usability guidelines. Moreover, a tool can also be built using machine learning to develop usability guidelines automatically.

[1]  A. Girouard,et al.  Impact of UX Internships on Human-computer Interaction Graduate Students: A Qualitative Analysis of Internship Reports , 2022, ACM Trans. Comput. Educ..

[2]  Joshua Sunshine,et al.  PL and HCI , 2021, Communications of the ACM.

[3]  Munil Shiva Goundar,et al.  The use of mobile learning applications in higher education institutes , 2021, Education and Information Technologies.

[4]  Christos Katsanos,et al.  Test-Retest Reliability of the Open Card Sorting Method , 2021, CHI Extended Abstracts.

[5]  F. Catalá-López,et al.  How to properly use the PRISMA Statement , 2021, Systematic Reviews.

[6]  Chris Cummins,et al.  Machine Learning in Compilers: Past, Present and Future , 2020, 2020 Forum for Specification and Design Languages (FDL).

[7]  Kerryn Butler-Henderson,et al.  COVID-19 in Higher Education Literature Database (CHELD V1): An open access systematic literature review database with coding rules , 2020, 2.

[8]  Bimal Aklesh Kumar,et al.  A framework for heuristic evaluation of mobile learning applications , 2020, Education and Information Technologies.

[9]  Saiful Adli Ismail,et al.  Enhancing Performance Aspect in Usability Guidelines for Mobile Web Application , 2019, 2019 6th International Conference on Research and Innovation in Information Systems (ICRIIS).

[10]  Natasha M. Costa Valentim,et al.  Prototyping Usability and User Experience: A Simple Technique to Agile Teams , 2019, SBQS.

[11]  Natalie Abts,et al.  Guidelines for Mobile Health Applications , 2019, Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care.

[12]  Virginica Rusu,et al.  Customer eXperience: A Bridge Between Service Science and Human-Computer Interaction , 2019, IHSED.

[13]  Syed Ishtiaque Ahmed,et al.  Evaluation of Web Usability Requirement Model and Web Application Interface Components , 2019 .

[14]  Eleanor Wynn,et al.  Qualitative and Critical Research in Information Systems and Human Computer Interaction: Divergent and Convergent Paths , 2019, Foundations and Trends® in Information Systems.

[15]  Bimal Aklesh Kumar,et al.  Usability guideline for Mobile learning applications: an update , 2019, Education and Information Technologies.

[16]  Lachana Ramingwong,et al.  Factors Supporting User Interface Design of Mobile Government Application , 2019, Proceedings of the 2019 2nd International Conference on Information Science and Systems.

[17]  B. Kumar,et al.  Usability heuristics for mobile learning applications , 2019, Education and Information Technologies.

[18]  Gerard O'Regan,et al.  The Innovation in Computing Companion , 2018, Springer International Publishing.

[19]  Taezoon Park,et al.  Development of safety and usability guideline for clinical information system , 2018, Medicine.

[20]  Ahmad Sobri Hashim,et al.  A review on usability guidelines for designing mobile apps user interface for children with autism , 2018 .

[21]  Ahto Kalja,et al.  Design-Time Web Usability Evaluation with Guideliner , 2018, Complex Syst. Informatics Model. Q..

[22]  Ahto Kalja,et al.  Guideliner: a Tool to Improve Web UI Development for Better Usability , 2018, WIMS.

[23]  Khai N. Truong,et al.  Guidelines for Creating Senior-Friendly Product Instructions , 2018, ACM Trans. Access. Comput..

[24]  S. Norris,et al.  The advantages and limitations of guideline adaptation frameworks , 2018, Implementation Science.

[25]  P. Nilsen,et al.  Towards evidence-based palliative care in nursing homes in Sweden: a qualitative study informed by the organizational readiness to change theory , 2018, Implementation Science.

[26]  Siti Fadzilah Mat Noor,et al.  Usability Guidelines for Elderly Website Interface , 2017 .

[27]  Ahto Kalja,et al.  A Tool for Design-Time Usability Evaluation of Web User Interfaces , 2017, ADBIS.

[28]  Gerti Pishtari,et al.  Constructing a Usability Guidelines List for Educational Social Networks , 2017, ICWL.

[29]  Cristina Manresa-Yee,et al.  Validation of navigation guidelines for improving usability in the mobile web , 2017, Comput. Stand. Interfaces.

[30]  André L. M. Santos,et al.  Toward accessibility with usability: understanding the requirements of impaired uses in the mobile context , 2017, IMCOM.

[31]  André L. M. Santos,et al.  Observation based analysis on the use of mobile applications for visually impaired users , 2016, MobileHCI Adjunct.

[32]  Cigdem Altin Gumussoy,et al.  Usability guideline for banking software design , 2016, Comput. Hum. Behav..

[33]  Jon A. Sanford,et al.  Development of Universal Design Mobile Interface Guidelines (UDMIG) for Aging Population , 2016, HCI.

[34]  Regina Bernhaupt,et al.  Game User Experience Evaluation , 2016, Human–Computer Interaction Series.

[35]  Alain Abran,et al.  Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards , 2016, SpringerPlus.

[36]  Paul Komiak,et al.  The Impact of Senior-Friendliness Guidelines on Seniors' Use of Personal Health Records , 2015, 2015 International Conference on Healthcare Informatics.

[37]  Norleyza Jailani,et al.  Usability guidelines for developing mobile application in the construction industry , 2015, 2015 International Conference on Electrical Engineering and Informatics (ICEEI).

[38]  Thanasis Hadzilacos,et al.  Usability Guidelines for the Design of Robot Teleoperation: A Taxonomy , 2015, IEEE Transactions on Human-Machine Systems.

[39]  Jing Xu,et al.  A Pilot Study of an Inspection Framework for Automated Usability Guideline Reviews of Mobile Health Applications , 2014, Wireless Health.

[40]  Ahmed Seffah,et al.  Usability through Software Design , 2013, IEEE Transactions on Software Engineering.

[41]  Fang Hu,et al.  On the Application of the Internet of Things in the Field of Medical and Health Care , 2013, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing.

[42]  Derek Flood,et al.  Usability of mobile applications: literature review and rationale for a new usability model , 2013, Journal of Interaction Science.

[43]  Rozilawati Razali,et al.  Usability Dimensions for Mobile Applications-A Review , 2013 .

[44]  Barbara A. Kitchenham,et al.  Systematic review in software engineering: where we are and where we should be going , 2012, EAST '12.

[45]  Sami Karjalainen,et al.  Usability guidelines for room temperature controls , 2010 .

[46]  Asmaa Alsumait,et al.  Usability heuristics evaluation for child e-learning applications , 2009, J. Softw..

[47]  A. Booth,et al.  A typology of reviews: an analysis of 14 review types and associated methodologies. , 2009, Health information and libraries journal.

[48]  Ab Razak Che Hussin,et al.  Three Layers Design Guideline for Mobile Application , 2009, 2009 International Conference on Information Management and Engineering.

[49]  Liam J. Bannon,et al.  Exploring User-Centred Design in Practice: Some Caveats , 2009 .

[50]  Azham Hussain,et al.  Usability metric for mobile application: a goal question metric (GQM) approach , 2008, iiWAS.

[51]  Mehregan Mahdavi,et al.  Fundamental Usability Guidelines for User Interface Design , 2008, 2008 International Conference on Computational Sciences and Its Applications.

[52]  Natalia Juristo Juzgado,et al.  Guidelines for Eliciting Usability Functionalities , 2007, IEEE Transactions on Software Engineering.

[53]  Nigel Bevan,et al.  Are Guidelines and Standards for Web Usability Comprehensive? , 2007, HCI.

[54]  Panayiotis Zaphiris,et al.  A systematic approach to the development of research-based web design guidelines for older people , 2007, Universal Access in the Information Society.

[55]  Daniel Su Kuen Seong,et al.  Usability guidelines for designing mobile learning portals , 2006, Mobility '06.

[56]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[57]  B. L. William Wong,et al.  Usability evaluation of non-immersive, desktop, photo-realistic virtual environments , 2004 .

[58]  Mun Y. Yi,et al.  Predicting the use of web-based information systems: self-efficacy, enjoyment, learning goal orientation, and the technology acceptance model , 2003, Int. J. Hum. Comput. Stud..

[59]  Misha W. Vaughan,et al.  The bull's-eye: a framework for web application user interface design guidelines , 2003, CHI '03.

[60]  B. Algozzine,et al.  Tips for Teaching: Use of Affinity Diagrams as Instructional Tools in Inclusive Classrooms , 2003 .

[61]  Atsushi Hasegawa,et al.  Usability guideline for i-mode contents , 2001, IS&T/SPIE Electronic Imaging.

[62]  Robert C. Williges,et al.  Criteria For Evaluating Usability Evaluation Methods , 2001, Int. J. Hum. Comput. Interact..

[63]  M. Rosson,et al.  Usability Engineering: Scenario-based Development of Human-Computer Interaction , 2001 .

[64]  James D. Hollan,et al.  Distributed cognition: toward a new foundation for human-computer interaction research , 2000, TCHI.

[65]  Anders Persson,et al.  Observation , 2000, Sociologisk Forskning.

[66]  M. Rosson,et al.  Coordinating Computer-Supported Cooperative Work: A Review of Research Issues and Strategies , 1998, J. Am. Soc. Inf. Sci..

[67]  Pedro Isaias,et al.  Usability and Human–Computer Interaction (HCI) , 2022, Sustainable Design.

[68]  Mohammad Alshehri,et al.  Privacy, Security and Usability for IoT-enabled Weight Loss Apps , 2020 .

[69]  Marco Niemann,et al.  The Data Doesn't Lie - An Approach for Form Usability Evaluation Based on Data Quality , 2020, ECIS.

[70]  Taezoon Park,et al.  Development of Safety and Usability Guideline for Hospital Information System , 2017, MedInfo.

[71]  Anke Schmid,et al.  Design For Six Sigma A Roadmap For Product Development , 2016 .

[72]  Bimal Aklesh Kumar,et al.  Usability guideline for mobile learning apps: an empirical study , 2016, Int. J. Mob. Learn. Organisation.

[73]  Paul Komiak,et al.  On the Need for Theory-grounded Guidelines for Designing Senior-friendly Personal Health Records , 2015 .

[74]  A. Hussain,et al.  Usability Evaluation of Mobile Game Applications: A Systematic Review , 2015 .

[75]  Regina Bernhaupt,et al.  User Experience Evaluation Methods in the Games Development Life Cycle , 2015, Game User Experience Evaluation.

[76]  Sebastian Möller,et al.  New ITG Guideline for the Usability Evaluation of Smart Home Environments , 2014, ITG Symposium on Speech Communication.

[77]  Ana María Moreno Sánchez-Capuchino,et al.  Software Design Guidelines for Usability , 2011 .

[78]  Mark Goellner,et al.  Industrial designers' processes and tools: projections for developing web-based design guidelines , 2009 .

[79]  Rita Hubert,et al.  Accessibility and usability guidelines for mobile devices in home health monitoring , 2006, ASAC.

[80]  Ann Blandford,et al.  Analysing ambulance dispatcher decision making: trialing emergent themes analysis , 2002 .

[81]  Constantine Stephanidis,et al.  User Interfaces for All: New Perspectives into Human- Computer Interaction , 2001 .

[82]  Scott Henninger,et al.  A methodology and tools for applying context-specific usability guidelines to interface design , 2000, Interact. Comput..

[83]  N. Denzin The research act: A theoretical introduction to sociological methods , 1977 .