Investigating Quality of Institutional Repository Website Design Using Usability Testing Framework

Quality of website design is one of the influential factors of website success. How the design helps the users using effectively and efficiently website and satisfied at the end of the use. However, it is a common tendency that websites are designed based on the developer's perspectives and lack considering user importance. Thus, the degree of website usability tends to be low according to user perceptions. This study purposed to understand the user experiences using an institutional repository (IR) website in a public university in Indonesia. The research was performed based on usability testing framework as the usability testing method. About 12 participants were purposely involved concerning their key informant characteristics. Following three empirical data collection techniques (i.e., query technique, formal experiment, and thinking aloud), both descriptive analysis using usability scale matric and content analysis using qualitative data analysis (QDA) Miner Lite software were used in the data analysis stage. Lastly, several visual design recommendations were then proposed at the end of the study. In terms of a case study, besides the practical recommendations which may contextually useful for the next website development; the clarity of the research design may also help scholars how to combine more than one usability testing technique within a multi-technique study design.

[1]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[2]  Anitawati Mohd Lokman,et al.  Usability testing research framework: Case of Handicraft Web-Based System , 2014, 2014 2nd International Conference on Information and Communication Technology (ICoICT).

[3]  Oliver Schilke,et al.  What Drives Key Informant Accuracy? , 2012 .

[4]  Jeff Sauro,et al.  Chapter 2 – Quantifying user research , 2016 .

[5]  Mira Kartiwi,et al.  The User Satisfaction Perspectives of the Information System Projects , 2016 .

[6]  Retno Kusumaningrum,et al.  Usability testing of weather monitoring on a web application , 2017, 2017 1st International Conference on Informatics and Computational Sciences (ICICoS).

[7]  Carolina Ruiz,et al.  Using a Key Informant Focus Group, Formative User Testing, and Theory to Guide Design of a Sleep Health BCSS , 2017, HICSS.

[8]  Andreas Sonderegger,et al.  The influence of age in usability testing. , 2016, Applied ergonomics.

[9]  Jeff Sauro,et al.  Quantifying the User Experience: Practical Statistics for User Research , 2012 .

[10]  Reyes Juárez-Ramírez,et al.  Framework to Evaluate M-Learning Systems: A Technological and Pedagogical Approach , 2016, IEEE Revista Iberoamericana de Tecnologias del Aprendizaje.

[11]  Dhanapal Durai Dominic,et al.  A New Approach of Indonesian University Webometrics Ranking Using Entropy and PROMETHEE II , 2017 .

[12]  James R. Lewis,et al.  The System Usability Scale: Past, Present, and Future , 2018, Int. J. Hum. Comput. Interact..

[13]  Mulya Suryadi,et al.  Integrating the Readiness and Usability Models for Assessing the Information System Use , 2018, 2018 6th International Conference on Cyber and IT Service Management (CITSM).

[14]  Satriyo Adhy,et al.  Usability Testing of Weather Monitoring on Android Application , 2018, 2018 2nd International Conference on Informatics and Computational Sciences (ICICoS).

[15]  A Jiamsanguanwong,et al.  User requirement and usability testing framework for information system development: case study of financial institution , 2020 .