European Portuguese validation of the Post-Study System Usability Questionnaire (PSSUQ)

The Post-Study System Usability Questionnaire (PSSUQ) is a 19-item instrument developed to assess the user satisfaction with system usability. The PSSUQ is widely used and robust in psychometric terms. This paper presents the process of translation, cultural adaptation and contribution to validation of the European Portuguese version of PSSUQ. The study is divided in two phases, the questionnaire translation and adaptation and the questionnaire validation. The questionnaire translation resulted in a Portuguese European version of PSSUQ equivalent to the original in terms of semantic and content. The second phase consisted of the validity and reliability assessment. The PSSUQ has excelent internal consistency (α = 0.80), as well as, satisfactory inter-rater reliability (ICC = 0.67). The PSSUQ presents construct validity, with a high and significant correlation with an overall usability evaluation question (r=0.84, p<;0.05). The PSSUQ presents discriminative validity, distinguishing applications with distinct quality.

[1]  Bella Martin,et al.  Universal Methods of Design: 100 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions , 2012 .

[2]  James R. Lewis Psychometric Evaluation of the Post-Study System Usability Questionnaire: The PSSUQ , 1992 .

[3]  Maria Helena de Aguiar Pereira e Pestana,et al.  Análise de Dados para Ciências Sociais: a Complementaridade do SPSS , 2008 .

[4]  W. Foddy Constructing Questions for Interviews and Questionnaires: Theory and Practice in Social Research , 1993 .

[5]  Nelson Pacheco da Rocha,et al.  Avaliação de Usabilidade: Uma Revisão Sistemática da Literatura , 2013 .

[6]  Thomas N. Smyth,et al.  Global/Local Usability: Locally Contextualized Usability in the Global South , 2011, Global Usability.

[7]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[8]  James R. Lewis AN AFTER-SCENARIO QUESTIONNAIRE FOR USABILITY STUDIES: PSYCHOMETRIC EVALUATION OVER THREE TRIALS , 1991, SGCH.

[9]  Angela M. Cirucci,et al.  Usability Testing , 2021, UX Research Methods for Media and Communication Studies.

[10]  John L. Bennett,et al.  Usability Engineering: Our Experience and Evolution , 1988 .

[11]  Marti A. Hearst,et al.  The state of the art in automating usability evaluation of user interfaces , 2001, CSUR.

[12]  James R. Lewis,et al.  Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies , 2002, Int. J. Hum. Comput. Interact..

[13]  Nigel Bevan,et al.  Planning and implementing user-centred design , 1999, CHI EA '99.

[14]  C. Bombardier,et al.  Guidelines for the process of cross-cultural adaptation of self-report measures. , 2000, Spine.

[15]  James R. Lewis,et al.  Psychometric evaluation of an after-scenario questionnaire for computer usability studies: the ASQ , 1991, SGCH.