Chinese System Usability Scale: Translation, Revision, Psychological Measurement

ABSTRACT The Chinese version of the system usability scale (SUS) was re-translated in this study by the addition of an interview process plus the modification and selection of strict translation results. The revised translation is in close accordance with the linguistic usage of Chinese native speakers without any ambiguity. The revised Chinese version of the psychometric measurement is shown to be reliable, effective, and sensitive. We also conducted a comparative study within one group to confirm that the reliability of the cross-cultural adaptation version is higher than that of the original version. The questionnaire provides a tested tool for Chinese language users to help practitioners complete usability assessments.

[1]  Jian Wang.  Human-computer interaction research and practice in China , 2003, INTR.

[2]  Philip T. Kortum,et al.  Usability Ratings for Everyday Products Measured With the System Usability Scale , 2013, Int. J. Hum. Comput. Interact..

[3]  Philippe Verduyn,et al.  Which emotions last longest and why: The role of event importance and rumination , 2015 .

[5]  R LewisJames,et al.  Revisiting the factor structure of the system usability scale , 2017 .

[6]  Stefano Federici,et al.  On the dimensionality of the System Usability Scale: a test of alternative measurement models , 2009, Cognitive Processing.

[7]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[8]  Comparison of Procedures for Detecting test-Item Bias with both Internal and External Ability Criteria , 1981 .

[9]  Y. Hao,et al.  The Chinese version of the Pediatric Quality of Life Inventory™ (PedsQL™) Family Impact Module: cross-cultural adaptation and psychometric evaluation , 2011, Health and quality of life outcomes.

[10]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[11]  Jiajie Zhang,et al.  The Current Status of Usability Studies of Information Technologies in China: A Systematic Study , 2014, BioMed research international.

[12]  Jaehyun Park,et al.  Developing Elements of User Experience for Mobile Phones and Services: Survey, Interview, and Observation Approaches , 2013 .

[13]  Jeff Sauro,et al.  Can I leave this one out?: the effect of dropping an item from the SUS , 2017 .

[14]  Nelson Pacheco da Rocha,et al.  European Portuguese Validation of the System Usability Scale (SUS) , 2015, DSAI.

[15]  H. J. Arnold,et al.  Social desirability response bias in self-report choice situations. , 1981 .

[16]  Q. Qian,et al.  Cross-cultural adaptation and validation of the Simplified Chinese version of Copenhagen Hip and Groin Outcome Score (HAGOS) for total hip arthroplasty , 2018, Journal of Orthopaedic Surgery and Research.

[17]  Muhamad Fadhil Mohamad Marzuki,et al.  Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps , 2018, JMIR human factors.

[18]  Bareeq A. Al Ghannam,et al.  Towards a Standard Arabic System Usability Scale: Psychometric Evaluation using Communication Disorder App , 2018, Int. J. Hum. Comput. Interact..

[19]  Jeff Sauro,et al.  Correlations among prototypical usability metrics: evidence for the construct of usability , 2009, CHI.

[20]  James R. Lewis,et al.  UMUX-LITE: when there's no time for the SUS , 2013, CHI.

[21]  Kraig Finstad.  The system usability scale and non-native English speakers , 2006 .

[22]  James R. Lewis,et al.  A Slovene Translation of the System Usability Scale: The SUS-SI , 2015, Int. J. Hum. Comput. Interact..

[23]  Jie Zhou,et al.  Integration of user centered design in the development of health monitoring system for elderly , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  James R. Lewis,et al.  Psychometric Evaluation of the T-CSUQ: The Turkish Version of the Computer System Usability Questionnaire , 2013, Int. J. Hum. Comput. Interact..

[25]  Tao Yang,et al.  DEEP: Design-Oriented Evaluation of Perceived Usability , 2012, Int. J. Hum. Comput. Interact..

[26]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[27]  R. Gurrea,et al.  The role played by perceived usability, satisfaction and consumer trust on website loyalty , 2006, Inf. Manag..

[28]  L. Herman.  Towards effective usability evaluation in Asia: cross-cultural differences , 1996, Proceedings Sixth Australian Conference on Computer-Human Interaction.

[29]  James R. Lewis,et al.  Investigating the Correspondence Between UMUX-LITE and SUS Scores , 2015, HCI.

[30]  Virpi Roto,et al.  User experience evaluation methods: current state and development needs , 2010, NordiCHI.

[31]  Katarzyna Jach,et al.  Pre-testing of Polish Translation of System Usability Scale (SUS) , 2016, ISAT.

[32]  Jean Scholtz,et al.  Usability Evaluation , 2001 .

[33]  Alberto Sampaio.  Quantifying the user experience: practical statistics for user research by Jeff Sauro and James R. Lewis , 2013, SOEN.

[34]  Fangyu Li,et al.  Usability evaluation of e-commerce on B2C websites in China , 2011 .

[35]  Jeff Sauro,et al.  The Factor Structure of the System Usability Scale , 2009, HCI.

[36]  Feng-Ru SHEUa,et al.  Pre-Testing the Chinese Version of the System Usability Scale (C-SUS) , 2022 .

[37]  Christos Katsanos,et al.  Perceived usability evaluation of learning management systems: Empirical evaluation of the System Usability Scale , 2015 .

[38]  M. Sommer,et al.  Reducing the effect size of the retest effect: Examining different approaches , 2017 .

[39]  Victor Costa,et al.  European Portuguese validation of the Post-Study System Usability Questionnaire (PSSUQ) , 2015, 2015 10th Iberian Conference on Information Systems and Technologies (CISTI).

[40]  Y. Poortinga,et al.  Towards an integrated analysis of bias in cross-cultural assessment , 1997 .

[41]  James R. Lewis,et al.  Measuring Perceived Usability: The CSUQ, SUS, and UMUX , 2018, Int. J. Hum. Comput. Interact..

[42]  Stefano Federici,et al.  Short Scales of Satisfaction Assessment: A Proxy to Involve Disabled Users in the Usability Testing of Websites , 2015, HCI.

[43]  Victor Y. Chen,et al.  Effects of interface layout on the usability of In-Vehicle Information Systems and driving safety , 2017, Displays.

[44]  SampaioAlberto.  Quantifying the user experience , 2013 .

[45]  James R. Lewis,et al.  The System Usability Scale: Past, Present, and Future , 2018, Int. J. Hum. Comput. Interact..

[46]  Joseph S. Dumas,et al.  Understanding the Usability Construct: User-Perceived Usbility , 2004 .

[47]  Jeff Sauro,et al.  When designing usability questionnaires, does it hurt to be positive? , 2011, CHI.

[48]  Netta Iivari,et al.  UX Professionals' Definitions of Usability and UX - A Comparison Between Turkey, Finland, Denmark, France and Malaysia , 2017, INTERACT.

[49]  Thomas S. Tullis,et al.  A Comparison of Questionnaires for Assessing Website Usability , 2004 .

[50]  Angela M. Cirucci,et al.  Usability Testing , 2021, UX Research Methods for Media and Communication Studies.

[51]  Anthony F. Norcio,et al.  Cultural differences on attention and perceived usability: Investigating color combinations of animated graphics , 2006, Int. J. Hum. Comput. Stud..

[52]  Káthia Marçal de Oliveira,et al.  Standardized Usability Questionnaires: Features and Quality Focus , 2016 .

[53]  Cross-Cultural Adaptation, Reliability and Validity of the Chinese Version of the Fear Avoidance Beliefs Questionnaire , 2010, The Journal of international medical research.

[54]  S. Rothmann,et al.  Assessment in multicultural groups : The South African case , 2004 .

[55]  ParkJaehyun,et al.  Developing Elements of User Experience for Mobile Phones and Services , 2013 .

[56]  Debora Shaw,et al.  Handbook of usability testing: How to plan, design, and conduct effective tests , 1996 .

[57]  Zahra Ghanbari,et al.  Psychometric properties of the persian language version of the system usability scale. , 2014, Health promotion perspectives.

[58]  Philip T. Kortum,et al.  Measuring the Usability of Mobile Applications for Phones and Tablets , 2015, Int. J. Hum. Comput. Interact..

[59]  Simone Aparecida Capellini,et al.  Translation and cross-cultural adaptation of the Detailed Assessment of Speed of Handwriting 17+ to Brazilian Portuguese: conceptual, item and semantic equivalence. , 2018, CoDAS.

[60]  Hui Li,et al.  User Experience with Chinese Handwriting Input on Touch-Screen Mobile Phones , 2013, HCI.

[61]  Myriam Skrutkowski,et al.  Translating Instruments Into Other Languages: Development and Testing Processes , 2002, Cancer nursing.

[62]  Jun Zhang,et al.  Usability in China , 2011, Global Usability.

[63]  Kwok Leung,et al.  Methods and data analysis of comparative research , 1997 .

[64]  Stefano Federici,et al.  Assessing User Satisfaction in the Era of User Experience: Comparison of the SUS, UMUX, and UMUX-LITE as a Function of Product Experience , 2015, Int. J. Hum. Comput. Interact..

[65]  Norbert K Tanzer,et al.  Bias and equivalence , 2000 .

[66]  Harry Budi Santoso,et al.  An Indonesian adaptation of the System Usability Scale (SUS) , 2016, 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS).