A Review of Empirical Intercultural Usability Studies

In this paper, we discuss the applicability of usability engineering methods to software engineering projects in intercultural contexts. We have conducted a review of 55 empirical studies from the field of intercultural usability engineering. Categories from ISO TR 16982 were used as a classification framework.

[1]  L. Herman.  Towards effective usability evaluation in Asia: cross-cultural differences , 1996, Proceedings Sixth Australian Conference on Computer-Human Interaction.

[2]  Man-Ying Wang,et al.  Banner Evaluation Predicted by Eye Tracking Performance and the Median Thinking Style , 2013, HCI.

[3]  Torkil Clemmensen,et al.  Cross cultural usability testing , 2006 .

[4]  John T. Kelso,et al.  Remote evaluation: the network as an extension of the usability laboratory , 1996, CHI.

[5]  Helene Gelderblom,et al.  The effects of culture on performance achieved through the use of human computer interaction , 2003 .

[6]  Jainaba Jagne,et al.  Cross-cultural interface design strategy , 2006, Universal Access in the Information Society.

[7]  Oscar Tomico,et al.  The Repertory Grid Technique as a Method for the Study of Cultural Differences , 2009 .

[8]  Christian Sturm,et al.  Localization beyond National Characteristics: The Impact of Language on Users' Performance with Different Menu Structures , 2013, HCI.

[9]  Ryo Sakurai,et al.  Out of Scandinavia to Asia: adaptability of participatory design in culturally distant society , 2012, PDC '12.

[10]  Sven Krause,et al.  Managing international usability projects: cooperative strategy , 2006, CHI EA '06.

[11]  Cecile Paris,et al.  Proceedings of the 23rd Australian Computer-Human Interaction Conference , 2011 .

[12]  T. Smith-Jackson,et al.  Usability Testing with Cultural Groups in Developing a Cell Phone Navigation System , 2005 .

[13]  Torkil Clemmensen,et al.  Cross cultural usability testing: The relationship between evaluator and test user , 2005 .

[14]  Kazuhiko Yamazaki,et al.  Observation Analysis Method for Culture Centered Design - Proposal of KH Method - , 2013, HCI.

[15]  Sari Kujala,et al.  Collecting cross-cultural user data with internationalized storyboard survey , 2011, OZCHI.

[16]  Lene Nielsen,et al.  Personas - User Focused Design , 2012, Human–Computer Interaction Series.

[17]  Andy Smith,et al.  Evaluation methods and cultural differences: studies across three continents , 2008, NordiCHI.

[18]  Qingxin Shi,et al.  A field study of the relationship and communication between Chinese evaluators and users in thinking aloud usability tests , 2008, NordiCHI.

[19]  Ying Liu,et al.  Designing for emerging rural users: experiences from China , 2011, CHI.

[20]  Xia Wang,et al.  How socio-economic structure influences rural users' acceptance of mobile entertainment , 2010, CHI.

[21]  Vanessa Evers.  Cross-cultural applicability of user evaluation methods: a case study amongst Japanese, North-American, English and Dutch users , 2002, CHI Extended Abstracts.

[22]  Qifeng Yan,et al.  A Remote Study on East-West Cultural Differences in Mobile User Experience , 2007, HCI.

[23]  Bryan S. Schaffer,et al.  A Review of Cross-Cultural Methodologies for Organizational Research: A Best- Practices Approach , 2003 .

[24]  J. Harkness.  Survey Methods in Multinational, Multiregional, and Multicultural Contexts , 2010 .

[25]  Daniel D. Suthers,et al.  Intra-and Inter-Cultural Usability in Computer-Supported Collaboration , 2010 .

[26]  Kerstin Röse.  Usability-Engineering in the Context of Product Development: Results of an Experts Focus Group , 2008 .

[27]  Sharon L. Oviatt,et al.  Designing speech and language interactions , 2014, CHI Extended Abstracts.

[28]  Manlai You,et al.  A Usability Testing of Chinese Character Writing System for Foreign Learners , 2013, HCI.

[29]  Robert H. Barbour,et al.  Usability testing: a Malaysian study , 1997 .

[30]  Thomas Pederson,et al.  Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design , 2012, NordiCHI 2012.

[31]  Mary Jane Northrop,et al.  Proceedings of the 19th annual international conference on Computer documentation , 2001 .

[32]  Kun-Pyo Lee,et al.  Cultural differences and design methods for user experience research: Dutch and Korean participants compared , 2007, DPPI.

[33]  Dinesh Katre.  Position Paper on "Cross-cultural Usability Issues of Bilingual (Hindi & English) Mobile Phones" , 2006 .

[34]  Ebba Þóra Hvannberg,et al.  Analysis of combinatorial user effect in international usability tests , 2004, CHI '04.

[35]  Jürgen H. P. Hoffmeyer-Zlotnik,et al.  Methodological aspects in cross-national research , 2005 .

[36]  José L. Abdelnour-Nocera,et al.  A Cross-Cultural Evaluation of HCI Student Performance - Reflections for the Curriculum , 2013, HCI.

[37]  Torkil Clemmensen,et al.  Templates for Cross-Cultural and Culturally Specific Usability Testing: Results From Field Studies and Ethnographic Interviewing in Three Countries , 2011, Int. J. Hum. Comput. Interact..

[38]  M. Gordon Hunter,et al.  Using Repertory Grids to Conduct Cross-Cultural Information Systems Research , 2000, Inf. Syst. Res..

[39]  O. Behling,et al.  Translating Questionnaires and Other Research Instruments: Problems and Solutions , 2000 .

[40]  José Antonio Pow-Sang,et al.  A cultural-oriented usability heuristics proposal , 2013, ChileCHI '13.

[41]  Pia Honold,et al.  Culture and Context: An Empirical Study for the Development of a Framework for the Elicitation of Cultural Influence in Product Usage , 2000, Int. J. Hum. Comput. Interact..

[42]  Manuel A. Pérez-Quiñones,et al.  Culture and usability evaluation: the effects of culture in structured interviews , 2006 .

[43]  Yee-Yin Choong,et al.  Cross-Cultural Design for IT Products and Services , 2012 .

[44]  Huatong Sun,et al.  Building a culturally-competent corporate web site: an exploratory study of cultural markers in multilingual web design , 2001, SIGDOC '01.

[45]  Stephen A. R. Scrivener,et al.  Meaning, The Central Issue in Cross-Cultural HCI Design , 1998, Interact. Comput..

[46]  K. Olson,et al.  Face-to-Face versus Online Focus Groups in Two Different Countries: Do Qualitative Data Collection Strategies Work the Same Way in Different Cultural Contexts? , 2008 .

[47]  Janet Davis,et al.  A comparison of synchronous remote and local usability studies for an expert interface , 2004, CHI EA '04.

[48]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[49]  Nicola J. Bidwell,et al.  Designing with mobile digital storytelling in rural Africa , 2010, CHI.

[50]  Shailey Minocha,et al.  Reprint of a process model for developing usable cross-cultural websites , 2012, Interact. Comput..

[51]  Elaine Ménard,et al.  Two Solitudes Revisited: A Cross-Cultural Exploration of Online Image Searcher's Behaviors , 2013, HCI.

[52]  Andrea J. van Doorn,et al.  Usability Problem Reports for Comparative Studies: Consistency and Inspectability , 2008, Hum. Comput. Interact..

[53]  Manuel A. Pérez-Quiñones,et al.  Culture and International Usability Testing: The Effects of Culture in Structured Interviews , 2004, ArXiv.

[54]  Jakob Biesterfeldt,et al.  Leading International UX Research Projects , 2011, HCI.

[55]  Gavriel Salvendy,et al.  A cross-culture study on older adults' information technology acceptance , 2011, Int. J. Mob. Commun..

[56]  Peter C. Wright,et al.  Evocative of experience: crafting cross-cultural digital narratives through stories and portraits , 2012, NordiCHI.

[57]  Noam Tractinsky,et al.  Aesthetics and apparent usability: empirically assessing cultural and methodological issues , 1997, CHI.

[58]  Elaine Byrne,et al.  Contextuality of participation in IS design: a developing country perspective , 2004, PDC 04.

[59]  Henri Christiaans,et al.  GLOBALIZATION AND CROSS CULTURAL PRODUCT DESIGN , 2006 .

[60]  Qingxin Shi,et al.  Language Issues in Cross Cultural Usability Testing: A Pilot Study in China , 2007, HCI.

[61]  P. Yammiyavar,et al.  Influence of Cultural Background on Non-verbal Communication in a Usability Testing Situation , 2008 .

[62]  Pei-Luen Patrick Rau,et al.  Internationalization and localization: evaluating and testing a Website for Asian users , 2003, Ergonomics.