Culture and usability evaluation: the effects of culture in structured interviews

A major impediment in global user interface development is that there is inadequate empirical evidence for the effects of culture in the usability engineering methods used for developing these global user interfaces. This paper presents a controlled study investigating the effects of culture on the effectiveness of structured interviews in international usability evaluation. The experiment consisted of a usability evaluation of a website with two independent groups of Indian participants. Each group had a different interviewer; one belonging to the Indian culture and the other to the Anglo-American culture. The results show that participants found more usability problems and made more suggestions to an interviewer who was a member of the same (Indian) culture than to the foreign (Anglo-American) interviewer. The results of the study empirically establish that culture significantly affects the efficacy of structured interviews during international user testing. The implications of this work for usability engineering are discussed.

[1]  A. Kroeber,et al.  Culture, a critical review of concepts and definitions , 1953 .

[2]  Yoshihisa Kashima,et al.  Acculturation Indices as a Means of Confirming Cultural Differences. Navy Recruit's Expectations of Productivity, Liking, and Intentions to Quit under Different Supervisors. , 1983 .

[3]  M. Bond,et al.  Hofstede's Culture Dimensions , 1984 .

[4]  M. Bond,et al.  The Confucius connection: From cultural roots to economic growth , 1988 .

[5]  D. Randall,et al.  Exploring subcultural differences in hofstede's value survey: The case of the Chinese , 1991 .

[6]  Gillian Khoo,et al.  The Suinn-Lew Asian Self-Identity Acculturation Scale: Concurrent and Factorial Validation , 1992 .

[7]  Dave Taylor.  Global Software: Developing Applications for the International Market , 1992 .

[8]  Robert Howard,et al.  Introduction to Software Internationalization and Localization , 1993 .

[9]  Robert Howard,et al.  Software Internationalization and Localization: An Introduction , 1993 .

[10]  Mikael Søndergaard,et al.  Research Note: Hofstede's Consequences: A Study of Reviews, Citations and Replications , 1994 .

[11]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[12]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[13]  Tony Fernandes,et al.  Global interface design , 1994, CHI Conference Companion.

[14]  Jakob Nielsen,et al.  Usability inspection methods , 1994, CHI 95 Conference Companion.

[15]  David J. Taylor,et al.  Internationalization: Developing Software For Global Markets , 1995 .

[16]  John T. Kelso,et al.  Remote evaluation: the network as an extension of the usability laboratory , 1996, CHI.

[17]  Noam Tractinsky,et al.  Aesthetics and apparent usability: empirically assessing cultural and methodological issues , 1997, CHI.

[18]  P. Earley,et al.  The transplanted executive : why you need to understand how workers in other countries see the world differntly , 1997 .

[19]  Vanessa Evers,et al.  The Role of Culture in Interface Acceptance , 1997, INTERACT.

[20]  Alvin Yeo,et al.  Cultural effects in usability assessment , 1998, CHI Conference Summary.

[21]  V. Evers.  CROSS-CULTURAL UNDERSTANDING OF METAPHORS IN INTERFACE DESIGN , 1998 .

[22]  Agnes Kukulska-Hulme,et al.  Cross-cultural understanding of interface design: A cross-cultural analysis of icon recognition , 1999, IWIPS.

[23]  김종식.  동아시아 문화와 경영, Geert Hofstede, Culture's Consequences: International Differences in Work-Related Values (Beverly Hills, CA:Sage Publications, 1980) ; and Cultures and Organizations : Software of the Mind (New York:McGraw-Hill, 1997) , 1999 .

[24]  E. W. Gould,et al.  Crosscurrents: cultural dimensions and global Web user-interface design , 2000, INTR.

[25]  Andreas Beu,et al.  How to Build Up an Infrastructure for Intercultural Usability Engineering , 2000, Int. J. Hum. Comput. Interact..

[26]  Pia Honold,et al.  Culture and Context: An Empirical Study for the Development of a Framework for the Elicitation of Cultural Influence in Product Usage , 2000, Int. J. Hum. Comput. Interact..

[27]  Aaron Marcus,et al.  Cultural Dimensions and Global Web User-Interface Design , 2000 .

[28]  Alvin W. Yeo,et al.  Global-software development lifecycle: an exploratory study , 2001, CHI.

[29]  Morten Hertzum,et al.  The Evaluator Effect: A Chilling Fact About Usability Evaluation Methods , 2001, Int. J. Hum. Comput. Interact..

[30]  Shailey Minocha,et al.  A process model for developing usable cross-cultural websites , 2004, Interact. Comput..

[31]  Fahri Yetim,et al.  Global human-computer systems: cultural determinants of usability , 2004, Interact. Comput..

[32]  Aaron Marcus,et al.  Culture: wanted? Alive or dead? , 2006 .

[33]  Kian Guan Lim.  The Asia Pacific Journal of Management between 1992 and 1995 , 2007 .