Adapting usability testing for oral, rural users

Traditional usability methods are of limited use when evaluating systems designed for distant, diverse populations. In this paper, we describe a study conducted in two Ghanaian villages that evaluated an audio computer designed for people living in oral cultures. Informed by ICTD and orality-grounded HCID, we modified existing usability testing practices and we reflect on the utility of these adaptations. We found that conducting a culturally appropriate study often meant forgoing more traditional approaches in favor of flexible, opportunistic methods. We acknowledge the challenges of adapting traditional usability methods for oral, rural users. However, we found that by implementing strategic modifications led by local staff, our study produced valuable, actionable results.

[1]  Carolyn Penstein Rosé,et al.  Orality-Grounded HCID: Understanding the Oral User , 2009 .

[2]  Jan H. Spyridakis,et al.  Internet Use in Uzbekistan: Developing a Methodology for Tracking Information Technology Implementation Success , 2003 .

[3]  Kentaro Toyama,et al.  Text-Free User Interfaces for Illiterate and Semi-Literate Users , 2006, 2006 International Conference on Information and Communication Technologies and Development.

[4]  Erica Johnson,et al.  Adapting User-Centered Design Methods to Design for Diverse Populations , 2009 .

[5]  Kentaro Toyama,et al.  A comparison of mobile money-transfer UIs for non-literate and semi-literate users , 2009, CHI.

[6]  Joseph F. Dumas,et al.  A Practical Guide to Usability Testing , 1993 .

[7]  Heike Winschiers-Theophilus,et al.  Assumptions Considered Harmful , 2007, HCI.

[8]  Kentaro Toyama,et al.  Intermediated technology use in developing communities , 2010, CHI.

[9]  Kentaro Toyama,et al.  Text-Free User Interfaces for Illiterate and Semi-Literate Users , 2006, 2006 International Conference on Information and Communication Technologies and Development.

[10]  Cynthia Putnam,et al.  Mobile phone users in Kyrgyzstan: A case study of identifying user requirements for diverse users , 2009, 2009 IEEE International Professional Communication Conference.

[11]  Kentaro Toyama,et al.  Optimal audio-visual representations for illiterate users of computers , 2007, WWW '07.

[12]  Carol M. Barnum,et al.  Usability testing and research , 2001 .

[13]  Trina Gorman,et al.  Impact of Low-Cost, On-demand, Information Access in a Remote Ghanaian Village , 2010, 2011 IEEE Global Humanitarian Technology Conference.