User Interface Design for Low-literate and Novice Users: Past, Present and Future

One of the greatest challenges in providing information and communication technology access is that about 775 million people in the world are completely non-literate and many are able to read only with great difficulty and effort. Even though mobile phone penetration is growing very fast, people with low levels of literacy have been found to avoid complex functions, and primarily use mobile phones for voice communication only. This monograph looks at how we can design ICT user interfaces UIs such that novice and low-literate users can access a broad range of services and utilities, increasingly available to them, with minimal training and external assistance. It begins by observing the challenges in designing for low-literate users, and in conducting user studies among low-income communities in the developing world. It discusses techniques used by researchers in overcoming some of these challenges. It presents a review of existing examples of UIs for novice and low-literate users, which have used various combinations of input-output modalities other than text. It goes on to discuss strong trends that are starting to emerge in this design space and concludes with opportunities and future directions for research and design of UIs targeted at populations with low-literacy.

[1]  Ronald Rosenfeld,et al.  Small-vocabulary speech recognition for resource-scarce languages , 2010, ACM DEV '10.

[2]  Jacki O'Neill,et al.  KrishiPustak: A Social Networking System for Low-Literate Farmers , 2015, CSCW.

[3]  M. Bernhart,et al.  Patient satisfaction in developing countries. , 1999, Social science & medicine.

[4]  Edward Cutrell,et al.  Anthropology, development and ICTs: slums, youth and the mobile internet in urban India , 2012, ICTD.

[5]  Kentaro Toyama,et al.  Full-context videos for first-time, non-literate PC users , 2007, 2007 International Conference on Information and Communication Technologies and Development.

[6]  Richard Heeks,et al.  Telecentres in mountain regions — A Peruvian case study of the impact of information and communication technologies on remoteness and exclusion , 2009 .

[7]  Carolyn Penstein Rosé,et al.  Orality-Grounded HCID: Understanding the Oral User , 2009 .

[8]  Alex Pentland,et al.  DakNet: rethinking connectivity in developing nations , 2004, Computer.

[9]  Agha Ali Raza,et al.  Job opportunities through entertainment: virally spread speech-based services for low-literate users , 2013, CHI.

[10]  M. Cole,et al.  Cognitive Development: Its Cultural and Social Foundations , 1976 .

[11]  M Ingvar,et al.  The illiterate brain. Learning to read and write during childhood influences the functional organization of the adult brain. , 1998, Brain : a journal of neurology.

[12]  James Davis,et al.  Evaluating and improving the usability of Mechanical Turk for low-income workers in India , 2010, ACM DEV '10.

[13]  Joyojeet Pal,et al.  The case for multi-user design for computer aided learning in developing regions , 2006, WWW '06.

[14]  Tapan S. Parikh,et al.  Understanding and designing for intermediated information tasks in India , 2006, IEEE Pervasive Computing.

[15]  Alexander I. Rudnicky,et al.  Speech interfaces for information access by low literate users , 2009 .

[16]  Nithya Sambasivan,et al.  The human infrastructure of ICTD , 2010, ICTD.

[17]  Nitendra Rajput,et al.  A comparative study of speech and dialed input voice interfaces in rural India , 2009, CHI.

[18]  S. Twinn An exploratory study examining the influence of translation on the validity and reliability of qualitative data in nursing research. , 1997, Journal of advanced nursing.

[19]  Rajesh Veeraraghavan,et al.  Digital Green: Participatory video for agricultural extension , 2007, 2007 International Conference on Information and Communication Technologies and Development.

[20]  Ronald Rosenfeld,et al.  Discriminative pronunciation learning for speech recognition for resource scarce languages , 2012, ACM DEV '12.

[21]  Jeffrey Huang,et al.  Getting in touch with text: designing a mobile phone application for illiterate users to harness SMS , 2012, ACM DEV '12.

[22]  Kentaro Toyama,et al.  Text-Free User Interfaces for Illiterate and Semi-Literate Users , 2006, 2006 International Conference on Information and Communication Technologies and Development.

[23]  M. Cole,et al.  The psychology of literacy , 1983 .

[24]  Kori Inkpen Quinn,et al.  A mischief of mice: examining children's performance in single display groupware systems with 1 to 32 mice , 2009, CHI.

[25]  Kentaro Toyama,et al.  Some evidence for the impact of limited education on hierarchical user interface navigation , 2013, CHI.

[26]  Kentaro Toyama,et al.  Integrating Social Development and Financial Sustainability: The Challenges of Rural Computer Kiosks in Kerala , 2006, 2006 International Conference on Information and Communication Technologies and Development.

[27]  Heather Underwood,et al.  The design and implementation of the PartoPen maternal health monitoring system , 2013, ACM DEV '13.

[28]  Kentaro Toyama,et al.  Intermediated technology use in developing communities , 2010, CHI.

[29]  Kentaro Toyama,et al.  It's not just illiteracy , 2010 .

[30]  Edward Cutrell,et al.  How bad is good enough?: exploring mobile video quality trade-offs for bandwidth-constrained consumers , 2012, NordiCHI.

[31]  Stephen J. Ceci,et al.  How Much Does Schooling Influence General Intelligence and Its Cognitive Components? A Reassessment of the Evidence. , 1991 .

[32]  Monica Rosselli,et al.  Neuropsychological assessment in illiterates: Visuospatial and memory abilities , 1989, Brain and Cognition.

[33]  William Thies,et al.  Emergent practices around CGNet Swara, voice forum for citizen journalism in rural India , 2012, ICTD.

[34]  Apala Lahiri Chavan,et al.  Design studies for a financial management system for micro-credit groups in rural india , 2002 .

[35]  Kentaro Toyama,et al.  Exploring the feasibility of video mail for illiterate users , 2008, AVI '08.

[36]  A. Castro-Caldas,et al.  Illiteracy: A cause for biased cognitive development , 1997, Journal of the International Neuropsychological Society.

[37]  Roger K. Moore A comparison of the data requirements of automatic speech recognition systems and human listeners , 2003, INTERSPEECH.

[38]  A. Bandura Self-efficacy: toward a unifying theory of behavioral change. , 1977, Psychological review.

[39]  Frank Oberle,et al.  Who, Why and How Often? Key Elements for the Design of a Successful Speech Application Taking Account of the Target Groups , 2008 .

[40]  Avi Parush,et al.  Web navigation structures in cellular phones: the depth/breadth trade-off issue , 2004, Int. J. Hum. Comput. Stud..

[41]  A. Robles,et al.  Does literacy have an effect on stick construction tasks? , 2000, Journal of the International Neuropsychological Society.

[42]  Robert B. Allen Cognitive Factors in the Use of Menus and Trees: An Experiment , 1983, IEEE J. Sel. Areas Commun..

[43]  Kentaro Toyama,et al.  Where there's a will there's a way: mobile media sharing in urban india , 2010, CHI.

[44]  Rajendra T. Kumar,et al.  Sustainability failures of rural telecenters: Challenges from the sustainable access in rural india (sari) project , 2008 .

[45]  Aaditeshwar Seth,et al.  Gurgaon idol: a singing competition over community radio and IVRS , 2013, ACM DEV '13.

[46]  Kentaro Toyama,et al.  Managing microfinance with paper, pen and digital slate , 2010, ICTD 2010.

[47]  F. Niyi Akinnaso,et al.  The Consequences of Literacy in Pragmatic and Theoretical Perspectives , 1981 .

[48]  Edward Cutrell,et al.  Man versus machine: evaluating IVR versus a live operator for phone surveys in India , 2013, ACM DEV '13.

[49]  Gary Marsden,et al.  WATER alert!: using mobile phones to improve community perspective on drinking water quality in South Africa , 2012, ICTD.

[50]  Anita H. M. Cremers,et al.  Cognitive Abilities of Functionally Illiterate Persons Relevant to ICT Use , 2008, ICCHP.

[51]  M. Orne On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. , 1962 .

[52]  Dinesh Katre Unorganized Cognitive Structures of Illiterate as the Key Factor in Rural e-Learning Design , 2006 .

[53]  Ronald Rosenfeld,et al.  HealthLine: Speech-based access to health information by low-literate users , 2007, 2007 International Conference on Information and Communication Technologies and Development.

[54]  Ronald Rosenfeld,et al.  Speech vs. touch-tone: Telephony interfaces for information access by low literate users , 2009, 2009 International Conference on Information and Communication Technologies and Development (ICTD).

[55]  Yoram Eshet-Alkalai,et al.  Digital Literacy: A Conceptual Framework for Survival Skills in the Digital era , 2004 .

[56]  Indrani Medhi-Thies,et al.  A Hindi speech recognizer for an agricultural video search application , 2013, ACM DEV '13.

[57]  Matt Jones,et al.  Mobile Interaction Design , 2006 .

[58]  Joyojeet Pal,et al.  Speech Recognition for Illiterate Access to Information and Technology , 2006, 2006 International Conference on Information and Communication Technologies and Development.

[59]  Mary Czerwinski,et al.  Subjective Duration Assessment: An Implicit Probe for Software Usability , 2001 .

[60]  Anirudha Joshi,et al.  A Comparison of List vs. Hierarchical UIs on Mobile Phones for Non-literate Users , 2013, INTERACT.

[61]  Helen Abadzi,et al.  Improving Adult Literacy Outcomes: Lessons from Cognitive Research for Developing Countries. Directions in Development. , 2003 .

[62]  Bharathi Pitti,et al.  Text-Free UI for Employment Search , 2005 .

[63]  Marco Francesconi,et al.  The Effect of Parents' Employment on Children's Educational Attainment , 2000, SSRN Electronic Journal.

[64]  Emma Brunskill,et al.  Evaluating the accuracy of data collection on mobile phones: A study of forms, SMS, and voice , 2009, 2009 International Conference on Information and Communication Technologies and Development (ICTD).

[65]  Arun Kumar,et al.  The spoken web application framework: user generated content and service creation through low-end mobiles , 2010, W4A.

[66]  Bernhard Suhm,et al.  Ivr Usability Engineering Using Guidelines And Analyses Of End-to-End Calls , 2008 .

[67]  Sugata Mitra Minimally invasive education: a progress report on the "hole-in-the-wall" experiments , 2003, Br. J. Educ. Technol..

[68]  Edward Cutrell,et al.  "Yours is better!": participant response bias in HCI , 2012, CHI.

[69]  Kentaro Toyama,et al.  Designing mobile interfaces for novice and low-literacy users , 2011, TCHI.

[70]  Edward Cutrell,et al.  mClerk: enabling mobile crowdsourcing in developing regions , 2012, CHI.

[71]  Edward Cutrell,et al.  Combating rural child malnutrition through inexpensive mobile phones , 2012, NordiCHI.

[72]  Kentaro Toyama,et al.  Correlation Between Limited Education and Transfer of Learning , 2012 .

[73]  A. Squires Methodological challenges in cross-language qualitative research: a research review. , 2009, International journal of nursing studies.

[74]  Kristin Dew,et al.  Karaoke: an assistive alternative interface for illiterate users , 2013, CHI Extended Abstracts.

[75]  Edward Cutrell,et al.  Ubicomp4D: infrastructure and interaction for international development--the case of urban indian slums , 2009, UbiComp.

[76]  Nikhil Welankar,et al.  Rangoli: a visual phonebook for low-literate users , 2008, Mobile HCI.

[77]  Jonathan Donner,et al.  The Rules of Beeping: Exchanging Messages Via Intentional "Missed Calls" on Mobile Phones , 2007, J. Comput. Mediat. Commun..

[78]  John F. Canny,et al.  Mobile-izing health workers in rural India , 2010, CHI.

[79]  Edward Cutrell,et al.  VideoKheti: making video content accessible to low-literate and novice users , 2013, CHI.

[80]  Etienne Barnard,et al.  HIV health information access using spoken dialogue systems: Touchtone vs. speech , 2009, 2009 International Conference on Information and Communication Technologies and Development (ICTD).

[81]  Gary S. Becker,et al.  Human Capital Revisited , 1994 .

[82]  Wendy E. Mackay,et al.  Triangulation within and across HCI disciplines , 1999 .

[83]  Kentaro Toyama,et al.  A comparison of mobile money-transfer UIs for non-literate and semi-literate users , 2009, CHI.

[84]  Richard Banks,et al.  You're capped: understanding the effects of bandwidth caps on broadband use in the home , 2012, CHI.

[85]  Un-Habitat The Challenge of Slums: Global Report on Human Settlements 2003 , 2004 .

[86]  Bill Tomlinson,et al.  Who are the crowdworkers?: shifting demographics in mechanical turk , 2010, CHI Extended Abstracts.

[87]  Thomas N. Smyth,et al.  Notes from the Field Stories from the Field : Reflections on HCI 4 D Experiences , 2009 .

[88]  Sally Grisedale,et al.  Designing a graphical user interface for healthcare workers in rural India , 1997, CHI.

[89]  Rakshit Agrawal,et al.  Exploring suitable interfaces for agriculture based smartphone apps in India , 2013, APCHI.

[90]  Yaakov Stern,et al.  Literacy and Memory Decline Among Ethnically Diverse Elders , 2003, Journal of clinical and experimental neuropsychology.

[91]  Gary Marsden,et al.  Exploring Mobile-only Internet Use: Results of a Training Study in Urban South Africa , 2011 .

[92]  P. Bertelson,et al.  Does awareness of speech as a sequence of phones arise spontaneously? , 1979, Cognition.

[93]  John Etherton,et al.  MOSES: exploring new ground in media and post-conflict reconciliation , 2010, CHI.

[94]  N. Charness,et al.  Factors Predicting the Use of Technology: Findings From the Center for Research and Education on Aging and Technology Enhancement (CREATE) , 2006 .

[95]  Shourov Bhattacharya,et al.  Igwana: a text-free search interface , 2012, OZCHI.

[96]  Beenish Chaudry,et al.  Mobile interface design for low-literacy populations , 2012, IHI '12.

[97]  Keyur Sorathia,et al.  Parichaya - a low-cost device to increase adherence among Tuberculosis patients in rural Assam , 2013, APCHI.

[98]  Thomas S. Tullis,et al.  Designing a menu-based interface to an operating system , 1985, CHI '85.

[99]  Susan Wiedenbeck,et al.  The use of icons and labels in an end user application program: An empirical study of learning and retention , 1999, Behav. Inf. Technol..

[100]  Karl Magnus Petersson,et al.  Formal Schooling Influences Two- but Not Three-Dimensional Naming Skills , 2001, Brain and Cognition.

[101]  Tapan S. Parikh,et al.  Avaaj Otalo: a field study of an interactive voice forum for small farmers in rural India , 2010, CHI.