Including the Voice of Care Recipients in Community Health Feedback Loops in Rural Kenya

Community health programs in low-resource settings (like rural Kenya) aim to provide essential health services to vulnerable populations. However, to date, there has been limited research that explores the design of mechanisms that enable care recipients to provide feedback regarding their satisfaction with the services they receive. Such feedback has the potential to increase the motivation of community health workers (CHWs), enhance training procedures, detect fraudulent behavior, and inform key performance indicators for health programs. Our paper explores the design and deployment of a USSD-based system that allows anyone who possesses a basic mobile phone to provide feedback regarding the health services and quality of care they received from a CHW or during a hospital visit. Our system was designed through iterative fieldwork in rural Kenya that engaged with multiple stakeholder groups, including care recipients, CHWs, and high-level decision makers. After designing and testing the system, we deployed it for seven weeks in Siaya, Kenya, collecting both quantitative system usage data and qualitative data from six focus groups with 42 participants. Findings from our deployment show that 168 care recipients engaged with the system, submitting 495 reports via USSD. We discuss the broader factors impacting deployment, including the feasibility of USSD, actionability of feedback, scalability, and sustainability. Taken together, our findings suggest that USSD is a promising approach for enabling care recipients to submit feedback in a way that balances privacy, equity, and sustainability.

[1]  Donna Spiegelman,et al.  The prevalence of disrespect and abuse during facility-based childbirth in urban Tanzania , 2016, BMC Pregnancy and Childbirth.

[2]  Richard J. Anderson,et al.  USSD: The Third Universal App , 2015, ACM DEV.

[3]  Stephan Huber,et al.  Implementing Systematically Collected User Feedback to Increase User Retention in a Mobile App for Self-Management of Low Back Pain: Retrospective Cohort Study , 2018, JMIR mHealth and uHealth.

[4]  Shrirang Mare,et al.  ThinSIM-based Attacks on Mobile Money Systems , 2018, COMPASS.

[5]  Isaac Holeman,et al.  Human-centered design for global health equity , 2019, Inf. Technol. Dev..

[6]  Nicola Dell,et al.  Engaging Pregnant Women in Kenya with a Hybrid Computer-Human SMS Communication System , 2015, CHI.

[7]  Subhajyoti Ray.  Reinforcing accountability in public services: an ICT enabled framework , 2012 .

[8]  David Nemer,et al.  Airbnb and the Costs of Emotional Labor in Havana, Cuba , 2018, CSCW Companion.

[9]  Nicola Dell,et al.  Opportunities and challenges in connecting care recipients to the community health feedback loop , 2019, ICTD.

[10]  Pamela Jordan.  Basics of qualitative research: Grounded theory procedures and techniques , 1994 .

[11]  Andrea Forte,et al.  "Facebook is a luxury": an exploratory study of social media use in rural Kenya , 2013, CSCW.

[12]  Gaetano Borriello,et al.  Paper-Digital Workflows in Global Development Organizations , 2015, CSCW.

[13]  Rebecca Koladycz,et al.  The Net Promoter Score (NPS) for Insight Into Client Experiences in Sexual and Reproductive Health Clinics , 2018, Global Health: Science and Practice.

[14]  Meredith Ringel Morris,et al.  EduFeed: A Social Feed to Engage Preliterate Children in Educational Activities , 2017, CSCW.

[15]  Edward Cutrell,et al.  Instituting credibility, accountability and transparency in local service delivery?: helpline and Aasthi in Karnataka, India , 2013, ICTD.

[16]  Melissa Densmore,et al.  Apps and Skits: Enabling New Forms of Village-To-Clinic Feedback for Rural Health Education , 2016, ACM DEV.

[17]  M. Melnik,et al.  Does a Seller's Ecommerce Reputation Matter? Evidence from Ebay Auctions , 2003 .

[18]  Mehrab Bin Morshed,et al.  When the Internet Goes Down in Bangladesh , 2017, CSCW.

[19]  Richard J. Anderson,et al.  eKichabi: Information Access through Basic Mobile Phones in Rural Tanzania , 2018, CHI.

[20]  Gaetano Borriello,et al.  Sangeet Swara: A Community-Moderated Voice Forum in Rural India , 2015, CHI.

[21]  M. Galesic,et al.  Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey , 2009 .

[22]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[23]  Xiao Ma,et al.  Anonymity, Intimacy and Self-Disclosure in Social Media , 2016, CHI.

[24]  Aaditeshwar Seth,et al.  Building citizen engagement into the implementation of welfare schemes in rural India , 2015, ICTD '15.

[25]  C. Howie,et al.  Assessing treatment outcomes using a single question: the net promoter score. , 2014, The bone & joint journal.

[26]  Sophie Yahui Hsieh,et al.  Healthcare complaints handling systems: a comparison between Britain, Australia and Taiwan , 2011, Health services management research.

[27]  S. Lonie,et al.  M-PESA: Mobile Money for the Unbanked Turning Cellphones into 24-Hour Tellers in Kenya , 2007, Innovations: Technology, Governance, Globalization.

[28]  Richard J. Anderson,et al.  User errors in SMS based reporting systems , 2015, ICTD '15.

[29]  P. Baker,et al.  What does patient feedback reveal about the NHS? A mixed methods study of comments posted to the NHS Choices online service , 2017, BMJ Open.

[30]  Yogan Pillay,et al.  The MomConnect mHealth initiative in South Africa: Early impact on the supply side of MCH services , 2016, Journal of public health policy.

[31]  Rob Comber,et al.  What Happens to Digital Feedback?: Studying the Use of a Feedback Capture Platform by Care Organisations , 2017, CHI.

[32]  Jerome Lewis,et al.  Supporting Collaboration with Non-Literate Forest Communities in the Congo-Basin , 2017, CSCW.

[33]  Gaetano Borriello,et al.  Closing the Feedback Loop: A 12-month Evaluation of ASTA, a Self-Tracking Application for ASHAs , 2016, ICTD.

[34]  Claudia Pagliari,et al.  Digital technology for health sector governance in low and middle income countries: a scoping review , 2016, Journal of global health.

[35]  Emma Brunskill,et al.  Evaluating the accuracy of data collection on mobile phones: A study of forms, SMS, and voice , 2009, 2009 International Conference on Information and Communication Technologies and Development (ICTD).

[36]  Gaetano Borriello,et al.  Improving community health worker performance through automated SMS , 2012, ICTD.

[37]  Nicola Dell,et al.  Supporting Community Health Workers in India through Voice- and Web-Based Feedback , 2017, CHI.

[38]  Bassey Ebenso,et al.  Protocol for a mixed-methods realist evaluation of a health service user feedback system in Bangladesh , 2017, BMJ Open.

[39]  Gábor Wiener,et al.  The ultimate question , 1982, Nature.

[40]  Donghun Lee,et al.  An Analysis of Social Features Associated with Room Sales of Airbnb , 2015, CSCW Companion.

[41]  William Thies,et al.  IVR Junction: Building Scalable and Distributed Voice Forums in the Developing World , 2012, NSDR.

[42]  Gaetano Borriello,et al.  Open data kit 2.0: expanding and refining information services for developing regions , 2013, HotMobile '13.

[43]  Patrick Olivier,et al.  Leaving the wild: lessons from community technology handovers , 2013, CHI.

[44]  K. G. Rajalekshmi.  E-governance services through telecenters: The role of human intermediary and issues of trust , 2007 .

[45]  Isaac Holeman,et al.  Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial , 2018, Journal of global health.

[46]  Frederick F. Reichheld,et al.  The Ultimate Question 2.0 : How Net Promoter Companies Thrive in a Customer-Driven World , 2011 .

[47]  Pushpendra Singh,et al.  Airavat: an automated system to increase transparency and accountability in social welfare schemes in India , 2013, ICTD '13.

[48]  Barry A. T. Brown,et al.  Designing for Labour: Uber and the On-Demand Mobile Workforce , 2016, CHI.

[49]  Michael S. Bernstein,et al.  4chan and /b/: An Analysis of Anonymity and Ephemerality in a Large Online Community , 2011, ICWSM.

[50]  Edward Cutrell,et al.  "Yours is better!": participant response bias in HCI , 2012, CHI.