Accuracy of measures for antiretroviral adherence in people living with HIV

Abstract Background Good patient adherence to antiretroviral (ART) medication determines effective HIV viral suppression, and thus reduces the risk of progression and transmission of HIV. With accurate methods to monitor treatment adherence, we could use simple triage to target adherence support interventions that could help in the community or at health centres in resource‐limited settings. Objectives To determine the accuracy of simple measures of ART adherence (including patient self‐report, tablet counts, pharmacy records, electronic monitoring, or composite methods) for detecting non‐suppressed viral load in people living with HIV and receiving ART treatment. Search methods The Cochrane Infectious Diseases Group Information Specialists searched CENTRAL, MEDLINE, Embase, LILACS, CINAHL, African‐Wide information, and Web of Science up to 22 April 2021. They also searched the World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP) and ClinicalTrials.gov for ongoing studies. No restrictions were placed on the language or date of publication when searching the electronic databases. Selection criteria We included studies of all designs that evaluated a simple measure of adherence (index test) such as self‐report, tablet counts, pharmacy records or secondary database analysis, or both, electronic monitoring or composite measures of any of those tests, in people living with HIV and receiving ART treatment. We used a viral load assay with a limit of detection ranging from 10 copies/mL to 400 copies/mL as the reference standard. We created 2 × 2 tables to calculate sensitivity and specificity. Data collection and analysis We screened studies, extracted data, and assessed risk of bias using QUADAS‐2 independently and in duplicate. We assessed the certainty of evidence using the GRADE method. The results of estimated sensitivity and specificity were presented using paired forest plots and tabulated summaries. We encountered a high level of variation among studies which precluded a meaningful meta‐analysis or comparison of adherence measures. We explored heterogeneity using pre‐defined subgroup analysis. Main results We included 51 studies involving children and adults with HIV, mostly living in low‐ and middle‐income settings, conducted between 2003 and 2021. Several studies assessed more than one index test, and the most common measure of adherence to ART was self‐report. ‐ Self‐report questionnaires (25 studies, 9211 participants; very low‐certainty): sensitivity ranged from 10% to 85% and specificity ranged from 10% to 99%. ‐ Self‐report using a visual analogue scale (VAS) (11 studies, 4235 participants; very low‐certainty): sensitivity ranged from 0% to 58% and specificity ranged from 55% to 100%. ‐ Tablet counts (12 studies, 3466 participants; very low‐certainty): sensitivity ranged from 0% to 100% and specificity ranged from 5% to 99%. ‐ Electronic monitoring devices (3 studies, 186 participants; very low‐certainty): sensitivity ranged from 60% to 88% and the specificity ranged from 27% to 67%. ‐ Pharmacy records or secondary databases (6 studies, 2254 participants; very low‐certainty): sensitivity ranged from 17% to 88% and the specificity ranged from 9% to 95%. ‐ Composite measures (9 studies, 1513 participants; very low‐certainty): sensitivity ranged from 10% to 100% and specificity ranged from 49% to 100%. Across all included studies, the ability of adherence measures to detect viral non‐suppression showed a large variation in both sensitivity and specificity that could not be explained by subgroup analysis. We assessed the overall certainty of the evidence as very low due to risk of bias, indirectness, inconsistency, and imprecision. The risk of bias and the applicability concerns for patient selection, index test, and reference standard domains were generally low or unclear due to unclear reporting. The main methodological issues identified were related to flow and timing due to high numbers of missing data. For all index tests, we assessed the certainty of the evidence as very low due to limitations in the design and conduct of the studies, applicability concerns and inconsistency of results. Authors' conclusions We encountered high variability for all index tests, and the overall certainty of evidence in all areas was very low. No measure consistently offered either a sufficiently high sensitivity or specificity to detect viral non‐suppression. These concerns limit their value in triaging patients for viral load monitoring or enhanced adherence support interventions.

[1]  E. Schouten,et al.  Early post-partum viremia predicts long-term non-suppression of viral load in HIV-positive women on ART in Malawi: Implications for the elimination of infant transmission , 2021, PLoS ONE.

[2]  J. Haberer,et al.  Approaches to Objectively Measure Antiretroviral Medication Adherence and Drive Adherence Interventions , 2020, Current HIV/AIDS Reports.

[3]  G. Guyatt,et al.  GRADE guidelines: 21 part 1. Study design, risk of bias and indirectness in rating the certainty across a body of evidence for test accuracy. , 2020, Journal of clinical epidemiology.

[4]  G. Guyatt,et al.  GRADE guidelines: 21 part 2. Inconsistency, Imprecision, publication bias and other domains for rating the certainty of evidence for test accuracy and presenting it in evidence profiles and summary of findings tables. , 2020, Journal of clinical epidemiology.

[5]  K. Naidoo,et al.  Long-term adherence to antiretroviral therapy in a South African adult patient cohort: a retrospective study , 2019, BMC Infectious Diseases.

[6]  L. Myer,et al.  A Comparison of Plasma Efavirenz and Tenofovir, Dried Blood Spot Tenofovir-Diphosphate, and Self-Reported Adherence to Predict Virologic Suppression Among South African Women. , 2019, Journal of acquired immune deficiency syndromes.

[7]  S. Mboup,et al.  Clinical predictor score to identify patients at risk of poor viral load suppression at six months on antiretroviral therapy: results from a prospective cohort study in Johannesburg, South Africa , 2019, Clinical epidemiology.

[8]  S. Oliver,et al.  Being HIV positive and staying on antiretroviral therapy in Africa: A qualitative systematic review and theoretical model , 2019, PloS one.

[9]  E. Moodie,et al.  Comparison of the predictive performance of adherence measures for virologic failure detection in people living with HIV: a systematic review and pairwise meta-analysis , 2018, AIDS care.

[10]  Yuli,et al.  Evaluation of Adherence, Virology and Imunology Response in HIV Patients Treated with a Once Daily Fixed Dose Combination (FDC) and a Free Combination of Antiretroviral , 2018, Advanced Science Letters.

[11]  N. Ford,et al.  Measures of antiretroviral adherence for detecting viral non-suppression in people living with HIV , 2018, Cochrane Database of Systematic Reviews.

[12]  E. Turner,et al.  Antiretroviral drug concentrations in hair are associated with virologic outcomes among young people living with HIV in Tanzania , 2018, AIDS.

[13]  L. Mabuza,et al.  The Prevalence of HIV Load Suppression and Related Factors Among Patients on ART at Phedisong 4 Clinic, Pretoria, South Africa , 2018 .

[14]  C. Hidalgo-Tenorio,et al.  High quality of life, treatment tolerability, safety and efficacy in HIV patients switching from triple therapy to lopinavir/ritonavir monotherapy: A randomized clinical trial , 2018, PloS one.

[15]  C. Charpentier,et al.  Positive Virological Outcomes of HIV-Infected Patients on Protease Inhibitor-Based Second-Line Regimen in Cambodia: The ANRS 12276 2PICAM Study , 2018, Front. Public Health.

[16]  J. Haberer,et al.  Adherence Measurements in HIV: New Advancements in Pharmacologic Methods and Real-Time Monitoring , 2018, Current HIV/AIDS Reports.

[17]  S. Billong,et al.  Immuno-virological response and associated factors amongst HIV-1 vertically infected adolescents in Yaoundé-Cameroon , 2017, PloS one.

[18]  R. Ferrand,et al.  Association Between Self-Reported Adherence and HIV Viral Load Suppression Among Older Children and Adolescents , 2017, Journal of acquired immune deficiency syndromes.

[19]  S. Letendre,et al.  At‐Risk Alcohol Use is Associated with Antiretroviral Treatment Nonadherence Among Adults Living with HIV/AIDS , 2017, Alcoholism, clinical and experimental research.

[20]  G. Maartens,et al.  Comparison of six methods to estimate adherence in an ART-naïve cohort in a resource-poor setting: which best predicts virological and resistance outcomes? , 2017, AIDS Research and Therapy.

[21]  N. Ford,et al.  Improving antiretroviral therapy adherence in resource‐limited settings at scale: a discussion of interventions and recommendations , 2017, Journal of the International AIDS Society.

[22]  R. Parker,et al.  Impact of Medication Adherence on Virologic Failure in A5202: A Randomized, Partially Blinded, Phase 3B Study , 2017, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[23]  T. Klimkait,et al.  Alcohol use and depression: link with adherence and viral suppression in adult patients on antiretroviral therapy in rural Lesotho, Southern Africa: a cross-sectional study , 2016, BMC Public Health.

[24]  M. Fox,et al.  Can Short-Term Use of Electronic Patient Adherence Monitoring Devices Improve Adherence in Patients Failing Second-Line Antiretroviral Therapy? Evidence from a Pilot Study in Johannesburg, South Africa , 2016, AIDS and Behavior.

[25]  G. Peterson,et al.  Adherence to Antiretroviral Therapy and Virologic Failure , 2016, Medicine.

[26]  Paula Fresco,et al.  Medication Adherence Measures: An Overview , 2015, BioMed research international.

[27]  W. Nilsen,et al.  Self-report measures of medication adherence behavior: recommendations on optimal use , 2015, Translational behavioral medicine.

[28]  W. Blattner,et al.  Adherence to Anti-Retroviral Therapy in North Central Nigeria. , 2015, Current HIV research.

[29]  W. Blattner,et al.  Socio-Demographic and Adherence Factors Associated with Viral Load Suppression in HIV-Infected Adults Initiating Therapy in Northern Nigeria: A Randomized Controlled Trial of a Peer Support Intervention. , 2015, Current HIV research.

[30]  R. Detels,et al.  Level of Adherence and HIV RNA Suppression in the Current Era of Highly Active Antiretroviral Therapy (HAART) , 2015, AIDS and Behavior.

[31]  D. Harris,et al.  Relationship between viral load and behavioral measures of adherence to antiretroviral therapy in children living with human immunodeficiency virus in Latin America , 2015, The Brazilian journal of infectious diseases : an official publication of the Brazilian Society of Infectious Diseases.

[32]  M. Mugavero,et al.  Self-Report Measures in the Assessment of Antiretroviral Medication Adherence , 2015, Journal of the International Association of Providers of AIDS Care.

[33]  J. H. van de Wijgert,et al.  Safety and Effectiveness of Combination Antiretroviral Therapy during the First Year of Treatment in HIV-1 Infected Rwandan Children: A Prospective Study , 2014, PloS one.

[34]  R. Camacho,et al.  Pharmacy refill adherence outperforms self-reported methods in predicting HIV therapy outcome in resource-limited settings , 2014, BMC Public Health.

[35]  J. Navarro,et al.  Impact of an adherence program to antiretroviral treatment on virologic response in a cohort of multitreated and poorly adherent HIV-infected patients in Spain. , 2014, AIDS patient care and STDs.

[36]  T. Kredo,et al.  Task shifting from doctors to non-doctors for initiation and maintenance of antiretroviral therapy. , 2014, The Cochrane database of systematic reviews.

[37]  A. L. Caze,et al.  What are validated self‐report adherence scales really measuring?: a systematic review , 2014, British journal of clinical pharmacology.

[38]  T. F. Rinke de Wit,et al.  HIV-1 virologic failure and acquired drug resistance among first-line antiretroviral experienced adults at a rural HIV clinic in coastal Kenya: a cross-sectional study , 2014, AIDS Research and Therapy.

[39]  P. Phanuphak,et al.  HIV multi-drug resistance at first-line antiretroviral failure and subsequent virological response in Asia , 2014, Journal of the International AIDS Society.

[40]  N. Ford,et al.  Viral Load Monitoring as a Tool to Reinforce Adherence: A Systematic Review , 2013, Journal of acquired immune deficiency syndromes.

[41]  J. van Lunzen,et al.  Prevalence and Determinants of Virological Failure in HIV-Infected Children on Antiretroviral Therapy in Rural Cameroon: A Cross-Sectional Study , 2013, Antiviral therapy.

[42]  W. Blattner,et al.  Immuno-virologic outcomes and immuno-virologic discordance among adults alive and on anti-retroviral therapy at 12 months in Nigeria , 2013, BMC Infectious Diseases.

[43]  S. Lewin,et al.  Pharmacy and Self-Report Adherence Measures to Predict Virological Outcomes for Patients on Free Antiretroviral Therapy in Tamil Nadu, India , 2013, AIDS and Behavior.

[44]  L. Lynen,et al.  A Clinical Prediction Score in Addition to WHO Criteria for Anti-Retroviral Treatment Failure in Resource-Limited Settings - Experience from Lesotho , 2012, PloS one.

[45]  M. Fowler,et al.  CD4, Viral Load Response, and Adherence Among Antiretroviral-Naive Breast-feeding Women Receiving Triple Antiretroviral Prophylaxis for Prevention of Mother-to-Child Transmission of HIV in Kisumu, Kenya , 2012, Journal of acquired immune deficiency syndromes.

[46]  B. Clotet,et al.  Efficacy and Safety of Rilpivirine (TMC278) Versus Efavirenz at 48 Weeks in Treatment-Naive HIV-1–Infected Patients: Pooled Results From the Phase 3 Double-Blind Randomized ECHO and THRIVE Trials , 2012, Journal of acquired immune deficiency syndromes.

[47]  Jeffrey K Aronson,et al.  A new taxonomy for describing and defining adherence to medications. , 2012, British journal of clinical pharmacology.

[48]  G. Rutherford,et al.  Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. , 2012, The Cochrane database of systematic reviews.

[49]  Susan Mallett,et al.  QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies , 2011, Annals of Internal Medicine.

[50]  D. Bangsberg,et al.  Excellent Adherence to Antiretrovirals in HIV+ Zambian Children Is Compromised by Disrupted Routine, HIV Nondisclosure, and Paradoxical Income Effects , 2011, PloS one.

[51]  Tania B. Huedo-Medina,et al.  Adherence to Highly Active Antiretroviral Therapy (HAART): A Meta-Analysis , 2011, AIDS and Behavior.

[52]  K. Freedberg,et al.  Association Between Medication Possession Ratio, Virologic Failure and Drug Resistance in HIV-1–Infected Adults on Antiretroviral Therapy in Côte d'Ivoire , 2011, Journal of acquired immune deficiency syndromes.

[53]  P. Harrigan,et al.  Risk of Viral Failure Declines With Duration of Suppression on Highly Active Antiretroviral Therapy Irrespective of Adherence Level , 2010, Journal of acquired immune deficiency syndromes.

[54]  I. Wilson,et al.  Importance of Dose Timing to Achieving Undetectable Viral Loads , 2010, AIDS and Behavior.

[55]  D. Katzenstein,et al.  Viremia and drug resistance among HIV-1 patients on antiretroviral treatment: a cross-sectional study in Soweto, South Africa , 2010, AIDS (London).

[56]  A. Apisarnthanarak,et al.  Long-term outcomes of HIV-infected patients with <95% rates of adherence to nonnucleoside reverse-transcriptase inhibitors. , 2010, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[57]  L. Chen,et al.  Suboptimal adherence to darunavir/ritonavir has minimal effect on efficacy compared with lopinavir/ritonavir in treatment-naive, HIV-infected patients: 96 week ARTEMIS data. , 2010, The Journal of antimicrobial chemotherapy.

[58]  Y. Yazdanpanah,et al.  Average adherence to boosted protease inhibitor therapy, rather than the pattern of missed doses, as a predictor of HIV RNA replication. , 2010, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[59]  Wayne T. Steward,et al.  Developing useful highly active antiretroviral therapy adherence measures for India: the Prerana study. , 2010, Journal of acquired immune deficiency syndromes.

[60]  Y. Madec,et al.  Simplified Assessment of Antiretroviral Adherence and Prediction of Virological Efficacy in HIV-Infected Patients in Cambodia , 2009, AIDS research and treatment.

[61]  N. Ford,et al.  Directly observed antiretroviral therapy: a systematic review and meta-analysis of randomised clinical trials , 2009, The Lancet.

[62]  Andrew D Oxman,et al.  SUPPORT Tools for evidence-informed health Policymaking (STP) 10: Taking equity into consideration when assessing the findings of a systematic review , 2009, Health research policy and systems.

[63]  E. Arts,et al.  Adherence and Treatment Response Among HIV-1-Infected Adults Receiving Antiretroviral Therapy in a Rural Government Hospital in Southwestern Uganda , 2009, Journal of the International Association of Physicians in AIDS Care.

[64]  R. Dewar,et al.  Development and evaluation of a clinical algorithm to monitor patients on antiretrovirals in resource-limited settings using adherence, clinical and CD4 cell count criteria , 2009, Journal of the International AIDS Society.

[65]  D. Podzamczer,et al.  Risk factors for loss of virological suppression in patients receiving lopinavir/ritonavir monotherapy for maintenance of HIV suppression , 2009, Antiviral therapy.

[66]  B. Eley,et al.  Adherence to antiretroviral therapy in young children in Cape Town, South Africa, measured by medication return and caregiver self-report: a prospective cohort study , 2008, BMC pediatrics.

[67]  A. Apisarnthanarak,et al.  Secure antiretroviral therapy delivery in a resource‐limited setting: streamlined to minimize drug resistance and expense , 2008, HIV medicine.

[68]  L. Ferradini,et al.  Adherence to antiretroviral therapy in patients enrolled in a comprehensive care program in Cambodia: A 24-month follow-up assessment , 2008, Antiviral therapy.

[69]  Gordon H Guyatt,et al.  GRADE: grading quality of evidence and strength of recommendations for diagnostic tests and strategies , 2008, BMJ : British Medical Journal.

[70]  R. Haynes,et al.  Interventions for enhancing medication adherence. , 2008, The Cochrane database of systematic reviews.

[71]  L. Hirschhorn,et al.  The CASE adherence index: A novel method for measuring adherence to antiretroviral therapy , 2006, AIDS care.

[72]  C Inch,et al.  Patient support and education for promoting adherence to highly active antiretroviral therapy for HIV/AIDS. , 2006, The Cochrane database of systematic reviews.

[73]  D. Häussinger,et al.  Predictors of short-term success of antiretroviral therapy in HIV infection. , 2006, The Journal of antimicrobial chemotherapy.

[74]  Ross T Tsuyuki,et al.  A meta-analysis of the association between adherence to drug therapy and mortality , 2006, BMJ : British Medical Journal.

[75]  R. Paredes,et al.  Long-term safety and efficacy of nevirapine-based approaches in HIV type 1-infected patients. , 2006, AIDS research and human retroviruses.

[76]  L. Osterberg,et al.  Adherence to medication. , 2005, The New England journal of medicine.

[77]  Vicente Martín,et al.  Factores predictores de carga viral detectable en pacientes en tratamiento antirretroviral de gran actividad , 2004 .

[78]  D. Jayaweera,et al.  The safety and efficacy of indinavir and ritonavir (400/400 mg BID) in HIV-1-infected individuals from an inner-city minority population: a pilot study , 2003, International journal of STD & AIDS.

[79]  D. Bangsberg,et al.  Adherence is not a barrier to successful antiretroviral therapy in South Africa , 2003, AIDS.

[80]  J. Farley,et al.  Assessment of adherence to antiviral therapy in HIV-infected children using the Medication Event Monitoring System, pharmacy refill, provider assessment, caregiver self-report, and appointment keeping. , 2003, Journal of acquired immune deficiency syndromes.

[81]  W. Bilker,et al.  Provider inaccuracy in assessing adherence and outcomes with newly initiated antiretroviral therapy. , 2002, AIDS.

[82]  J. Casado,et al.  Validation of a simplified medication adherence questionnaire in a large cohort of HIV-infected patients: the GEEMA Study , 2002, AIDS.

[83]  J. Moatti,et al.  The Dynamic of Adherence to Highly Active Antiretroviral Therapy: Results From the French National APROCO Cohort , 2001, Journal of acquired immune deficiency syndromes.

[84]  F. Hecht,et al.  Provider Assessment of Adherence to HIV Antiretroviral Therapy , 2001, Journal of acquired immune deficiency syndromes.

[85]  J. Parienti,et al.  The pills identification test: a tool to assess adherence to antiretroviral therapy. , 2001, JAMA.

[86]  Susan Swindells,et al.  Adherence to Protease Inhibitor Therapy and Outcomes in Patients with HIV Infection , 2000, Annals of Internal Medicine.

[87]  A. Wu,et al.  Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: The AACTG Adherence Instruments , 2000, AIDS care.

[88]  Jay J H Park,et al.  Interventions to improve adherence to antiretroviral therapy: a systematic review and network meta-analysis. , 2017, The lancet. HIV.

[89]  C. Bova,et al.  A Proposal for Quality Standards for Measuring Medication Adherence in Research , 2012, AIDS and Behavior.

[90]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.