Measuring the Effects of Caffeine and L-Theanine on Cognitive Performance: A Protocol for Self-Directed, Mobile N-of-1 Studies

Background: The growing consumer digital tools market has made using individual health data to inform lifestyle changes more accessible than ever. The n-of-1 trial–a single participant, multiple crossover, comparative effectiveness trial–offers methodological tools that link interventions directly with personalized outcomes to determine the best treatment for an individual. We have developed a complete digital platform to support self-directed n-of-1 trials, comprised of virtual study on-boarding, visual informed consent, device integrations, in-app assessments, and automated data analysis. Objective: To evaluate the n-of-1 platform, a pilot study was launched to investigate the effects of commonly consumed substances on cognition. The purpose of the study is to allow an individual to measure the effect of 2 treatments (caffeine alone vs. caffeine + L-theanine) on 3 measures of cognitive performance: creative thinking, processing speed, and visual attention. Upon completion of the study, individuals receive personalized results that compare the impact of the two treatments on each of the cognitive performance measures. Methods: After the onboarding process, participants are randomized to a study length (5, 15, or 27 days), starting treatment (caffeine or caffeine + L-theanine), and app notification frequency (light, moderate). Each trial begins with a baseline period, during which participants abstain from either treatment, followed by 2 randomized counterbalanced treatment sequences (either ABBA or BAAB). Throughout the trial, daily tests assess participant cognitive performance. These tests are digital versions of the Remote Associates Test, Stroop Test, and Trail Making Test, and are implemented directly in the n-of-1 mobile application (“N1”). Assessments are completed at a fixed time, defined by the individual during study setup. Treatments are taken daily within a fixed time window prior to the user-defined assessment time. Cognitive assessment results are analyzed using a linear model with factors for treatment and block, and each treatment is compared to baseline. Results: We launched our N1 app on the Apple App Store in mid-October 2019 and recruited over 40 participants within the first month. Conclusion: This platform provides individuals the opportunity to investigate their response to treatments through n-of-1 methods, empowering them to make data-driven, personalized lifestyle choices. Trial Registration: www.ClinicalTrials.gov, identifier: NCT04056650.

[1]  R. Reitan Validity of the Trail Making Test as an Indicator of Organic Brain Damage , 1958 .

[2]  A. Benton,et al.  COMPARATIVE STUDIES OF SOME PSYCHOLOGICAL TESTS FOR CEREBRAL DAMAGE , 1965, The Journal of nervous and mental disease.

[3]  A. Jensen,et al.  The Stroop color-word test: a review. , 1966, Acta psychologica.

[4]  S. Mednick,et al.  The Remote Associates Test , 1968 .

[5]  J. Kaas Comparative studies. , 1977, Science.

[6]  D. Chatel,et al.  Derived Trail Making Test indices: A preliminary report. , 1994 .

[7]  J. Schooler,et al.  The ineffability of insight. , 1995 .

[8]  K. Arbuthnott,et al.  Trail Making Test, Part B as a Measure of Executive Control: Validation Using a Set-Switching Paradigm , 2000, Journal of clinical and experimental neuropsychology.

[9]  In Summary: Caffeine for the Sustainment of Mental Task Performance: Formulations for Military Operations. , 2002, Nutrition today.

[10]  K. Kortte,et al.  The Trail Making Test, Part B: Cognitive Flexibility or Ability to Maintain Set? , 2002, Applied neuropsychology.

[11]  Andrew P. Smith,et al.  Effects of caffeine on human behavior. , 2002, Food and chemical toxicology : an international journal published for the British Industrial Biological Research Association.

[12]  Mark Jung-Beeman,et al.  Normative data for 144 compound remote associate problems , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[13]  G. Eysenbach The Law of Attrition , 2005, Journal of medical Internet research.

[14]  C. Nikles,et al.  An n-of-1 Trial Service in Clinical Practice: Testing the Effectiveness of Stimulants for Attention-Deficit/Hyperactivity Disorder , 2006, Pediatrics.

[15]  D. Woltz,et al.  Availability of related long-term memory during and after attention focus in working memory , 2006, Memory & cognition.

[16]  D. Kennedy,et al.  The effects of l-theanine, caffeine and their combination on cognition and mood , 2008, Biological Psychology.

[17]  J. Bryan Psychological effects of dietary components of tea: caffeine and L-theanine. , 2008, Nutrition reviews.

[18]  R. Kravitz,et al.  Marketing therapeutic precision: Potential facilitators and barriers to adoption of n-of-1 trials. , 2009, Contemporary clinical trials.

[19]  E. Keenan,et al.  How much theanine in a cup of tea? Effects of tea type and method of preparation , 2011 .

[20]  W. Shadish,et al.  CONSORT extension for reporting N-of-1 trials (CENT) 2015: Explanation and elaboration , 2015, BMJ : British Medical Journal.

[21]  S. Friend,et al.  The mPower study, Parkinson disease mobile data collected using ResearchKit , 2016, Scientific Data.

[22]  C. Suver,et al.  Developing a Transparent, Participant-Navigated Electronic Informed Consent for Mobile-Mediated Research , 2016 .

[23]  R. Kravitz,et al.  Effect of Mobile Device–Supported Single-Patient Multi-crossover Trials on Treatment of Chronic Musculoskeletal Pain: A Randomized Clinical Trial , 2018, JAMA internal medicine.

[24]  Hans Ekkehard Plesser,et al.  Reproducibility vs. Replicability: A Brief History of a Confused Terminology , 2018, Front. Neuroinform..

[25]  Adam B. Cohen,et al.  Digital health: a path to validation , 2019, npj Digital Medicine.

[26]  M. Desai,et al.  Rationale and design of a large-scale, app-based study to identify cardiac arrhythmias using a smartwatch: The Apple Heart Study , 2018, American heart journal.

[27]  Stephen G. Henry,et al.  Effect of Mobile Device-Assisted N-of-1 Trial Participation on Analgesic Prescribing for Chronic Pain: Randomized Controlled Trial , 2019, Journal of General Internal Medicine.

[28]  Jason R. Bobe,et al.  Factors Associated With Trial Completion and Adherence in App-Based N-of-1 Trials: Protocol for a Randomized Trial Evaluating Study Duration, Notification Level, and Meaningful Engagement in the Brain Boost Study , 2020, JMIR research protocols.