Bmc Medical Informatics and Decision Making a Review of Randomized Controlled Trials Comparing the Effectiveness of Hand Held Computers with Paper Methods for Data Collection

BackgroundHandheld computers are increasingly favoured over paper and pencil methods to capture data in clinical research.MethodsThis study systematically identified and reviewed randomized controlled trials (RCTs) that compared the two methods for self-recording and reporting data, and where at least one of the following outcomes was assessed: data accuracy; timeliness of data capture; and adherence to protocols for data collection.ResultsA comprehensive key word search of NLM Gateway's database yielded 9 studies fitting the criteria for inclusion. Data extraction was performed and checked by two of the authors. None of the studies included all outcomes. The results overall, favor handheld computers over paper and pencil for data collection among study participants but the data are not uniform for the different outcomes. Handheld computers appear superior in timeliness of receipt and data handling (four of four studies) and are preferred by most subjects (three of four studies). On the other hand, only one of the trials adequately compared adherence to instructions for recording and submission of data (handheld computers were superior), and comparisons of accuracy were inconsistent between five studies.ConclusionHandhelds are an effective alternative to paper and pencil modes of data collection; they are faster and were preferred by most users.

[1]  J. Walden,et al.  Electronic Diary for Bipolar Patients , 2003, Neuropsychobiology.

[2]  Darin J Erickson,et al.  Handheld Computers , 2003, Evaluation review.

[3]  P. Quinn,et al.  Assessment of an electronic daily diary in patients with overactive bladder , 2003, BJU international.

[4]  A F Cohen,et al.  Self-medication of a single headache episode with ketoprofen, ibuprofen or placebo, home-monitored with an electronic patient diary. , 1996, British journal of clinical pharmacology.

[5]  N Heddle,et al.  Handheld computers and paper diaries for documenting the use of factor concentrates used in haemophilia home therapy: a qualitative study , 2005, Haemophilia : the official journal of the World Federation of Hemophilia.

[6]  S Shiffman,et al.  Remember that? A comparison of real-time versus retrospective recall of smoking lapses. , 1997, Journal of consulting and clinical psychology.

[7]  R. Delfino,et al.  Anxiety, affect, and activity in teenagers: monitoring daily life with electronic diaries. , 2002, Journal of the American Academy of Child and Adolescent Psychiatry.

[8]  Nathaniel P. Katz,et al.  Comparative study of electronic vs. paper VAS ratings: a randomized, crossover trial using healthy volunteers , 2002, PAIN.

[9]  S Shiffman,et al.  Comparative efficacy of 24-hour and 16-hour transdermal nicotine patches for relief of morning craving. , 2000, Addiction.

[10]  M Elia,et al.  Comparison of the traditional paper visual analogue scale questionnaire with an Apple Newton electronic appetite rating system (EARS) in free living subjects feeding ad libitum , 1998, European Journal of Clinical Nutrition.

[11]  G. Badlani,et al.  Computerized voiding diary , 1993, Neurourology and urodynamics.

[12]  P. Kind,et al.  Link between patient preferences and treatment outcomes in seasonal allergic rhinitis: an empiric investigation. , 1999, Clinical therapeutics.

[13]  S. Shiffman,et al.  Patient compliance with paper and electronic diaries. , 2003, Controlled clinical trials.

[14]  Kay Lehman Clinical nursing instructors' use of handheld computers for student recordkeeping and evaluation. , 2003, The Journal of nursing education.

[15]  Khaled J Saleh,et al.  Comparison of commonly used orthopaedic outcome measures using palm‐top computers and paper surveys , 2002, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[16]  Marin H Kollef,et al.  Use of a handheld computer by respiratory care practitioners to improve the efficiency of weaning patients from mechanical ventilation* , 2002, Critical care medicine.

[17]  B. Tiplady,et al.  The Use of Electronic Diaries in Respiratory Studies , 1997 .

[18]  P. Gupta,et al.  Survey of sociodemographic characteristics of tobacco use among 99,598 individuals in Bombay, India using handheld computers. , 1996, Tobacco control.

[19]  D H Christiansen,et al.  Computer-assisted data collection in multicenter epidemiologic research. The Atherosclerosis Risk in Communities Study. , 1990, Controlled clinical trials.

[20]  H. Emslie,et al.  Enhancing an appointment diary on a pocket computer for use by people after brain injury , 2001, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.

[21]  R. Jamison,et al.  Electronic diaries for monitoring chronic pain: 1-year validation study , 2001, Pain.

[22]  Kristine E Keplar,et al.  Personal digital assistant applications for the healthcare provider. , 2003, The Annals of pharmacotherapy.

[23]  Ralph Mösges,et al.  The use of handheld computers in clinical trials. , 2002, Controlled clinical trials.

[24]  Philippe L Bedard,et al.  "Palm reading": 2. Handheld software for physicians. , 2003, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[25]  B. Kovatchev,et al.  Hypoglycemia and the decision to drive a motor vehicle by persons with diabetes. , 1999, JAMA.

[26]  André Kushniruk,et al.  Evaluation in the design of health information systems: application of approaches emerging from usability engineering , 2002, Comput. Biol. Medicine.

[27]  David Wittrock,et al.  An evaluation of the relationship between mood and binge eating in the natural environment using ecological momentary assessment. , 2002, The International journal of eating disorders.

[28]  M. Hyland,et al.  Diary keeping in asthma: comparison of written and electronic methods. , 1993, BMJ.

[29]  J. J. Caro Sr,et al.  Does electronic implementation of questionnaires used in asthma alter responses compared to paper implementation? , 2004, Quality of Life Research.

[30]  Saul Shiffman,et al.  Remember that? A comparison of real-time versus retrospective recall of smoking lapses. , 1997, Journal of consulting and clinical psychology.

[31]  M M Wofford,et al.  Clinical documentation: the handheld computer as a survival tool. , 1998, M.D. computing : computers in medical practice.

[32]  J. Bahnson,et al.  Using a hand-held computer to collect data in an orthopedic outpatient clinic: a randomized trial of two survey methods. , 1999, Medical care.

[33]  Stephen E. Lapinsky,et al.  Review Paper: Handheld Computing in Medicine , 2003, J. Am. Medical Informatics Assoc..

[34]  Dorian G. W. Smith,et al.  Palm computer demonstrates a fast and accurate means of burn data collection. , 2000, The Journal of burn care & rehabilitation.

[35]  H. Drummond,et al.  Electronic quality of life questionnaires: a comparison of pen-based electronic questionnaires with conventional paper in a gastrointestinal study , 1995, Quality of Life Research.

[36]  Kevin B. Johnson,et al.  An Electronic Menstrual Cycle Calendar: Comparison of Data Quality With a Paper Version , 2000, Menopause.

[37]  Alec Holt,et al.  Hand-held computers in healthcare: what software programs are available? , 2002, The New Zealand medical journal.

[38]  Richard Usatine Teaching and practicing medicine with handheld computers. , 2002, Family medicine.

[39]  Gopal H. Badlani,et al.  “Compu-void II”: The computerized voiding diary , 1996, Journal of Medical Systems.

[40]  S. Shiffman,et al.  Patient non-compliance with paper diaries , 2002, BMJ : British Medical Journal.

[41]  Bonnie Kaplan,et al.  Evaluating informatics applications - some alternative approaches: theory, social interactionism, and call for methodological pluralism , 2001, Int. J. Medical Informatics.

[42]  John M. Weiler,et al.  Data Capture from the Sponsors’ And Investigators’ Perspectives: Balancing Quality, Speed, and Cost , 1998 .

[43]  M Berg,et al.  Integrating Quantitative and Qualitative Methods in Patient Care Information System Evaluation , 2003, Methods of Information in Medicine.

[44]  Gabriele Riccardi,et al.  Evaluation of New Computerized Method for Recording 7-Day Food Intake in IDDM Patients , 1991, Diabetes Care.

[45]  H. Emslie,et al.  Comparison of pocket-computer memory aids for people with brain injury. , 2001, Brain injury.

[46]  R Brian Haynes,et al.  Comparison of deferral rates using a computerized versus written blood donor questionnaire: a randomized, cross-over study [ISRCTN84429599] , 2002, BMC public health.

[47]  D Robinson Data capture using hand-held computers. , 1994, Journal of psychiatric and mental health nursing.

[48]  Neil R. Powe,et al.  The Atherosclerosis Risk in Communities Study , 2006 .

[49]  Joel D. Selanikio,et al.  Mobile Computing in the Humanitarian Assistance Setting: An Introduction and Some First Steps , 2002, Journal of Medical Systems.

[50]  S. M. Miller,et al.  Personal digital assistant infectious diseases applications for health care professionals. , 2003, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[51]  N Heddle,et al.  Comparing hand‐held computers and paper diaries for haemophilia home therapy: a randomized trial , 2004, Haemophilia : the official journal of the World Federation of Hemophilia.