Testing the Usability of Two Automated Home-Based Patient-Management Systems

To explore to what extent observation and semistructured in-depth interviews provide effective tools for usability testing of two automated home-based systems aimed at monitoring patients' health status at home and improving self-care. Telephone-Linked Care for Diet Adherence in Dyslipidemia (TLC-DietAid) used computer telephony to interact with users and Home Asthma Telemonitoring System (HAT System) used a combination of Personal Digital Assistant (palmtops) and the Internet for similar purposes. Both systems were evaluated in two separate pilot studies. Our pilot studies uncovered “medium-specific” and “content-specific” issues that addressed either the process of the interaction or its content. The results demonstrated that patient-users tended to evaluate each system on the basis of how it fit into everyday life and corresponded to personal preferences. The methodology also allowed the system designers to understand users' concerns and the context of adoption in order to introduce necessary changes to the design to address such concerns.

[1]  John E. Stollerman,et al.  A telecommunications system for monitoring and counseling patients with hypertension. Impact on medication adherence and blood pressure control. , 1996, American journal of hypertension.

[2]  Scott Lewis,et al.  Ethnographic data for product development: a collaborative process , 1996, INTR.

[3]  Cathleen Wharton,et al.  Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces , 1992, Int. J. Man Mach. Stud..

[4]  R. Friedman.  Automated Telephone Conversations to Assess Health Behavior and Deliver Behavioral Interventions , 1998, Journal of Medical Systems.

[5]  Ann Lantz,et al.  User centered design—problems and possibilities: a summary of the 1998 PDC & CSCW workshop , 1999, SGCH.

[6]  S. Moore,et al.  The Effects of a Special Computer Network on Caregivers of Persons with Alzheimer's Disease , 1995, Nursing research.

[7]  R. Hanka,et al.  Evaluating information technology in health care: barriers and challenges , 1998, BMJ.

[8]  Frank F. Land,et al.  Viewpoint: choosing appropriate information systems research methodologies , 1987, CACM.

[9]  N. P. Vitalari,et al.  The need of longitudinal designs in the study of computing environments , 1986, Trends in Information Systems.

[10]  David H. Gustafson,et al.  Wired for health and well-being : the emergence of interactive health communication , 1999 .

[11]  H A Heathfield,et al.  Current evaluations of information technology in health care are often inadequate , 1996, BMJ.

[12]  A. Strauss,et al.  Basics of qualitative research: Grounded theory procedures and techniques. , 1992 .

[13]  Dennis Wixon,et al.  Field methods casebook for software design , 1996 .

[14]  V. J. Symons,et al.  A review of information systems evaluation: content, context and process , 1991 .

[15]  D H Gustafson,et al.  Access to health information and support: a public highway or a private road? , 1998, JAMA.

[16]  Warner V. Slack.  Cybermedicine: How Computing Empowers Doctors and Patients for Better Health Care , 1997 .

[17]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[18]  David E. Rowley,et al.  The cognitive jogthrough: a fast-paced user interface evaluation procedure , 1992, CHI.

[19]  P. Prasad.  Systems of meaning: ethnography as a methodology for the study of information technologies , 1997 .

[20]  A. Strauss.  Basics Of Qualitative Research , 1992 .

[21]  Guy Fitzgerald,et al.  Research methods in information systems , 1985 .

[22]  tim boone,et al.  SOCIAL LEARNING THEORY Albert Bandura Englewood Cliffs, N.J.: Prentice-Hall, 1977. 247 pp., paperbound , 1977 .

[23]  Ann Lantz,et al.  USER CENTERED DESIGN – PROBLEMS AND POSSIBILITIES , 1999 .

[24]  Bonnie Kaplan,et al.  Participant reactions to a computerized telephone system for nutrition and exercise counseling. , 2003, Patient education and counseling.

[25]  Karen Holtzblatt.  Introduction to special section on contextual design , 1999, INTR.

[26]  F Alemi,et al.  Educating patients at home. Community Health Rap. , 1996, Medical care.

[27]  Diana E. Forsythe,et al.  Using ethnography in the design of an explanation system , 1995 .

[28]  Robert H. Friedman,et al.  Synthesis of Research: The Virtual Visit: Using Telecommunications Technology to Take Care of Patients , 1997, J. Am. Medical Informatics Assoc..

[29]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[30]  Joseph Finkelstein,et al.  Telematic System for Monitoring of Asthma Severity in Patients' Homes , 1998, MedInfo.

[31]  E. Trauth.  Qualitative Research in IS: Issues and Trends , 2001 .

[32]  Anselm L. Strauss,et al.  Qualitative Analysis For Social Scientists , 1987 .

[33]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[34]  Hans-Erik Nissen,et al.  ACQUIRING KNOWLEDGE OF INFORMATION SYSTEMS : RESEARCH IN A METHODOLOGICAL QUAGMIRE , 2000 .

[35]  Frank Land,et al.  Choosing Appropriate Information Systems Research Methodologies , 2002 .

[36]  David G. Novick,et al.  Using the cognitive walkthrough for operating procedures , 1999, INTR.

[37]  G. Hripcsak,et al.  Internet-based home asthma telemonitoring: can patients handle the technology? , 2000, Chest.

[38]  Third Expert Panel on theDiagnosis,et al.  Expert Panel Report 3: Guidelines for the Diagnosis and Management of Asthma , 1997 .

[39]  A. Bandura.  Social learning theory , 1977 .

[40]  Michael D. Myers,et al.  Investigating Information Systems with Ethnographic Research , 1999, Commun. Assoc. Inf. Syst..

[41]  Karlheinz Kautz,et al.  User Participation and Participatory Design: Topics in Computing Education , 1996, Hum. Comput. Interact..