Usability of a web-based personal nutrition management tool

‘Personal Nutrition Management Tool’ (PENUMAT) is an interactive web-based application which aims to help individuals seeking nutrition information on the Internet. However, little is known about the usability of such applications. The purpose of this study was to evaluate the usability of PENUMAT using multi-method approach. For an in-depth usability analysis, using a multi-method approach involving protocol analysis, interviews and a system usability scale (SUS) was adopted. The sample consisted of 10 healthy (five males and five females) volunteers between the ages of 22 and 60. The overall usability score was calculated; usability problems and users' opinions were obtained. All usability problems were classified according to the heuristics and listed with their frequencies. Overall, the usability score ranged from 77.5 to 100, with a median of 88.7. In-depth usability analysis exposed several usability problems mostly related to content, navigation and interactivity. Interview results showed that ‘being personal and private’ (70%) and ‘providing personal feedbacks' (60%) were the most appreciated characteristics of the tool. Although the tool has an acceptable overall usability score, several unnoticed usability problems of the interface design were realised with the in-depth analysis. Therefore, the importance of using a multi-method analysis of usability was pointed out.

[1]  Jakob Nielsen,et al.  Chapter 5 – Usability Heuristics , 1993 .

[2]  J. Nielsen.  Usability inspection methods , 1994, CHI Conference Companion.

[3]  J J Cimino,et al.  Cognitive evaluation of the user interface and vocabulary of an outpatient information system. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[4]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[5]  Jakob Nielsen,et al.  Usability Metrics: Tracking Interface Improvements , 1996, IEEE Softw..

[6]  Jennifer Niederst,et al.  Designing for the web , 1996 .

[7]  Vimla L. Patel,et al.  Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces , 1997, AMIA.

[8]  J. Brug,et al.  Computer-tailored nutrition education: differences between two interventions. , 1999, Health education research.

[9]  J Brug,et al.  The application and impact of computer-generated personalized nutrition education: a review of the literature. , 1999, Patient education and counseling.

[10]  Jianhua Li,et al.  An evaluation of patient access to their electronic medical records via the World Wide Web , 2000, AMIA.

[11]  Vimla L. Patel,et al.  Evaluation of Web-based patient information resources: application in the assessment of a patient clinical information system , 2000, AMIA.

[12]  Vimla L. Patel,et al.  'Televaluation' of clinical information systems: an integrative approach to assessing Web-based systems , 2001, Int. J. Medical Informatics.

[13]  J. Brug,et al.  Framing of nutrition education messages in persuading consumers of the advantages of a healthy diet. , 2001, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[14]  R. Winett,et al.  Using Internet technology to deliver a behavioral weight loss program. , 2001, JAMA.

[15]  J. Brug,et al.  Web-based tailored nutrition education: results of a randomized controlled trial. , 2001, Health education research.

[16]  Nancy L Kondracki,et al.  Content analysis: review of methods and their applications in nutrition education. , 2002, Journal of nutrition education and behavior.

[17]  D. Greenwood,et al.  A randomised trial of an internet weight control resource: The UK Weight Control Trial [ISRCTN58621669] , 2003, BMC health services research.

[18]  S. Noah,et al.  DietPal: A Web-Based Dietary Menu-Generating and Management System , 2004, Journal of medical Internet research.

[19]  Andrea L. Paiva,et al.  Assessing stage of change and informed decision making for Internet participation in health promotion and disease management. , 2004, Managed care interface.

[20]  Monique W. M. Jaspers,et al.  The think aloud method: a guide to user interface design , 2004, Int. J. Medical Informatics.

[21]  Lisa A Sutherland,et al.  Unraveling the web: an evaluation of the content quality, usability, and readability of nutrition web sites. , 2005, Journal of nutrition education and behavior.

[22]  Myron Hatcher,et al.  Web Based Health Education, E-learning, for Weight Management , 2005, Journal of Medical Systems.

[23]  Debbie Stone,et al.  User Interface Design and Evaluation , 2005 .

[24]  Monique W. M. Jaspers,et al.  Usability Evaluation of a Laboratory Order Entry System: Cognitive Walkthrough and Think Aloud Combined , 2005, MIE.

[25]  Brian G Danaher,et al.  Bandwidth Constraints to Using Video and Other Rich Media in Behavior Change Websites , 2005, Journal of medical Internet research.

[26]  Johannes Brug,et al.  Short-term efficacy of a web-based computer-tailored nutrition intervention: Main Effects and Mediators , 2005, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[27]  Steven H. Woolf,et al.  A Practice-Sponsored Web Site to Help Patients Pursue Healthy Behaviors: An ACORN Study , 2006, The Annals of Family Medicine.

[28]  M. A. Roth,et al.  Web‐based Weight Management Programs in an Integrated Health Care Setting: A Randomized, Controlled Trial , 2006, Obesity.

[29]  Sandra L Saperstein,et al.  The impact of Internet use for weight loss , 2007, Obesity reviews : an official journal of the International Association for the Study of Obesity.

[30]  Gary G Bennett,et al.  Feasibility of Using a Web-Based Nutrition Intervention Among Residents of Multiethnic Working-Class Neighborhoods , 2007, Preventing chronic disease.

[31]  Áine McConnon,et al.  The Internet for weight control in an obese sample: results of a randomised controlled trial , 2007, BMC Health Services Research.

[32]  A. Booth,et al.  Evaluation of an interactive, Internet-based weight loss program: a pilot study. , 2008, Health education research.

[33]  Howard Cabral,et al.  Weight, Blood Pressure, and Dietary Benefits After 12 Months of a Web-based Nutrition Education Program (DASH for Health): Longitudinal Observational Study , 2008, Journal of medical Internet research.

[34]  Monique W. M. Jaspers,et al.  Usability Studies on Interactive Health Information Systems; Where Do We Stand? , 2008, MIE.

[35]  C. Champagne,et al.  Design and Implementation of an Interactive Website to Support Long-Term Maintenance of Weight Loss , 2008, Journal of medical Internet research.

[36]  Farrokh Alemi,et al.  Rethinking Satisfaction Surveys: Minute Survey , 2008, Quality management in health care.

[37]  C. Chronaki,et al.  eHealth Trends in Europe 2005-2007: A Population-Based Survey , 2008, Journal of medical Internet research.

[38]  W. Kroeze,et al.  The efficacy of Web-based and print-delivered computer-tailored interventions to reduce fat intake: results of a randomized, controlled trial. , 2008, Journal of nutrition education and behavior.

[39]  Dag Svanæs,et al.  The Contextual Nature of Usability and its Relevance to Medical Informatics , 2008, MIE.

[40]  Mildred A. Horodynski,et al.  Increasing nutrition literacy: testing the effectiveness of print, web site, and game modalities. , 2008, Journal of nutrition education and behavior.

[41]  Juliann Cortese,et al.  Computer-tailored health interventions delivered over the Web: review and analysis of key components. , 2009, Patient education and counseling.

[42]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[43]  Titus Schleyer,et al.  Comparative study of heuristic evaluation and usability testing methods. , 2009, Studies in health technology and informatics.

[44]  Suzanne Bakken,et al.  A Comparison of Usability Evaluation Methods: Heuristic Evaluation versus End-User Think-Aloud Protocol - An Example from a Web-based Communication Tool for Nurse Scheduling , 2009, AMIA.

[45]  Gail D Pearson,et al.  The National Heart, Lung, and Blood Institute bench to bassinet Program: a new paradigm for translational research. , 2010, Journal of the American College of Cardiology.

[46]  Kemal Macit Hisar,et al.  Human Resource Management At the Ministry of Health of Turkey , 2012 .