A Multi-method Approach to Assessing Health Information Systems End Users' Training Needs

Many existing training programs for Health Information Systems (HIS) do not adequately satisfy end users' needs nor meet training objectives. This is because they do not envisage the problems that users may encounter when performing specific tasks. Therefore the first priority for the development of an effective training program is to precisely assess the end users' training needs, a process called Training Needs Assessment (TNA). Applying traditional approaches for TNA, such as interviews or surveys alone, however, may be insufficient because they are limited in their capacity to reveal the cognitive processes of end users. Usability testing, with its ability to gather data about human computer interaction, overcomes the deficiencies of these traditional approaches. This paper proposes a multi-method approach, which combines usability testing together with traditional methods, such as interviews or questionnaire surveys to assess HIS end users' training needs. This innovative method is able to precisely reveal the training needs for different levels of HIS users. A case study, which applied this method to assess the training needs for users of a nursing information system demonstrates its feasibility.

[1]  Robert P. Bostrom,et al.  Individual Differences and Conceptual Models in Training Novice Users , 1989, Hum. Comput. Interact..

[2]  Ping Yu,et al.  An Exploration of the Barriers to the Adoption of Information Technology in Australian Aged Care Industry , 2004 .

[3]  Catherine Courage,et al.  Understanding Your Users: A Practical Guide to User Requirements Methods, Tools, and Techniques , 2005 .

[4]  J. Fox,et al.  Decision-Support Systems as Safety-Critical Components: Towards a Safety Culture for Medical Informatics , 1993, Methods of Information in Medicine.

[5]  Linda Worrall-Carter,et al.  Teaching in Nursing: A guide for faculty , 1998 .

[6]  Albert H. Huang End-User Training Management Systems. , 2002 .

[7]  Vimla L. Patel,et al.  Cognitive Approaches to the Evaluation of Healthcare Information Systems , 2005 .

[8]  Vimla L. Patel,et al.  Cognitive and usability engineering methods for the evaluation of clinical information systems , 2004, J. Biomed. Informatics.

[9]  André Kushniruk,et al.  Evaluation in the design of health information systems: application of approaches emerging from usability engineering , 2002, Comput. Biol. Medicine.

[10]  R. Ryan Nelson,et al.  The assessment of end-user training needs , 1995, CACM.

[11]  Cheri Ostroff,et al.  Assessing training needs: Critical levels of analysis. , 1989 .

[12]  Robert P. Bostrom,et al.  End-user training methods: what we know, need to know , 2006, SIGMIS CPR '06.

[13]  T. Crowl,et al.  Fundamentals of Educational Research , 1993 .

[14]  John Gosbee,et al.  Human-computer interaction and medical software development , 1997, INTR.

[15]  Paul H. Cheney,et al.  End User Training: A Decade of Research , 1997 .

[16]  Diane M Billings,et al.  Teaching in Nursing: A Guide for Faculty , 1998 .

[17]  P Washer,et al.  Barriers to the use of web-based learning in nurse education. , 2001, Nurse education today.

[18]  Vincent S. Lai,et al.  Evaluating end-user training programs , 2005, CACM.

[19]  R. Ryan Nelson,et al.  Educational Needs as Perceived by IS and End-User Personnel: A Survey of Knowledge and Skill Requirements , 1991, MIS Q..

[20]  A. W. Lazonder Exploring novice users' training needs in searching information on the WWW , 2000, J. Comput. Assist. Learn..

[21]  Steve Howard,et al.  User interface design and HCI: identifying the training needs of practitioners , 1995, SGCH.

[22]  D. Wilkinson,et al.  Using Research Instruments: A Guide for Researchers , 2003 .

[23]  Eleanor Callahan Hunt,et al.  The Nursing Informatics Implementation Guide , 2004, Health Informatics Series.

[24]  Mark Simpson How usability testing can aid the development of online documentation , 1990, SIGDOC '90.

[25]  H. Lehmann,et al.  Communication and information technology in medical education , 2001, The Lancet.

[26]  P. Tang,et al.  Medical Computer Applications in Health Care and Biomedicine , 2002 .

[27]  M R Kidd,et al.  The “Lost Generation”: IT education for healthcare professionals , 1999, The Medical journal of Australia.

[28]  Emma O'Brien,et al.  Training Needs Analysis: the first step in authoring e-learning content , 2004, SAC '04.

[29]  André Kushniruk,et al.  Analysis of Complex Decision-Making Processes in Health Care: Cognitive Approaches to Health Informatics , 2001, J. Biomed. Informatics.