User Manuals for a Primary Care Electronic Medical Record System: A Mixed-Methods Study of User- and Vendor-Generated Documents

Research problem: Tutorials and user manuals are important forms of impersonal support for using software applications, including electronic medical records (EMRs). Differences between user- and vendor-generated documentation may indicate support needs, which are not sufficiently addressed by the official documentation, and reveal new elements that may inform the design of tutorials and user manuals. Research question: What are the differences between user-generated tutorials and manuals for an EMR and the official user manual from the software vendor? Literature review: Effective design of tutorials and user manuals requires careful packaging of information, balance between declarative and procedural texts, an action and task-oriented approach, support for error recognition and recovery, and effective use of visual elements. No previous research compared these elements between formal and informal documents. Methodology: We conducted a mixed-methods study. Seven tutorials and two manuals for an EMR were collected from three family health teams and compared with the official user manual from the software vendor. Documents were qualitatively analyzed using a framework analysis approach in relation to the principles of technical documentation described before. Subsets of the data were quantitatively analyzed using cross-tabulation to compare the types of error information and visual cues in screen captures between user- and vendor-generated manuals. Results and discussion: The user-developed tutorials and manuals differed from the vendor-developed manual in that they contained mostly procedural and not declarative information; were customized to the specific workflow, user roles, and patient characteristics; contained more error information related to work processes than software usage; and used explicit visual cues on screen captures to help users identify window elements. These findings imply that to support EMR implementation, tutorials and manuals need to be customized and adapted to specific organizational contexts and workflows. The main limitation of the study is its generalizability. Future research should address this limitation and may explore alternative approaches to software documentation, such as modular manuals or participatory design.

[1]  N. Denzin The research act: A theoretical introduction to sociological methods , 1977 .

[2]  Paula Otero,et al.  Assessing the impact of change in the organization of a technical support system for an Health Information Systems (HIS) , 2004, MedInfo.

[3]  Ben Shneiderman,et al.  Workplace user frustration with computers: an exploratory investigation of the causes and severity , 2006, Behav. Inf. Technol..

[4]  John M. Carroll,et al.  Minimalism in Technical Communication: Some Issues to Consider , 1998 .

[5]  Joan S. Ash,et al.  Implementing computerized physician order entry: the importance of special people , 2003, Int. J. Medical Informatics.

[6]  John M. Carroll,et al.  The Minimal Manual , 1987, SGCH.

[7]  Jm Noyes Review of Procedural and declarative information in software manuals: Effects on information use, task performance and knowledge by Ummelen, N , 1998 .

[8]  D. Bates,et al.  Improving safety with information technology. , 2003, The New England journal of medicine.

[9]  D. Bates Getting in Step: Electronic Health Records and their Role in Care Coordination , 2010, Journal of General Internal Medicine.

[10]  Maria Lluch,et al.  Healthcare professionals' organisational barriers to health information technologies - A literature review , 2011, Int. J. Medical Informatics.

[11]  P. Shekelle,et al.  Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care , 2006, Annals of Internal Medicine.

[12]  Clay Spinuzzi,et al.  The Methodology of Participatory Design , 2005 .

[13]  Ard W. Lazonder,et al.  Minimalist Instruction for Learning to Search the World Wide Web , 2001, Education and Information Technologies.

[14]  Janice C. Redish,et al.  Reading to learn to do , 1989 .

[15]  Clay Spinuzzi,et al.  Tracing Genres through Organizations: A Sociocultural Approach to Information Design , 2003 .

[16]  Hans van der Meij,et al.  Empirical proof for presenting screen captures in software documentations , 2004 .

[17]  Barbara Mirel,et al.  “Applied Constructivism” for User Documentation , 1998 .

[18]  Hans van der Meij,et al.  Screen captures in software documentation , 1998 .

[19]  William J. Doll,et al.  The place and value of documentation in end-user computing , 1993, Inf. Manag..

[20]  W. Rosser,et al.  Progress of Ontario’s Family Health Team Model: A Patient-Centered Medical Home , 2011, The Annals of Family Medicine.

[21]  C.J.M. Jansen Procedural and declarative information in software manuals , 1997 .

[22]  David K. Farkas Procedural and Declarative Information in Software Manuals: Effects of Information Use, Task Performance, and Knowledge. , 1997 .

[23]  George Palaigeorgiou,et al.  Journal of Information Technology Education Known and Unknown Weaknesses in Software Animated Demonstrations (screencasts): a Study in Self-paced Learning Settings , 2022 .

[24]  Ronald M. Baecker,et al.  Readings in human-computer interaction : a multidisciplinary approach , 1988 .

[25]  Joyce Karreman,et al.  Three Decades of Research and Professional Practice on Printed Software Tutorials for Novices , 2009 .

[26]  Cathy Schoen,et al.  A survey of primary care physicians in eleven countries, 2009: perspectives on care, costs, and experiences. , 2009, Health affairs.

[27]  C. Anandan,et al.  The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview , 2011, PLoS medicine.

[28]  Felicia M Bowens,et al.  Health information technology: integration of clinical workflow into meaningful use of electronic health records. , 2010, Perspectives in health information management.

[29]  Ard W. Lazonder,et al.  The Minimal Manual: Is Less Really More? , 1993, Int. J. Man Mach. Stud..

[30]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[31]  Ben Shneiderman,et al.  Severity and impact of computer user frustration: A comparison of student and workplace users , 2006, Interact. Comput..

[32]  Robert E. Horn Structured writing at twenty‐five , 1993 .

[33]  Janice Redish,et al.  Technical Communication and Usability: Intertwined Strands and Mutual Influences , 2010, IEEE Transactions on Professional Communication.

[34]  Ard W. Lazonder,et al.  Error-information in tutorial documentation: Supporting users' errors to facilitate initial skill learning , 1995, Int. J. Hum. Comput. Stud..

[35]  David W. Bates,et al.  Position Paper: Factors and Forces Affecting EHR System Adoption: Report of a 2004 ACMI Discussion , 2004, J. Am. Medical Informatics Assoc..

[36]  Steven R. Gordon Computing Information Technology: The Human Side , 2003 .

[37]  W. Hersh Medical informatics: improving health care through information. , 2002, JAMA.

[38]  Aviv Shachak,et al.  Understanding end-user support for health information technology: a theoretical framework. , 2011, Informatics in primary care.

[39]  John M. Carroll,et al.  Principles and Heuristics for Designing Minimalist Instruction , 1998 .

[40]  Kim M. Unertl,et al.  Traversing the many paths of workflow research: developing a conceptual framework of workflow terminology through a systematic literature review , 2010, J. Am. Medical Informatics Assoc..

[41]  John M. Carroll,et al.  Minimalist design for active users , 1987 .

[42]  Susan Palmiter,et al.  Animated Demonstrations for Learning Procedural Computer-Based Tasks , 1993, Hum. Comput. Interact..

[43]  Dean F. Sittig,et al.  Computerized Provider Order Entry Adoption: Implications for Clinical Workflow , 2008, Journal of General Internal Medicine.

[44]  Juanita I. Fernando Clinicians, security and information technology support services in practice settings - A pilot study , 2010, MedInfo.

[45]  John Krumm,et al.  User-Generated Content , 2008, IEEE Pervasive Comput..

[46]  Lone Stub Petersen Complexities in securing sustainable IT infrastructures in Hospitals: The many faces of Local Technical Support , 2010, MedInfo.

[47]  L. Spencer,et al.  Qualitative data analysis for applied policy research , 2002 .

[48]  Brian J. Reithel,et al.  Beyond the information center: An instrument to measure end-user computing support from multiple sources , 1998, Inf. Manag..

[49]  Robin Munkvold,et al.  End user support usage , 2003 .