A multi-site cognitive task analysis for biomedical query mediation

OBJECTIVE To apply cognitive task analyses of the Biomedical query mediation (BQM) processes for EHR data retrieval at multiple sites towards the development of a generic BQM process model. MATERIALS AND METHODS We conducted semi-structured interviews with eleven data analysts from five academic institutions and one government agency, and performed cognitive task analyses on their BQM processes. A coding schema was developed through iterative refinement and used to annotate the interview transcripts. The annotated dataset was used to reconstruct and verify each BQM process and to develop a harmonized BQM process model. A survey was conducted to evaluate the face and content validity of this harmonized model. RESULTS The harmonized process model is hierarchical, encompassing tasks, activities, and steps. The face validity evaluation concluded the model to be representative of the BQM process. In the content validity evaluation, out of the 27 tasks for BQM, 19 meet the threshold for semi-valid, including 3 fully valid: "Identify potential index phenotype," "If needed, request EHR database access rights," and "Perform query and present output to medical researcher", and 8 are invalid. DISCUSSION We aligned the goals of the tasks within the BQM model with the five components of the reference interview. The similarity between the process of BQM and the reference interview is promising and suggests the BQM tasks are powerful for eliciting implicit information needs. CONCLUSIONS We contribute a BQM process model based on a multi-site study. This model promises to inform the standardization of the BQM process towards improved communication efficiency and accuracy.

[1]  N. Hoffart,et al.  A Member Check Procedure to Enhance Rigor in Naturalistic Research , 1991, Western journal of nursing research.

[2]  Wei Pan,et al.  Recalculation of the Critical Values for Lawshe’s Content Validity Ratio , 2012 .

[3]  C. H. Lawshe A QUANTITATIVE APPROACH TO CONTENT VALIDITY , 1975 .

[4]  D W Bates,et al.  eHealth in North America , 2013, Yearbook of Medical Informatics.

[5]  Chunhua Weng,et al.  DREAM: Classification scheme for dialog acts in clinical research query mediation , 2016, J. Biomed. Informatics.

[6]  Stéphane M. Meystre,et al.  A Clinical Use Case to Evaluate the i2b2 Hive: Predicting Asthma Exacerbations , 2009, AMIA.

[7]  Luke V Rasmussen,et al.  The Electronic Health Record for Translational Research , 2014, Journal of Cardiovascular Translational Research.

[8]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[9]  Susan C. Weber,et al.  STRIDE - An Integrated Standards-Based Translational Research Informatics Platform , 2009, AMIA.

[10]  R. Clark,et al.  Cognitive task analysis for training , 1996 .

[11]  Jimmy J. Lin,et al.  Toward automatic facet analysis and need negotiation: Lessons from mediated search , 2008, TOIS.

[12]  Paul A. Fontelo,et al.  Utilization of the PICO framework to improve searching PubMed for clinical questions , 2007, BMC Medical Informatics Decis. Mak..

[13]  Nigel Ford,et al.  Toward a Cognitive Theory of Information Accessing: An Empirical Study , 1993, Inf. Process. Manag..

[14]  Chunhua Weng,et al.  Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research , 2013, J. Am. Medical Informatics Assoc..

[15]  C. Weston,et al.  Analyzing Interview Data: The Development and Evolution of a Coding System , 2001 .

[16]  Christopher G Chute,et al.  Analyzing the heterogeneity and complexity of Electronic Health Record oriented phenotyping algorithms. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[17]  Guo-Qiang Zhang,et al.  VISAGE: A Query Interface for Clinical Research , 2010, Summit on translational bioinformatics.

[18]  Melissa A. Basford,et al.  Validation of electronic medical record-based phenotyping algorithms: results and lessons learned from the eMERGE network. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[19]  R. David Lankes The digital reference research agenda , 2004, J. Assoc. Inf. Sci. Technol..

[20]  Chunhua Weng,et al.  A centralized research data repository enhances retrospective outcomes research capacity: a case report , 2013, J. Am. Medical Informatics Assoc..

[21]  C. Chute,et al.  Electronic Medical Records for Genetic Research: Results of the eMERGE Consortium , 2011, Science Translational Medicine.

[22]  Joyce A. Mitchell,et al.  Evaluating the informatics for integrating biology and the bedside system for clinical research , 2009 .

[23]  Robert S. Taylor Question-Negotiation and Information Seeking in Libraries , 1968, Coll. Res. Libr..

[24]  M. Etminan,et al.  Comparative Effectiveness of Olmesartan and Other Angiotensin Receptor Blockers in Diabetes Mellitus: Retrospective Cohort Study , 2014, Hypertension.

[25]  Steve Evans,et al.  The DEDUCE Guided Query tool: Providing simplified access to clinical data for research and quality improvement , 2011, J. Biomed. Informatics.

[26]  Nicholas J. Belkin,et al.  Ask for Information Retrieval: Part I. Background and Theory , 1997, J. Documentation.

[27]  Preben Hansen,et al.  Collaborative Information Retrieval in an information-intensive domain , 2005, Inf. Process. Manag..

[28]  S. Chipman,et al.  Introduction to Cognitive Task Analysis , 2000 .

[29]  S. Fosså,et al.  Treatment and 5-year survival in patients with nonmetastatic prostate cancer: the Norwegian experience. , 2014, Urology.

[30]  Chunhua Weng,et al.  What Is Asked in Clinical Data Request Forms? A Multi-site Thematic Analysis of Forms Towards Better Data Access Support , 2014, AMIA.

[31]  A Wajda,et al.  Epidemiology of Crohn's disease and ulcerative colitis in a central Canadian province: a population-based study. , 1999, American journal of epidemiology.

[32]  F. Lagerwaard,et al.  A clinical nomogram and recursive partitioning analysis to determine the risk of regional failure after radiosurgery alone for brain metastases. , 2014, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[33]  Chunhua Weng,et al.  Toward a Cognitive Task Analysis for Biomedical Query Mediation , 2014, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[34]  Julia Hirschberg,et al.  Characterization of the Biomedical Query Mediation Process , 2013, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[35]  Vimla L. Patel,et al.  Understanding the nature of information seeking behavior in critical care: Implications for the design of health information technology , 2013, Artif. Intell. Medicine.