Ecological content validation of the Information Assessment Method for parents (IAM-parent): A mixed methods study.

This mixed methods study content validated the Information Assessment Method for parents (IAM-parent) that allows users to systematically rate and comment on online parenting information. Quantitative data and results: 22,407 IAM ratings were collected; of the initial 32 items, descriptive statistics showed that 10 had low relevance. Qualitative data and results: IAM-based comments were collected, and 20 IAM users were interviewed (maximum variation sample); the qualitative data analysis assessed the representativeness of IAM items, and identified items with problematic wording. Researchers, the program director, and Web editors integrated quantitative and qualitative results, which led to a shorter and clearer IAM-parent.

[1]  Scott E. Sampson.  Ramifications of Monitoring Service Quality Through Passively Solicited Customer Feedback , 1996 .

[2]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[3]  Roland M. Grad,et al.  Four levels of outcomes of information-seeking: A mixed methods study in primary health care , 2013, J. Assoc. Inf. Sci. Technol..

[4]  Pierre Frémont,et al.  Feasibility of a Knowledge Translation CME Program: Courriels Cochrane , 2012, The Journal of continuing education in the health professions.

[5]  Michael S. Garver.  Listening to Customers , 2001 .

[6]  Pierre Pluye,et al.  Evaluation of email alerts in practice: Part 1. Review of the literature on clinical emailing channels. , 2010, Journal of evaluation in clinical practice.

[7]  Pierre Pluye,et al.  Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. , 2014, Annual review of public health.

[8]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[9]  Edward G. Carmines,et al.  Reliability and Validity Assessment , 1979 .

[10]  D. Streiner,et al.  Health measurement scales , 2008 .

[11]  Roland M. Grad,et al.  The value of user feedback: Healthcare professionals' comments to the health information provider , 2015, J. Assoc. Inf. Sci. Technol..

[12]  N. Chumbler,et al.  Implementation of a journal prototype for pregnant and parenting adolescents. , 2014, Evaluation and program planning.

[13]  Samuel Messick,et al.  STANDARDS OF VALIDITY AND THE VALIDITY OF STANDARDS IN PERFORMANCE ASSESSMENT , 2005 .

[14]  T. Schuster,et al.  Assessing and Improving the Use of Online Information About Child Development, Education, Health, and Well-Being in Low-Education, Low-Income Parents: Protocol for a Mixed-Methods Multiphase Study , 2018, JMIR research protocols.

[15]  S. Messick.  Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. , 1994 .

[16]  Mandy Hudson.  Listening to Customers: How EBSCO Plans Enhancements and Product Acquisitions Based on Customer Feedback , 2008, Public Libr. Q..

[17]  Maria Cristiane Barbosa Galvão,et al.  The Clinical Relevance of Information Index (CRII): assessing the relevance of health information to the clinical practice. , 2013, Health information and libraries journal.

[18]  K. Phillips,et al.  Evaluating health inequity interventions: applying a contextual (external) validity framework to programs funded by the Canadian Health Services Research Foundation. , 2013, Evaluation and program planning.

[19]  Roland Pierre Marie-Eve James Bernard Michael Janique Ann Grad,et al.  Validation of a Method to Assess the Clinical Impact of Electronic Knowledge Resources , 2007 .

[20]  Roland M. Grad,et al.  A New Impact Assessment Method to Evaluate Knowledge Resources , 2005, AMIA.

[21]  Ronald W. Thompson,et al.  Implementation assessment of widely used but understudied prevention programs: an illustration from the Common Sense Parenting trial. , 2014, Evaluation and program planning.

[22]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .

[23]  Pierre Pluye,et al.  "Better-than-best" evidence? Using family physicians' feedback for 2-way knowledge translation. , 2014, Canadian family physician Medecin de famille canadien.

[24]  Cameron B Richardson,et al.  Let's get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies. , 2016, Evaluation and program planning.

[25]  Pierre Pluye,et al.  Physician assessments of the value of therapeutic information delivered via e-mail. , 2014, Canadian family physician Medecin de famille canadien.

[26]  S. Haynes,et al.  Content validity in psychological assessment: A functional approach to concepts and methods. , 1995 .

[27]  Pierre Pluye,et al.  Evaluation of email alerts in practice: Part 2. Validation of the information assessment method. , 2010, Journal of evaluation in clinical practice.

[28]  Izaak L Williams,et al.  Web-based tracking methods in longitudinal studies. , 2014, Evaluation and program planning.

[29]  F. Jacobs,et al.  Measuring program- and individual-level fidelity in a home visiting program for adolescent parents. , 2016, Evaluation and program planning.

[30]  Pierre Pluye,et al.  Development and Content Validation of the Information Assessment Method for Patients and Consumers , 2014, JMIR research protocols.

[31]  Moya L. Alfonso,et al.  Application of mixed-methods design in community-engaged research: Lessons learned from an evidence-based intervention for Latinos with chronic illness and minor depression. , 2017, Evaluation and program planning.

[32]  Roland M. Grad,et al.  Physicians' assessment of the value of clinical information: Operationalization of a theoretical model , 2011, J. Assoc. Inf. Sci. Technol..

[33]  P. Pluye,et al.  Number Needed to Benefit From Information (NNBI): Proposal From a Mixed Methods Research Study With Practicing Family Physicians , 2013, The Annals of Family Medicine.

[34]  Jörg Dirmaier,et al.  Usefulness scale for patient information material (USE) - development and psychometric properties , 2015, BMC Medical Informatics and Decision Making.

[35]  Chris L. S. Coryn,et al.  An overview of evidence-based program registers (EBPRs) for behavioral health. , 2015, Evaluation and program planning.

[36]  Roland M. Grad,et al.  An Online Knowledge Resource and Questionnaires as a Continuing Pharmacy Education Tool to Document Reflective Learning , 2012, American Journal of Pharmaceutical Education.

[37]  J. Fisher,et al.  Brief online surveys to monitor and evaluate facilitated peer support groups for caregivers of children with special needs. , 2015, Evaluation and program planning.

[38]  Roland M. Grad,et al.  Health outcomes of online consumer health information: A systematic mixed studies review with framework synthesis , 2019, J. Assoc. Inf. Sci. Technol..

[39]  Lynda A. King,et al.  Focus groups in psychological assessment: enhancing content validity by consulting members of the target population. , 2004, Psychological assessment.

[40]  Pierre Pluye,et al.  In pursuit of a valid information assessment method for continuing education: a mixed methods study , 2013, BMC medical education.

[41]  J. Ruiz,et al.  Supporting parenting of infants: evaluating outcomes for parents and children in a community-based program. , 2013, Evaluation and program planning.

[42]  Pierre Pluye,et al.  IAM: A Comprehensive and Systematic Information Assessment Method for Electronic Knowledge Resources , 2009 .