Fostering Scientific Meta-analyses with Knowledge Graphs: A Case-Study

A meta-analysis is a Science of Science method widely used in the medical and social sciences to review, aggregate and quantitatively synthesise a body of studies that address the same research question. With the volume of research growing exponentially every year, conducting meta-analyses can be costly and inefficient, as a significant amount of time and human efforts needs to be spent in finding studies meeting research criteria, annotating them, and properly performing the statistical analyses to summarise the findings. In this work, we show these issues can be tackled with semantic representations and technologies, using a social science scenario as case-study. We show how the domain-specific content of research outputs can be represented and used to facilitate their search, analysis and synthesis. We present the very first representation of the domain of human cooperation, and the application we built on top of this to help experts in performing meta-analyses semi-automatically. Using few application scenarios, we show how our approach supports the various phases meta-analyses, and more in general contributes towards research replication and automated hypotheses generation.

[1]  Carole Goble,et al.  Sharing interoperable workflow provenance: A review of best practices and their practical application in CWLProv , 2019, GigaScience.

[2]  Daniel Balliet,et al.  Social Dilemmas: Understanding the Psychology of Human Cooperation. , 2013 .

[3]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[4]  Carole A. Goble,et al.  Workflow-Centric Research Objects: A First Class Citizen in the Scholarly Discourse , 2012, SePublica@ESWC.

[5]  Mark Gahegan,et al.  Ontology use for semantic e-Science , 2010, Semantic Web.

[6]  Feng Li,et al.  An Introduction to Metaanalysis , 2005 .

[7]  Dan Brickley,et al.  Google Dataset Search: Building a search engine for datasets in an open Web ecosystem , 2019, WWW.

[8]  T Greco,et al.  Review Article , 2022 .

[9]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[10]  Andrew W. Brown,et al.  Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry , 2017, BMJ Open.

[11]  Paul T. Groth,et al.  The anatomy of a nanopublication , 2010, Inf. Serv. Use.

[12]  Jessica Gurevitch,et al.  Meta-analysis and the science of research synthesis , 2018, Nature.

[13]  Neil Malhotra,et al.  Publication bias in the social sciences: Unlocking the file drawer , 2014, Science.

[14]  S. Yusuf,et al.  Strengths and limitations of meta-analysis: larger studies may be more reliable. , 1997, Controlled clinical trials.

[15]  Michael Schroeder,et al.  GoWeb: a semantic search engine for the life science web , 2009, BMC Bioinformatics.

[16]  Enrico Motta,et al.  An Incremental Learning Method to Support the Annotation of Workflows with Data-to-Data Relations , 2016, EKAW.

[17]  Carole A. Goble,et al.  Common motifs in scientific workflows: An empirical analysis , 2012, 2012 IEEE 8th International Conference on E-Science.

[18]  I Olkin,et al.  Meta-analysis: reconciling the results of independent studies. , 1995, Statistics in Medicine.

[19]  I Olkin,et al.  Comparison of effect estimates from a meta-analysis of summary data from published studies and from a meta-analysis using individual patient data for ovarian cancer studies. , 1997, American journal of epidemiology.

[20]  Frank A. Bosco,et al.  MetaBUS as a vehicle for facilitating meta-analysis , 2017 .

[21]  E. Tacconelli Systematic reviews: CRD's guidance for undertaking reviews in health care , 2010 .

[22]  Michael C. Frank,et al.  Promoting Replicability in Developmental Research Through Meta‐analyses: Insights From Language Acquisition Research , 2018, Child development.

[23]  M. S. Avila-Garcia,et al.  From Peer-Reviewed to Peer-Reproduced in Scholarly Publishing: The Complementary Roles of Data Models and Workflows in Bioinformatics , 2015, PloS one.

[24]  Rinke Hoekstra,et al.  The dataLegend Ecosystem for Historical Statistics , 2018, J. Web Semant..

[25]  Yolanda Gil,et al.  The DISK Hypothesis Ontology: Capturing Hypothesis Evolution for Automated Discovery , 2017, K-CAP Workshops.

[26]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[27]  Fabio Vitali,et al.  The Publishing Workflow Ontology (PWO) , 2017, Semantic Web.

[28]  Wei Hu,et al.  BioSearch: a semantic search engine for Bio2RDF , 2017, Database J. Biol. Databases Curation.

[29]  Diogo R. Ferreira,et al.  Ontology-Based Discovery of Workflow Activity Patterns , 2011, Business Process Management Workshops.

[30]  Robert A Parker,et al.  BMC Medical Research Methodology BioMed Central BMC 22002, Medical Research Methodology , 2001 .