Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering

This is an overview of the eleventh edition of the BioASQ challenge in the context of the Conference and Labs of the Evaluation Forum (CLEF) 2023. BioASQ is a series of international challenges promoting advances in large-scale biomedical semantic indexing and question answering. This year, BioASQ consisted of new editions of the two established tasks b and Synergy, and a new task (MedProcNER) on semantic annotation of clinical content in Spanish with medical procedures, which have a critical role in medical practice. In this edition of BioASQ, 28 competing teams submitted the results of more than 150 distinct systems in total for the three different shared tasks of the challenge. Similarly to previous editions, most of the participating systems achieved competitive performance, suggesting the continuous advancement of the state-of-the-art in the field.

[1]  Marian-Andrei Rizoiu,et al.  Enhancing Biomedical Text Summarization and Question-Answering: On the Utility of Domain-Specific Pre-Training , 2023, CLEF.

[2]  Udo Kruschwitz,et al.  Is ChatGPT a Biomedical Expert? , 2023, CLEF.

[3]  G. Paliouras,et al.  BioASQ-QA: A manually curated corpus for Biomedical Question Answering , 2022, bioRxiv.

[4]  G. Paliouras,et al.  Overview of BioASQ 2022: The Tenth BioASQ Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering , 2022, CLEF.

[5]  Georgios Paliouras,et al.  Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering , 2021, CLEF.

[6]  Zaiqiao Meng,et al.  Self-Alignment Pretraining for Biomedical Entity Representations , 2020, NAACL.

[7]  Martin Krallinger,et al.  Overview of BioASQ 2020: The Eighth BioASQ Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering , 2020, CLEF.

[8]  Roberto Basili,et al.  GAN-BERT: Generative Adversarial Learning for Robust Text Classification with a Bunch of Labeled Examples , 2020, ACL.

[9]  Omer Levy,et al.  RoBERTa: A Robustly Optimized BERT Pretraining Approach , 2019, ArXiv.

[10]  Eric Nyberg,et al.  Learning to Answer Biomedical Questions: OAQA at BioASQ 4B , 2016 .

[11]  Zhiyong Lu,et al.  Beyond accuracy: creating interoperable and scalable text-mining web services , 2016, Bioinform..

[12]  Georgios Balikas,et al.  An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition , 2015, BMC Bioinformatics.

[13]  Martin Krallinger,et al.  Mention detection, normalization & classification of species, pathogens, humans and food in clinical documents: Overview of the LivingNER shared task and resources , 2022, Proces. del Leng. Natural.

[14]  M. Reczko.  ELECTROLBERT: Combining Replaced Token Detection and Sentence Order Prediction , 2022, Conference and Labs of the Evaluation Forum.

[15]  G. Paliouras,et al.  BioASQ at CLEF2022: The Tenth Edition of the Large-scale Biomedical Semantic Indexing and Question Answering Challenge , 2022, European Conference on Information Retrieval.

[16]  G. Paliouras,et al.  Overview of DisTEMIST at BioASQ: Automatic detection and normalization of diseases from clinical texts: results, methods, evaluation and multilingual resources , 2022, CLEF.

[17]  Diego Mollá Aliod.  Query-focused Extractive Summarisation for Biomedical and COVID-19 Complex Question Answering , 2022, CLEF.

[18]  Georgios Paliouras,et al.  Overview of BioASQ 2021-MESINESP track. Evaluation of advance hierarchical classification techniques for scientific literature, patents and clinical trials , 2021, CLEF.

[19]  Ibrahim Burak Özyurt,et al.  End-to-end Biomedical Question Answering via Bio-AnswerFinder and Discriminative Language Representation Models , 2021, CLEF.