Skip to main content

2024 | OriginalPaper | Buchkapitel

BioASQ at CLEF2024: The Twelfth Edition of the Large-Scale Biomedical Semantic Indexing and Question Answering Challenge

verfasst von : Anastasios Nentidis, Anastasia Krithara, Georgios Paliouras, Martin Krallinger, Luis Gasco Sanchez, Salvador Lima, Eulalia Farre, Natalia Loukachevitch, Vera Davydova, Elena Tutubalina

Erschienen in: Advances in Information Retrieval

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The large-scale biomedical semantic indexing and question-answering challenge (BioASQ) aims at the continuous advancement of methods and tools to meet the needs of biomedical researchers and practitioners for efficient and precise access to the ever-increasing resources of their domain. With this purpose, during the last eleven years, a series of annual challenges have been organized with specific shared tasks on large-scale biomedical semantic indexing and question answering. Benchmark datasets have been concomitantly provided in alignment with the real needs of biomedical experts, providing a unique common testbed where different teams around the world can investigate and compare new approaches for accessing biomedical knowledge.
The twelfth version of the BioASQ Challenge will be held as an evaluation Lab within CLEF2024 providing four shared tasks: (i) Task b on the information retrieval for biomedical questions, and the generation of comprehensible answers. (ii) Task Synergy the information retrieval and generation of answers for open biomedical questions on developing topics, in collaboration with the experts posing the questions. (iii) Task MultiCardioNER on the automated annotation of clinical entities in medical documents in the field of cardiology, primarily in Spanish, English, Italian and Dutch. (iv) Task BioNNE on the automated annotation of biomedical documents in Russian and English with nested named entity annotations. As BioASQ rewards the methods that outperform the state of the art in these shared tasks, it pushes the research frontier towards approaches that accelerate access to biomedical knowledge.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
3
Since the first BioASQ, the task on large-scale biomedical semantic indexing is called Task a, and the task on biomedical QA is called Task b, for brevity. After the completion of Task a [5], we keep this naming convention for Task b for consistency.
 
Literatur
1.
Zurück zum Zitat Gasco, L., et al.: Overview of BioASQ 2021-MESINESP track. Evaluation of advance hierarchical classification techniques for scientific literature, patents and clinical trials. CEUR Workshop Proceedings (2021) Gasco, L., et al.: Overview of BioASQ 2021-MESINESP track. Evaluation of advance hierarchical classification techniques for scientific literature, patents and clinical trials. CEUR Workshop Proceedings (2021)
2.
Zurück zum Zitat Gonzalez-Agirre, A., Marimon, M., Intxaurrondo, A., Rabal, O., Villegas, M., Krallinger, M.: Pharmaconer: pharmacological substances, compounds and proteins named entity recognition track. In: Proceedings of The 5th Workshop on BioNLP Open Shared Tasks, pp. 1–10 (2019) Gonzalez-Agirre, A., Marimon, M., Intxaurrondo, A., Rabal, O., Villegas, M., Krallinger, M.: Pharmaconer: pharmacological substances, compounds and proteins named entity recognition track. In: Proceedings of The 5th Workshop on BioNLP Open Shared Tasks, pp. 1–10 (2019)
3.
Zurück zum Zitat Kosmopoulos, A., Partalas, I., Gaussier, E., Paliouras, G., Androutsopoulos, I.: Evaluation measures for hierarchical classification: a unified view and novel approaches. Data Min. Knowl. Disc. 29(3), 820–865 (2015)MathSciNetCrossRef Kosmopoulos, A., Partalas, I., Gaussier, E., Paliouras, G., Androutsopoulos, I.: Evaluation measures for hierarchical classification: a unified view and novel approaches. Data Min. Knowl. Disc. 29(3), 820–865 (2015)MathSciNetCrossRef
6.
Zurück zum Zitat Krithara, A., Nentidis, A., Bougiatiotis, K., Paliouras, G.: BioASQ-QA: a manually curated corpus for Biomedical Question Answering. bioRxiv (2022) Krithara, A., Nentidis, A., Bougiatiotis, K., Paliouras, G.: BioASQ-QA: a manually curated corpus for Biomedical Question Answering. bioRxiv (2022)
7.
Zurück zum Zitat Krithara, A., Nentidis, A., Paliouras, G., Krallinger, M., Miranda, A.: BioASQ at CLEF2021: large-scale biomedical semantic indexing and question answering. In: Hiemstra, D., Moens, M.F., Mothe, J., Perego, R., Potthast, M., Sebastiani, F. (eds.) ECIR 2021. LNCS, vol. 12657, pp. 624–630. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-72240-1_73CrossRef Krithara, A., Nentidis, A., Paliouras, G., Krallinger, M., Miranda, A.: BioASQ at CLEF2021: large-scale biomedical semantic indexing and question answering. In: Hiemstra, D., Moens, M.F., Mothe, J., Perego, R., Potthast, M., Sebastiani, F. (eds.) ECIR 2021. LNCS, vol. 12657, pp. 624–630. Springer, Cham (2021). https://​doi.​org/​10.​1007/​978-3-030-72240-1_​73CrossRef
8.
Zurück zum Zitat Lima-López, S., et al.: Overview of MedProcNER task on medical procedure detection and entity linking at BioASQ 2023. In: CEUR Workshop Proceedings (2023) Lima-López, S., et al.: Overview of MedProcNER task on medical procedure detection and entity linking at BioASQ 2023. In: CEUR Workshop Proceedings (2023)
9.
Zurück zum Zitat Lima-López, S., et al.: Overview of medprocner task on medical procedure detection and entity linking at bioasq 2023. Working Notes of CLEF (2023) Lima-López, S., et al.: Overview of medprocner task on medical procedure detection and entity linking at bioasq 2023. Working Notes of CLEF (2023)
10.
Zurück zum Zitat Loukachevitch, N., et al.: NEREL: a Russian dataset with nested named entities, relations and events. In: Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), pp. 876–885. INCOMA Ltd., Held Online (2021). https://aclanthology.org/2021.ranlp-1.100 Loukachevitch, N., et al.: NEREL: a Russian dataset with nested named entities, relations and events. In: Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), pp. 876–885. INCOMA Ltd., Held Online (2021). https://​aclanthology.​org/​2021.​ranlp-1.​100
11.
Zurück zum Zitat Loukachevitch, N., et al.: NEREL-BIO: a dataset of biomedical abstracts annotated with nested named entities. Bioinformatics 39(4), btad161 (2023) Loukachevitch, N., et al.: NEREL-BIO: a dataset of biomedical abstracts annotated with nested named entities. Bioinformatics 39(4), btad161 (2023)
13.
Zurück zum Zitat Miranda-Escalada, A., et al.: Overview of DisTEMIST at BioASQ: automatic detection and normalization of diseases from clinical texts: results, methods, evaluation and multilingual resources. In: Working Notes of Conference and Labs of the Evaluation (CLEF) Forum. CEUR Workshop Proceedings (2022) Miranda-Escalada, A., et al.: Overview of DisTEMIST at BioASQ: automatic detection and normalization of diseases from clinical texts: results, methods, evaluation and multilingual resources. In: Working Notes of Conference and Labs of the Evaluation (CLEF) Forum. CEUR Workshop Proceedings (2022)
14.
Zurück zum Zitat Mork, J., Aronson, A., Demner-Fushman, D.: 12 years on-Is the NLM medical text indexer still useful and relevant? J. Biomed. Semant. 8(1), 8 (2017)CrossRef Mork, J., Aronson, A., Demner-Fushman, D.: 12 years on-Is the NLM medical text indexer still useful and relevant? J. Biomed. Semant. 8(1), 8 (2017)CrossRef
15.
Zurück zum Zitat Mork, J., Jimeno-Yepes, A., Aronson, A.: The NLM Medical Text Indexer System for Indexing Biomedical Literature (2013) Mork, J., Jimeno-Yepes, A., Aronson, A.: The NLM Medical Text Indexer System for Indexing Biomedical Literature (2013)
17.
Zurück zum Zitat Nentidis, A., Katsimpras, G., Krithara, A., Paliouras, G.: Overview of BioASQ tasks 11b and Synergy11 in CLEF2023. In: CEUR Workshop Proceedings (2023) Nentidis, A., Katsimpras, G., Krithara, A., Paliouras, G.: Overview of BioASQ tasks 11b and Synergy11 in CLEF2023. In: CEUR Workshop Proceedings (2023)
20.
Zurück zum Zitat Nentidis, A., Katsimpras, G., Vandorou, E., Krithara, A., Paliouras, G.: Overview of BioASQ tasks 9a, 9b and synergy in CLEF2021. In: Proceedings of the 9th BioASQ Workshop A Challenge on Large-scale Biomedical Semantic Indexing and Question Answering. CEUR Workshop Proceedings (2021). https://ceur-ws.org/Vol-2936/paper-10.pdf Nentidis, A., Katsimpras, G., Vandorou, E., Krithara, A., Paliouras, G.: Overview of BioASQ tasks 9a, 9b and synergy in CLEF2021. In: Proceedings of the 9th BioASQ Workshop A Challenge on Large-scale Biomedical Semantic Indexing and Question Answering. CEUR Workshop Proceedings (2021). https://​ceur-ws.​org/​Vol-2936/​paper-10.​pdf
21.
Zurück zum Zitat Nentidis, A., Katsimpras, G., Vandorou, E., Krithara, A., Paliouras, G.: Overview of BioASQ tasks 10a, 10b and Synergy10 in CLEF2022. In: CEUR Workshop Proceedings, vol. 3180, pp. 171–178 (2022) Nentidis, A., Katsimpras, G., Vandorou, E., Krithara, A., Paliouras, G.: Overview of BioASQ tasks 10a, 10b and Synergy10 in CLEF2022. In: CEUR Workshop Proceedings, vol. 3180, pp. 171–178 (2022)
22.
Zurück zum Zitat Nentidis, A., Krithara, A., Paliouras, G., Farre-Maduell, E., Lima-Lopez, S., Krallinger, M.: BioASQ at CLEF2023: the eleventh edition of the large-scale biomedical semantic indexing and question answering challenge. In: Kamps, J., et al. (eds.) ECIR 2023. LNCS, vol. 13982, pp. 577–584. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-28241-6_66CrossRef Nentidis, A., Krithara, A., Paliouras, G., Farre-Maduell, E., Lima-Lopez, S., Krallinger, M.: BioASQ at CLEF2023: the eleventh edition of the large-scale biomedical semantic indexing and question answering challenge. In: Kamps, J., et al. (eds.) ECIR 2023. LNCS, vol. 13982, pp. 577–584. Springer, Cham (2023). https://​doi.​org/​10.​1007/​978-3-031-28241-6_​66CrossRef
23.
Zurück zum Zitat Nentidis, A., Krithara, A., Paliouras, G., Gasco, L., Krallinger, M.: BioASQ at CLEF2022: the tenth edition of the large-scale biomedical semantic indexing and question answering challenge. In: Hagen, M., et al. (eds.) ECIR 2022. LNCS, vol. 13186, pp. 429–435. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-99739-7_53CrossRef Nentidis, A., Krithara, A., Paliouras, G., Gasco, L., Krallinger, M.: BioASQ at CLEF2022: the tenth edition of the large-scale biomedical semantic indexing and question answering challenge. In: Hagen, M., et al. (eds.) ECIR 2022. LNCS, vol. 13186, pp. 429–435. Springer, Cham (2022). https://​doi.​org/​10.​1007/​978-3-030-99739-7_​53CrossRef
25.
Zurück zum Zitat Rodriguez-Penagos, C., et al.: Overview of MESINESP8, a Spanish Medical Semantic Indexing Task within BioASQ 2020 (2020) Rodriguez-Penagos, C., et al.: Overview of MESINESP8, a Spanish Medical Semantic Indexing Task within BioASQ 2020 (2020)
Metadaten
Titel
BioASQ at CLEF2024: The Twelfth Edition of the Large-Scale Biomedical Semantic Indexing and Question Answering Challenge
verfasst von
Anastasios Nentidis
Anastasia Krithara
Georgios Paliouras
Martin Krallinger
Luis Gasco Sanchez
Salvador Lima
Eulalia Farre
Natalia Loukachevitch
Vera Davydova
Elena Tutubalina
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-56069-9_67

Premium Partner