SemEval-2025 Task 5: LLMs4Subjects -- LLM-based Automated Subject Tagging for a National Technical Library's Open-Access Catalog
SemEval-2025 Task 5: LLMs4Subjects -- LLM-based Automated Subject Tagging for a National Technical Library's Open-Access Catalog
We present SemEval-2025 Task 5: LLMs4Subjects, a shared task on automated subject tagging for scientific and technical records in English and German using the GND taxonomy. Participants developed LLM-based systems to recommend top-k subjects, evaluated through quantitative metrics (precision, recall, F1-score) and qualitative assessments by subject specialists. Results highlight the effectiveness of LLM ensembles, synthetic data generation, and multilingual processing, offering insights into applying LLMs for digital library classification.
Diana Slawig、Jennifer D'Souza、Sameer Sadruddin、Holger Israel、Mathias Begoin
计算技术、计算机技术常用外国语
Diana Slawig,Jennifer D'Souza,Sameer Sadruddin,Holger Israel,Mathias Begoin.SemEval-2025 Task 5: LLMs4Subjects -- LLM-based Automated Subject Tagging for a National Technical Library's Open-Access Catalog[EB/OL].(2025-04-09)[2025-04-26].https://arxiv.org/abs/2504.07199.点此复制
评论