No Gold Standard, No Problem: Reference-Free Evaluation of Taxonomies
No Gold Standard, No Problem: Reference-Free Evaluation of Taxonomies
We introduce two reference-free metrics for quality evaluation of taxonomies. The first metric evaluates robustness by calculating the correlation between semantic and taxonomic similarity, covering a type of error not handled by existing metrics. The second uses Natural Language Inference to assess logical adequacy. Both metrics are tested on five taxonomies and are shown to correlate well with F1 against gold-standard taxonomies.
Pascal Wullschleger、Majid Zarharan、Donnacha Daly、Marc Pouly、Jennifer Foster
计算技术、计算机技术
Pascal Wullschleger,Majid Zarharan,Donnacha Daly,Marc Pouly,Jennifer Foster.No Gold Standard, No Problem: Reference-Free Evaluation of Taxonomies[EB/OL].(2025-05-16)[2025-06-13].https://arxiv.org/abs/2505.11470.点此复制
评论