|国家预印本平台
首页|RMIT-ADM+S at the SIGIR 2025 LiveRAG Challenge

RMIT-ADM+S at the SIGIR 2025 LiveRAG Challenge

RMIT-ADM+S at the SIGIR 2025 LiveRAG Challenge

来源:Arxiv_logoArxiv
英文摘要

This paper presents the RMIT--ADM+S participation in the SIGIR 2025 LiveRAG Challenge. Our Generation-Retrieval-Augmented Generation (GRAG) approach relies on generating a hypothetical answer that is used in the retrieval phase, alongside the original question. GRAG also incorporates a pointwise large language model (LLM)-based re-ranking step prior to final answer generation. We describe the system architecture and the rationale behind our design choices. In particular, a systematic evaluation using the Grid of Points (GoP) framework and N-way ANOVA enabled comparison across multiple configurations, including query variant generation, question decomposition, rank fusion strategies, and prompting techniques for answer generation. Our system achieved a Relevance score of 1.199 and a Faithfulness score of 0.477 on the private leaderboard, placing among the top four finalists in the LiveRAG 2025 Challenge.

Kun Ran、Shuoqi Sun、Khoi Nguyen Dinh Anh、Damiano Spina、Oleg Zendel

计算技术、计算机技术

Kun Ran,Shuoqi Sun,Khoi Nguyen Dinh Anh,Damiano Spina,Oleg Zendel.RMIT-ADM+S at the SIGIR 2025 LiveRAG Challenge[EB/OL].(2025-06-17)[2025-06-29].https://arxiv.org/abs/2506.14516.点此复制

评论