|国家预印本平台
首页|WebTrust: An AI-Driven Data Scoring System for Reliable Information Retrieval

WebTrust: An AI-Driven Data Scoring System for Reliable Information Retrieval

WebTrust: An AI-Driven Data Scoring System for Reliable Information Retrieval

来源:Arxiv_logoArxiv
英文摘要

As access to information becomes more open and widespread, people are increasingly using AI tools for assistance. However, many of these tools struggle to estimate the trustworthiness of the information. Although today's search engines include AI features, they often fail to offer clear indicators of data reliability. To address this gap, we introduce WebTrust, a system designed to simplify the process of finding and judging credible information online. Built on a fine-tuned version of IBM's Granite-1B model and trained on a custom dataset, WebTrust works by assigning a reliability score (from 0.1 to 1) to each statement it processes. In addition, it offers a clear justification for why a piece of information received that score. Evaluated using prompt engineering, WebTrust consistently achieves superior performance compared to other small-scale LLMs and rule-based approaches, outperforming them across all experiments on MAE, RMSE, and R2. User testing showed that when reliability scores are displayed alongside search results, people feel more confident and satisfied with the information they find. With its accuracy, transparency, and ease of use, WebTrust offers a practical solution to help combat misinformation and make trustworthy information more accessible to everyone.

Aleksandr Algazinov、Satyam Kumar Navneet、Rim El Filali、Joydeep Chandra、Matt Laing、Andrew Hanna

计算技术、计算机技术

Aleksandr Algazinov,Satyam Kumar Navneet,Rim El Filali,Joydeep Chandra,Matt Laing,Andrew Hanna.WebTrust: An AI-Driven Data Scoring System for Reliable Information Retrieval[EB/OL].(2025-06-04)[2025-06-24].https://arxiv.org/abs/2506.12072.点此复制

评论