|国家预印本平台
首页|Fast-DataShapley: Neural Modeling for Training Data Valuation

Fast-DataShapley: Neural Modeling for Training Data Valuation

Fast-DataShapley: Neural Modeling for Training Data Valuation

来源:Arxiv_logoArxiv
英文摘要

The value and copyright of training data are crucial in the artificial intelligence industry. Service platforms should protect data providers' legitimate rights and fairly reward them for their contributions. Shapley value, a potent tool for evaluating contributions, outperforms other methods in theory, but its computational overhead escalates exponentially with the number of data providers. Recent works based on Shapley values attempt to mitigate computation complexity by approximation algorithms. However, they need to retrain for each test sample, leading to intolerable costs. We propose Fast-DataShapley, a one-pass training method that leverages the weighted least squares characterization of the Shapley value to train a reusable explainer model with real-time reasoning speed. Given new test samples, no retraining is required to calculate the Shapley values of the training data. Additionally, we propose three methods with theoretical guarantees to reduce training overhead from two aspects: the approximate calculation of the utility function and the group calculation of the training data. We analyze time complexity to show the efficiency of our methods. The experimental evaluations on various image datasets demonstrate superior performance and efficiency compared to baselines. Specifically, the performance is improved to more than 2.5 times, and the explainer's training speed can be increased by two orders of magnitude.

Haifeng Sun、Yu Xiong、Runze Wu、Xinyu Cai、Changjie Fan、Lan Zhang、Xiang-Yang Li

计算技术、计算机技术

Haifeng Sun,Yu Xiong,Runze Wu,Xinyu Cai,Changjie Fan,Lan Zhang,Xiang-Yang Li.Fast-DataShapley: Neural Modeling for Training Data Valuation[EB/OL].(2025-06-05)[2025-07-23].https://arxiv.org/abs/2506.05281.点此复制

评论