|国家预印本平台
首页|Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration

Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration

Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration

来源:Arxiv_logoArxiv
英文摘要

While diffusion models demonstrate strong generative capabilities in image restoration (IR) tasks, their complex architectures and iterative processes limit their practical application compared to mainstream reconstruction-based general ordinary IR networks. Existing approaches primarily focus on optimizing network architecture and diffusion paths but overlook the integration of the diffusion training paradigm within general ordinary IR frameworks. To address these challenges, this paper elucidates key principles for adapting the diffusion training paradigm to general IR training through systematic analysis of time-step dependencies, network hierarchies, noise-level relationships, and multi-restoration task correlations, proposing a new IR framework supported by diffusion-based training. To enable IR networks to simultaneously restore images and model generative representations, we introduce a series of regularization strategies that align diffusion objectives with IR tasks, improving generalization in single-task scenarios. Furthermore, recognizing that diffusion-based generation exerts varying influences across different IR tasks, we develop an incremental training paradigm and task-specific adaptors, further enhancing performance in multi-task unified IR. Experiments demonstrate that our method significantly improves the generalization of IR networks in single-task IR and achieves superior performance in multi-task unified IR. Notably, the proposed framework can be seamlessly integrated into existing general IR architectures.

Xin Lu、Xueyang Fu、Jie Xiao、Zihao Fan、Yurui Zhu、Zheng-Jun Zha

电子技术应用计算技术、计算机技术

Xin Lu,Xueyang Fu,Jie Xiao,Zihao Fan,Yurui Zhu,Zheng-Jun Zha.Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration[EB/OL].(2025-06-26)[2025-07-09].https://arxiv.org/abs/2506.21722.点此复制

评论