|国家预印本平台
首页|一种AI平台算法库设计与实现

一种AI平台算法库设计与实现

esign and implementation of an algorithm library for AI platform

中文摘要英文摘要

近年来,为了缓解在AI业务生产和发展过程中出现的技术债,诞生了AI中台和MLOps技术,然而,现有的AI中台和MLOps框架对于解决深度学习算法训练过程中数据集治理层面的技术债,却做的并不完善。在本文中,基于Kubernetes和微服务架构设计并实现了一个AI中台,该AI中台包括入口页面、训练中心、原型中心和算法库。由于在平台中对于算法进行组件化调度、训练中心对于数据集治理的支持以及算法库和平台功能的良好对接,使得在所设计AI中台中能够沉淀和复用多框架、多领域的AI算法,且使用者可以在减少技术债的前提下,灵活地在训练中对于数据集进行增减,并进行一键部署。本文详细阐述了在该AI中台中算法库的设计以及算法在该平台中从集成到部署的完整生命周期。

In the field of deep learning, it has become a challenging research to mitigate the impact of differences between different scenarios on model performance, and unsupervised domain adaptationon semantic segmentation is one of the classical tasks. Currently, unsupervised domain adaptation methods based on self-training have achieved good results, however, the existence of hard categories makes it difficult to obtain better performance, and the incorrect pseudo-labelin the target domain further hinders the optimization of cross-domain segmentation. To address the above problems, this paper proposes a cross-image hard-awareaugmentation and a Mean-Teacherbased consistency constraint, respectively, to enhance the proportion of hard category in the pseudo-label and improve the robustness of the cross-domain segmentation model. Experiments are conducted on GTA5-to-Cityscapes and SYNTHIA-to-Cityscapes and both objective metrics and visualization results demonstrate the effectiveness of the proposed methods in this paper.

尹子闻、刘芳

计算技术、计算机技术

深度学习I中台技术债Kubernetes数据集治理算法库

deep learningAI middle platformtechnical debtKubernetesdata set governancealgorithm library

尹子闻,刘芳.一种AI平台算法库设计与实现[EB/OL].(2023-05-12)[2025-08-04].http://www.paper.edu.cn/releasepaper/content/202305-62.点此复制

评论