深度学习计算图优化综述
n Overview of Deep Learning Computation Graph Optimization
随着深度学习的发展,深度学习模型的规模变得更大、结构更加复杂,如何加快深度学习模型的计算引起了研究人员的关注。本文首先介绍了深度学习计算图,然后从近几年的研究成果中介绍了基于计算图的优化方式,包括设备放置优化、基于图替换的优化以及相关联合优化,并根据算法的不同介绍了相关研究的成果,包括回溯、动态规划等传统算法以及基于深度强化学习的算法。
With the development of deep learning, the scale of deep learning models has become larger and more complex, and how to speed up the computation of deep learning models has attracted the attention of researchers. In this thesis, we first introduce the deep learning computational graph, and then introduce the optimization methods based on the computational graph from the research results in recent years, including device placement optimization, optimization based on graph replacement and related joint optimization, and introduce the results of related research according to the algorithms, including traditional algorithms such as backtracking and dynamic programming, as well as algorithms based on deep reinforcement learning.
刘维雨、雷友珣
计算技术、计算机技术
深度学习计算图设备放置优化图替换深度强化学习
deep learning computation graphdevice placement optimizationgraph substitutiondeep reinforcement learning
刘维雨,雷友珣.深度学习计算图优化综述[EB/OL].(2022-03-22)[2025-08-21].http://www.paper.edu.cn/releasepaper/content/202203-330.点此复制
评论