|国家预印本平台
首页|基于边缘计算的任务卸载优化:深度强化学习方法

基于边缘计算的任务卸载优化:深度强化学习方法

Base on Edge Computing and Task Offloading Optimization: A Deep Reinforcement Learning Approach

中文摘要英文摘要

近年来,随着物联网、大数据、机器人、人工智能等现代电子信息技术和产业的蓬勃发展,边缘计算有着迫切的应用场景需求。在处理计算卸载和任务调度的优化问题时,面对日益增长的设备数据、用户需求和场景变化等挑战,传统的凸优化、启发式算法和强化学习等方法,并不能应对爆炸式的增长。深度强化学习能够很好地解决这一问题,它依靠深度神经网络,适用于大状态空间。 本文基于边缘计算和强化学习平台,针对传统神经网络中的三层全连接结构,发现全连接神经网络在边缘计算优化中存在训练速度慢、对数据的过滤不足和过拟合等问题。本文进一步采用了前馈神经网络和自动编码器的网络结构,测试并对比了不同隐藏层层数和激活函数等参数的训练性能,使收敛时间缩短了18.4%。本文的研究结果将有助于研究和操作人员在移动边缘计算优化中选择神经网络。

In recent years, with the booming development of modern electronic information technologies and industries, such as the Internet of Things (IoTs), big data, robots and artificial intelligence, mobile edge computing thus has urgent application scenario needs. To deal with the optimization problem on computing offloading and task scheduling, traditional methods like convex optimization, heuristic algorithm and reinforcement learning, are short at explosive growth challenges from increasing number of devices and date, user needs and changing scenarios. Fortunately, deep reinforcement learning is a good solution to this problem, which relies on deep neural network, and has become quite suitable for large state space. This paper is based on an edge computing and reinforcement learning platform. With regard to the three-layer fully connected structure of traditional neural network, nevertheless, such a fully connected neural network has to face some problems. For instance, low training efficiency, insufficient data filtering and over-fitting. Therefore, this dissertation has adopted the neural network structure of feed-forward and auto-encoder, tested and compared the training performance of parameters with different hidden layers and Activation Function. As a result, the convergence time can be shortened by 18.4%. The results of this paper would help researchers and operators to choose neural networks for the mobile edge computing optimizations.

王锦涛、诸葛斌

计算技术、计算机技术通信电子技术应用

边缘计算最优化问题深度强化学习

Edge computation Optimization Problems Deep Reinforcement Learning

王锦涛,诸葛斌.基于边缘计算的任务卸载优化:深度强化学习方法[EB/OL].(2022-12-14)[2025-08-10].http://www.paper.edu.cn/releasepaper/content/202212-49.点此复制

评论