|国家预印本平台
首页|Hadoop集群公平调度算法的改进

Hadoop集群公平调度算法的改进

n Improved Hadoop Fair Scheduling Algorithm

中文摘要英文摘要

对于基于特定系统和应用建立的Hadoop集群,任务的作业优先级别有显著差异。此时原有的公平调度算法并不能很好地利用资源并完成相应要求。本文提出了Hadoop公平调度算法的改进算法,根据作业优先级别来控制是否进行资源抢占。实验表明,使用改进后的公平调度算法,能够保证重要的作业在运行时不会被低级别的作业抢占资源,并且在一定时间内提交的作业始终是最重要的作业先完成。

For some specific system and applications, jobs are almost same size, but have clearly defined priorities. The original fair scheduler can't satisfy this need. We propose a improved fair scheduler to control slots preemption based on the job priority which it is only used as job weight in original scheduler. The experiments' results show that the improved scheduler can guarantee that the preemption won't happen between running high-level job and new low-level job and it's always the most important job first completed in a certain time.

谷利泽、徐国胜、张晓莉

计算技术、计算机技术

hadoop公平调度器作业资源抢占?????

hadoopfair schedulerjobpreemption

谷利泽,徐国胜,张晓莉.Hadoop集群公平调度算法的改进[EB/OL].(2013-10-23)[2025-08-06].http://www.paper.edu.cn/releasepaper/content/201310-302.点此复制

评论