|国家预印本平台
首页|云存储中的元数据管理方法研究

云存储中的元数据管理方法研究

Metadata Management Scheme for Cloud Storage

中文摘要英文摘要

针对HDFS单一名字节点架构在云存储环境下很容易形成性能瓶颈的问题,提出了一种改进的基于HDFS的元数据管理方案。改进方案使用分布式的名字节点集群,首先将元数据划分到"桶"中,再将这些桶均匀的分布到名字节点集群中,并随着系统负载的变化而动态调整。元数据使用"日志副本"的方法进行复制,使用Paxos算法维持副本的一致性。另外,改进算法还使用了缓存和预抓取技术。实验结果表明,与单一名字节点相比,改进方案有效地提高了元数据的读写性能。

he single Namenode architecture can't meet the exponentially increased storage demand in cloud computing, and may become a performance bottleneck. This paper presents a metadata management scheme based on HDFS for cloud storage. Our scheme employs multiple Namenodes, and divides the metadata into "buckets" which can be dynamically migrated among Namenodes according to system workloads. To maintain reliability, metadata is replicated in different Namenodes with log replication technology, and Paxos algorithm is adopted to keep replication consensus. Besides, caching and prefetching technology is integrated to improve system performance. Test result shows that our system has a well performance for metadata reading and writing.

杨俊、何玉涛

计算技术、计算机技术

云计算HDFS元数据管理备份Paxos

loud computingHDFSMetadata managementReplicationPaxos

杨俊,何玉涛.云存储中的元数据管理方法研究[EB/OL].(2011-11-11)[2025-08-03].http://www.paper.edu.cn/releasepaper/content/201111-199.点此复制

评论