OLAP数据库跨集群复制机制的设计与实现
esign and Implementation of Cross-Cluster Replication Mechanism for OLAP Databases
本文设计了一种针对OLAP（ Online Analytical Processing，联机分析处理）数据库库与表级别的跨集群复制（Cross-Cluster Replication，CCR）机制，利用可灵活部署的轻量进程ccr-syncer，以建立同步任务的方式控制源集群与目的集群数据的异步复制进度，实现在指定时间间隔内将源集群的数据变更同步到目标集群的目的。ccr-syncer设计的实现基于Share Engine架构下开源OLAP数据库Doris，涉及到Doris的相关功能已于Doris2.0版本后合并入其代码库主分支，其功能的可靠性也得到了生产环境的验证。
his paper designs a Cross-Cluster Replication (CCR) mechanism targeting OLAP (Online Analytical Processing) databases at the library and table levels. Leveraging the deployable lightweight process, ccr-syncer, synchronisation tasks are established to control the asynchronous replication progress of data between source and destination clusters. This enables the synchronization of data changes from the source cluster to the destination cluster within specified time intervals. The implementation of ccr-syncer is designed based on the Share Engine architecture and integrated into the open-source OLAP database Doris, with relevant functionalities merged into its main codebase since version 2.0. The reliability of its functionality has also been validated in production environments.
吴瑞峰、何刚
计算技术、计算机技术
跨集群复制数据同步OLAP数据库Share Engine
OLAP databasesCross-cluster replicationData synchronizationShare Engine
吴瑞峰,何刚.OLAP数据库跨集群复制机制的设计与实现[EB/OL].(2024-02-28)[2025-08-12].http://www.paper.edu.cn/releasepaper/content/202402-92.点此复制
评论