基于Storm的实时消息处理系统
The real-time information processing system based on Storm
摘要
随着互联网的飞速发展以及网络提供商带宽的不断升级,能够在互联网上进行网络活动的人数日益增长,总人数增长带来的结果就是提高了各网站的用户数量,无论新闻,视频,还是应用型网站的用户数量猛增,用户数量对网络后台的要求越来越高,有一套能够同时满足实时性与高效性的后台消息处理系统来说迫在眉睫。本文针对当前网络系统对大数据处理以及实时性处理的需求,结合流式计算框架Storm与消息队列系统Kafka提出一套解决方案,用来解决大数据处理以及实时处理的需求问题。Abstract
With the rapid development of Internet and wider network bandwidth, the result of growth is the increment of the user number of the sites which includes news, videos, and other applications. The increment put forward to requirements on huge data processing and real time processing. A real time and efficient information processing system is imminent. This paper proposes a solution for meeting the requirements by combining Storm and Kafka. 关键词
分布式计算/实时性/Storm/KafkaKey words
distributed computing/real time/Storm/Kafka引用本文复制引用
孔祥起,张海涛.基于Storm的实时消息处理系统[EB/OL].(2014-01-03)[2025-12-13].http://www.paper.edu.cn/releasepaper/content/201401-132.学科分类
通信/计算技术、计算机技术
评论