|国家预印本平台
首页|物联网云服务的日志聚类算法研究

物联网云服务的日志聚类算法研究

Research on Event Log Clustering of IoT Cloud Service

中文摘要英文摘要

对物联网云服务的日志数据进行日志聚类,得到数据中事件日志的行模式和行模式出现的频繁程度,可用于支持云平台的日志监控与告警。LogCluster是一个基于密度的日志聚类算法,本文在该算法基础上提出了改进算法。通过改进算法中启发式方法的调用时序,解决了在阈值较高情况下无法输出有效聚类结果的问题;改进了异常行判断逻辑,使异常行输出更符合聚类结果;实现了自动调整阈值进行多轮聚类,输出完整的多级聚类结果。最后,通过实验结果证明,改进型算法保持相近的运行时间的同时,可以输出更多模式和多级的聚类结果。

Log clustering of the log data of the IoT cloud service to obtain the line patterns of the event logs and the frequencies of them,which can be used in log monitoring and alarm of the cloud platform. LogCluster is a density-based log clustering algorithm. Based on this algorithm, an improved algorithm is proposed. By improving the calling sequence of the heuristic method in the algorithm, the problem that the effective clustering result cannot be output under the high threshold is solved; the outlier judgment logic is improved, and the outlier output is more consistent with the clustering result; At the same time, the optimization algorithm can automatically adjust the threshold for multi-round clustering and output multi-level clustering results. Finally, the experimental results show that the improved algorithm can output more patterns and multi-level clustering results while maintaining similar running time.

龙航、王一川

计算技术、计算机技术

日志聚类LogCluster算法云服务日志

event log clusteringLogClustercloud service log

龙航,王一川.物联网云服务的日志聚类算法研究[EB/OL].(2019-01-29)[2025-08-16].http://www.paper.edu.cn/releasepaper/content/201901-205.点此复制

评论