本文已被:浏览 1580次 下载 3078次
Received:December 05, 2019 Revised:January 14, 2020
Received:December 05, 2019 Revised:January 14, 2020
中文摘要: 随着业务系统规模不断扩大, 系统结构也变得十分复杂, 常规基于规则的方法已经很难判断多个系统相互作用下的复合型故障, 也难以对潜在故障进行预测. 本文在多业务系统的复杂场景下, 使用ELK平台对日志进行集中化管理, 梳理出复杂系统环境下日志与各业务系统、主机、进程之间的关系, 筛选出系统中直接与故障相关的日志文件, 进而在深度学习框架TensorFlow中使用这些海量数据对LSTM算法模型进行训练, 从而实现对系统的实时故障预测.
中文关键词: ELK LSTM 故障预测 深度学习 TensorFlow
Abstract:As the scale of systems continues to expand, the system structure also becomes very complex. The rule-based methods have been difficult to judge the composite faults under the interaction of multiple systems, and it is also hard to predict potential faults. Firstly, the study uses the ELK platform for centralized management of logs in complex scenarios of multi-business systems. Then, it sorts out the relationship between logs and various business systems, hosts, and processes in a complex system environment. Finally, we filter out the log files related to the failure in the system, and use these data in the deep learning framework TensorFlow to train the LSTM algorithm model, so as to realize the real-time fault prediction of the system.
keywords: ELK LSTM failure prediction deep learning TensorFlow
文章编号: 中图分类号: 文献标志码:
基金项目:
引用文本:
徐志斌,叶晗,王晗,郜义浩.系统日志故障预测中的ELK与LSTM应用与实践.计算机系统应用,2020,29(7):264-267
XU Zhi-Bin,YE Han,WANG Han,GAO Yi-Hao.Application and Practice of ELK and LSTM in System Log Fault Prediction.COMPUTER SYSTEMS APPLICATIONS,2020,29(7):264-267
徐志斌,叶晗,王晗,郜义浩.系统日志故障预测中的ELK与LSTM应用与实践.计算机系统应用,2020,29(7):264-267
XU Zhi-Bin,YE Han,WANG Han,GAO Yi-Hao.Application and Practice of ELK and LSTM in System Log Fault Prediction.COMPUTER SYSTEMS APPLICATIONS,2020,29(7):264-267