本文已被:浏览 1591次 下载 4468次
Received:July 23, 2012 Revised:August 26, 2012
Received:July 23, 2012 Revised:August 26, 2012
中文摘要: 介绍了使用Node.js来实现一个分布式的数据流日志处理系统. 为解决随着运行服务数量的增加, 基于文件的日志操作会带来的存储性能瓶颈和必须要多处查看等问题提供一种方案. 将日志从文件还原为流, 利用Node.js来实现一个可分布式获得各日志数据流并且汇聚到中心存储的新型日志系统octoLogStreamlet. 充分利用Node.js的非阻塞I/O特性及NoSQL数据库的读写高性能, 实现多个数据流同时写入. 系统适用于有集中存放日志需求的计算机服务集群. 集中存放后对日志的处理和使用均提供了极大的便利
Abstract:This paper introduces a distributed log service System treating logs as data streams built with Node.js. and provides a solution to the problem that with the service number increases, the operation based on files gives rise to disadvantages that files I/O have performance bottleneck and have to be checked at multiple places. Logs are considered as a sort of data stream rather than files. Write a new log service system named octoLogStreamlet which collects the streams to a central storage with Node.js. Combining Node.js’ non-blocking I/O model and outstanding performance of NoSQL database, the system meets the requirements to cope with distributed data streams. The system is suitable for computer clusters needing centralized storage of logs, which provides great convenience for processing and utilizing logs.
keywords: data stream non-blocking I/O log Node.js Redis
文章编号: 中图分类号: 文献标志码:
基金项目:
Author Name | Affiliation |
ZHANG Yu | Technology and Project management Division, Shanghai Alcatel Network Support System Co.,Ltd., Shanghai 200122, China |
Author Name | Affiliation |
ZHANG Yu | Technology and Project management Division, Shanghai Alcatel Network Support System Co.,Ltd., Shanghai 200122, China |
引用文本:
张煜.一种使用Node.js构建的分布式数据流日志服务系统.计算机系统应用,2013,22(2):68-71
ZHANG Yu.Distributed Data Stream Log Service System Built with Node.js.COMPUTER SYSTEMS APPLICATIONS,2013,22(2):68-71
张煜.一种使用Node.js构建的分布式数据流日志服务系统.计算机系统应用,2013,22(2):68-71
ZHANG Yu.Distributed Data Stream Log Service System Built with Node.js.COMPUTER SYSTEMS APPLICATIONS,2013,22(2):68-71