###

DOI:

计算机系统应用英文版:2013,22(10):175-180

View/Add Comment 过刊浏览高级检索 HTML

←前一篇 | 后一篇→

码上扫一扫！

下载全文

一种基于HBase的数据持久性和可用性研究

唐长城¹, 杨峰^1,2, 代栋¹, 孙明明¹, 周学海^1,2

(1.中国科学技术大学计算机科学与技术学院, 合肥 230027;2.中国科学技术大学苏州研究院, 苏州 215123)

Research of Data Durable and Available Base on Hbase

TANG Chang-Cheng¹, YANG Feng^1,2, DAI Dong¹, SUN Ming-Ming¹, ZHOU Xue-Hai^1,2

(1.College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China;2.Suzhou Institute for Advanced Study, University of Scienceand Technology of China, Suzhou 215123, China)

摘要

图/表

参考文献

相似文献

本文已被：浏览 1972次下载 2843次
Received:March 18, 2013 Revised:May 02, 2013

中文摘要: HBase(Hadoop DataBase)是Apache Hadoop项目下的一款非关系型数据库, 它是一个基于列簇的开源数据存储系统, 关于HBase的研究和应用越来越受到关注. 由于HBase会在内存缓存数据后写文件系统, 所以缓存的大小成为影响系统性能的一个重要因素. 本文提出一种基于备份日志的持久性、可用性方案Remote Log Process, 使得HBase能够在不同的缓存规模获得更好的写性能. 实验证明, 在保证数据的持久性和可用性前提下, RLP能够在不同的缓存大小下获得稳定的性能, 并且在缓存不超过默认设置时明显提高写操作时间性能.

中文关键词: HBase 持久性可用性预写日志写操作效率

Abstract:HBase, a NoSql database under Apache Hadoop, is an open source data storage system based on column family. Researches and applications based on HBase is more and more popular. But the size of memory buffer become a key factor to influence system performance as HBase will buffer data in memory before store them on file system. In this paper, we provide a new method based on copied log named Remote Log Process to make HBase perform better on write operation with different buffer size while keeping data durable and available. Experiments result indicates RLP can get a steady performance with different buffer size under the condition to guarantee durable and available of input data, while perform much better than pristine systems if the buffer isn't larger then default value.

keywords: HBase durable available write ahead log write performance

文章编号： 中图分类号： 文献标志码：

基金项目:江苏省产学研前瞻性联合研究(BY2009128);江苏省自然科学基金(BK2012194);国家自然科学基金(61272131)

Author Name	Affiliation
TANG Chang-Cheng	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China
YANG Feng	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China Suzhou Institute for Advanced Study, University of Scienceand Technology of China, Suzhou 215123, China
DAI Dong	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China
SUN Ming-Ming	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China
ZHOU Xue-Hai	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China Suzhou Institute for Advanced Study, University of Scienceand Technology of China, Suzhou 215123, China

Author Name	Affiliation
TANG Chang-Cheng	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China
YANG Feng	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China Suzhou Institute for Advanced Study, University of Scienceand Technology of China, Suzhou 215123, China
DAI Dong	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China
SUN Ming-Ming	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China
ZHOU Xue-Hai	College of Computer Science and Technology, University of Science and Technology of China, Hefei 230027, China Suzhou Institute for Advanced Study, University of Scienceand Technology of China, Suzhou 215123, China

引用文本：
唐长城,杨峰,代栋,孙明明,周学海.一种基于HBase的数据持久性和可用性研究.计算机系统应用,2013,22(10):175-180
TANG Chang-Cheng,YANG Feng,DAI Dong,SUN Ming-Ming,ZHOU Xue-Hai.Research of Data Durable and Available Base on Hbase.COMPUTER SYSTEMS APPLICATIONS,2013,22(10):175-180