本文已被:浏览 1345次 下载 2523次
Received:May 22, 2014 Revised:June 26, 2014
Received:May 22, 2014 Revised:June 26, 2014
中文摘要: 首先针对我军装备保障管理系统关系数据库在海量数据查询以及分析处理方面的不足, 在对系统数据资源分析的基础上提出并实现了基于Hadoop云平台结构化数据查询策略, 通过Sqoop工具将数据库中的数据导入到HDFS中, 并利用Hive进行数据分析. 然后通过实验证明此方法克服了海量数据在单机环境中查询效率低下的缺点, 具有较高的实用价值.
Abstract:First, this paper talked about the deficiencies of current Equipment Support Management System on massive data query and analysis. Then it proposed and realized a method of Structured Data Query used by the Cloud Platform based on Hadoop, after analyzing the data source. In the article, we used the tool of Sqoop to import data from a relational database into HDFS, and then use Hive to analyze the data. Finally, the experiment proved that the method makes up the shortage of the data query in the environment of single computer, and has high practical value.
keywords: structured data Hadoop cloud platform Sqoop Hive
文章编号: 中图分类号: 文献标志码:
基金项目:
引用文本:
张惠民,胡海荣,向阳霞.云平台下的装备保障管理系统结构化数据查询.计算机系统应用,2015,24(2):70-74
ZHANG Hui-Min,HU Hai-Rong,XIANG Yang-Xia.Structured Data Query in the Equipment Support Management System Based on Cloud Platform.COMPUTER SYSTEMS APPLICATIONS,2015,24(2):70-74
张惠民,胡海荣,向阳霞.云平台下的装备保障管理系统结构化数据查询.计算机系统应用,2015,24(2):70-74
ZHANG Hui-Min,HU Hai-Rong,XIANG Yang-Xia.Structured Data Query in the Equipment Support Management System Based on Cloud Platform.COMPUTER SYSTEMS APPLICATIONS,2015,24(2):70-74