突发水污染事件中遥感瓦片大数据存储系统
DOI:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

"十二五"国家水体污染控制与治理重大专项课题(2012ZX07201-006);陕西省自然科学基础研究计划(2015JQ5157);陕西省教育厅科学研究计划(14JK1293);西安工程大学博士科研启动基金(BS1330)


Storage System on the Remote Sensing Tile Data Based on Big Data Technology in Sudden Water Pollution Incident
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    突发水污染事件频发,利用GIS平台、遥感技术及水质模型对突发水污染事件进行模拟研究逐渐成为一种发展趋势.针对目前海量、异构、动态遥感数据难以快速处置和高效存储的问题,基于HBase设计和实现了突发水污染事件的遥感瓦片大数据存储系统.该系统以数字地球平台为支撑,结合遥感瓦片金字塔模型和MapReduce框架,考虑实时、动态观察事件发展态势引起的瓦片数据频繁加载特点,对遥感瓦片数据的线性四叉树编码索引进行了改进,将其同水污染数据一并存储到HBase数据库中,并通过增加缓存区来提升遥感瓦片数据的访问效率.将此系统应用于渭河陕西段突发水污染事件中,实验结果表明:改进后的索引可在200个毫秒时间内提取到水污染区域的遥感数据,引入的缓存机制使得水污染区域遥感数据的加载时间节省了近2/3.因此,该存储系统访问效率高,能够满足突发水污染事件快速应急模拟的需求.

    Abstract:

    The sudden water pollution incidents occur frequently, so it has become a trend to do simulated research on sudden water pollution incident utilizing GIS platform, remote sensing technology and water quality model. Aiming at solving the problem that mass, heterogeneous and dynamic remote sensing data could not be disposed rapidly and stored efficiently; the storage system of remote sense tile data used in the sudden water pollution incidents was designed and implemented based on HBase. The system is supported by the digital earth platform and integrated with remote sensing tile pyramid model and MapReduce framework. The linear quad tree coding index of the remote sensing tile data was improved in this system according to the frequent load character of remote sensing tile data caused by event situation with real-time and dynamic observation and stored into HBase together with water pollution data. The access efficiency of the remote sensing tile data was increased through adding cache area. Applying this system to Weihe River sudden water pollution in Shanxi, the results showed that the improved index could extract the remote sensing data of the water pollution area within 22 milliseconds and the introduction of the caching mechanism saved almost 2/3 loading time on the remote sensing data in water pollution area. Therefore, the storage system could be accessed efficiently and it could satisfy the quick emergent simulation demand of the sudden water pollution incidents.

    参考文献
    相似文献
    引证文献
引用本文

李维乾,解建仓,李建勋,李莉.突发水污染事件中遥感瓦片大数据存储系统.计算机系统应用,2016,25(2):31-37

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2015-05-06
  • 最后修改日期:2015-06-08
  • 录用日期:
  • 在线发布日期: 2016-02-23
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号