###
计算机系统应用:2019,28(2):274-279
本文二维码信息
码上扫一扫!
基于PostgreSQL的海量准实时数据服务平台访问方案
李钢1,2, 茅海泉1,2
(1.南瑞集团有限公司(国网电力科学研究院有限公司), 南京 211000;2.江苏瑞中数据股份有限公司, 南京 210012)
PostgreSQL-Based Big Data Access Scheme of Massive Quasi-Real-Time Data Service Platform
LI Gang1,2, MAO Hai-Quan1,2
(1.NARI Group Crporation/State Grid Electric Power Research Institute, Nanjing 211000, China;2.China Realtime Database Co. Ltd., Nanjing 210012, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 87次   下载 123
投稿时间:2018-08-01    修订日期:2018-09-05
中文摘要: 大数据服务平台在电网系统中具有重要的应用价值.海量准实时数据平台作为电网重要数据中心,存储了大量有价值的数据,其存储的数据多为非结构化数据,法直接通过SQL语句获取.为了最大限度挖掘数据价值,需要在平台中集成SQL访问实时数据的功能.为此,本文基于PostgresSQL Foreign Data Wrapper (Postgres_fdw)开发了SQL引擎.通过分析PostgresSQL的功能特点以及已有UAPI接口的不足,针对原有大数据平台框架,采用分层策略,基于Postgres_fdw开发了SQL引擎,并提出了针对海量平台中实时数据库的外部表空间估算方案和SQL解析方案,以此实现数据平台运用SQL的方式获取底层海量平台数据的功能.现场功能和性能测试,验证了该引擎的有效性.
Abstract:Big data services platform has important applications in the power distribution system. Massive quasi-real-time data service platform is a key data center in power grid, and a lot of valuable data is stored in the platform. The data in platform is unstructured, and cannot be selected by SQL statement. To maximize mining the data value, platform needs to integrate function that the accesses to real-time data, for this develop SQL engine based on PostgresSQL foreign data wrapper (Postgres_fdw). The SQL engine proposes a foreign table space estimation scheme and SQL resolution scheme for real-time databases in massive platforms. This access scheme provided good support for big data platform to get data from the underlying massive data service platform with an SQL way. Field function and performance tests validated the effectiveness of the engine.
文章编号:     中图分类号:    文献标志码:
基金项目:
引用文本:
李钢,茅海泉.基于PostgreSQL的海量准实时数据服务平台访问方案.计算机系统应用,2019,28(2):274-279
LI Gang,MAO Hai-Quan.PostgreSQL-Based Big Data Access Scheme of Massive Quasi-Real-Time Data Service Platform.COMPUTER SYSTEMS APPLICATIONS,2019,28(2):274-279

用微信扫一扫

用微信扫一扫