Mixed Heterogeneous Data Acquisition System for Power Big Data
CSTR:
Author:
Affiliation:

Clc Number:

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    With the rapid development of smart grid, the growth of power system data is also very fast. There is an urgent need of in-depth research for power big data. Because of the large span of the data acquistion speed, numerous data sources, complicated interaction interfaces, and various kinds of data type, the existing big data technologies are unable to adapt to power big data aquisition. In this study, a new solution for power big data acquisition is proposed. The system schedules and manages the heterogeneous data source acquisition tasks through mixed data acquisition model and collection cluster. With the technology of data confidential degree label, the system preserves the original data, indicates the quality of the data and provides convenience for big data analysis applications. The system submittes collected data to the big data platform for storage by Sqoop, Kafka, file transfer, or other methods. The system has been deployed and puts into use in the user site. It runs stably and has a sound effect.

    Reference
    Related
    Cited by
Get Citation

孙超,王永贵,常夏勤,陆鑫,顾全.面向电力大数据的异构数据混合采集系统.计算机系统应用,2018,27(12):62-68

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:April 29,2018
  • Revised:May 24,2018
  • Adopted:
  • Online: December 05,2018
  • Published:
Article QR Code
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063