分布式关系型数据库研究与金融行业应用
作者:

Distributed Relational Database Research and Its Application in Financial Industry
Author:
  • 摘要
  • | |
  • 访问统计
  • |
  • 参考文献 [23]
  • |
  • 相似文献 [20]
  • | | |
  • 文章评论
    摘要:

    数据库作为金融信息化建设的重要组成部分, 需要面对持续的业务量增长、高度可用性和扩展性等挑战, 而以MySQL、Oracle等为代表的传统数据库单点架构, 在可用性、扩展性和存储能力上已经无法满足当前的金融服务要求. 分布式数据库的出现, 旨在解决单机数据库所面临的各种挑战, 提供更加灵活的架构, 保障系统稳定运行. 为此, 本文在结合实际的金融业务需求下, 研究实现了具有分布式事务支持、分布式SQL引擎、混合事务分析处理等特点的分布式数据库. 系统采用全组件的冗余设计, 通过类Raft增强一致性算法保证了存储层高可用和数据强一致, 同时利用基于Zookeeper的集群调度方案保证调度层的高可用.

    Abstract:

    As an important part of financial informatization, the database faces the challenges of continuous business growth and high availability and scalability, while the traditional single-point architecture of databases, represented by MySQL, Oracle, etc., fails to meet the current requirements of financial services in terms of availability, scalability and storage capacity. Distributed databases are designed to address the challenges faced by single-site databases and provide the more flexible architecture, ensuring stable system operation. To this end, this study, subject to actual financial service requirements, researches and implements a distributed database equipped with a distributed SQL engine, which is capable of distributed transaction support and hybrid transactional/analytical processing. The system is designed with full component redundancy. In addition, high availability of the storage layer and strong consistency of the data are ensured by the Raft-like enhanced consistency algorithm, while high availability of the scheduling layer is guaranteed by the Zookeeper-based cluster scheduling scheme.

    参考文献
    [1] 申德荣, 于戈, 王习特, 等. 支持大数据管理的NoSQL系统研究综述. 软件学报, 2013, 24(8): 1786–1803. [doi: 10.3724/SP.J.1001.2013.04416
    [2] Corbett JC, Dean J, Epstein M, et al. Spanner: Google's globally distributed database. ACM Transactions on Computer Systems, 2013, 31(3): 8
    [3] Taft R, Sharif I, Matei A, et al. CockroachDB: The resilient geo-distributed SQL database. Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. Portland, OR, USA. 2020. 1493–1509.
    [4] Huang DX, Liu Q, Cui Q, et al. TiDB: A raft-based HTAP database. Proceedings of the VLDB Endowment, 2020, 13(12): 3072–3084. [doi: 10.14778/3415478.3415535
    [5] Gilbert S, Lynch N. Perspectives on the CAP theorem. Computer, 2012, 45(2): 30–36. [doi: 10.1109/MC.2011.389
    [6] Kleppmann M. Designing Data-intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems. O’Reilly Media, 2017.
    [7] de Prisco R, Lampson B, Lynch N. Revisiting the PAXOS algorithm. Theoretical Computer Science, 2000, 243(1–2): 35–91
    [8] Ongaro D, Ousterhout J. In search of an understandable consensus algorithm. Proceedings of the 2014 USENIX Annual Technical Conference. Philadelphia, PA, USA. 2014. 305–320.
    [9] CORPORATE X/Open Company Ltd. X/Open CAE Specification: Distributed Transaction Processing: CPI-C Specification, version 2. Prentice-Hall, 1996.
    [10] Junqueira F, Reed B. ZooKeeper: Distributed Process Coordination. Sebastopol: O’Reilly Media, 2013.
    [11] 康文杰, 王勇, 俸皓. 云平台中MySQL数据库高可用性的设计与实现. 计算机工程与设计, 2018, 39(1): 296–300
    [12] 姚入榕. 面向HTAP的大规模分布式数据库混合存储引擎[硕士学位论文]. 成都: 电子科技大学, 2020.
    [13] 赵中英, 李斌, 王敏. F5负载均衡综述. 现代信息科技, 2019, 3(2): 60–61. [doi: 10.3969/j.issn.2096-4706.2019.02.022
    [14] Widenius M, Axmark D, Arno K. MySQL Reference Manual. O’Reilly & Associates, 2002.
    [15] 茅潇潇. 分布式数据库并行连接查询的实现及优化[硕士学位论文]. 上海: 华东师范大学, 2018.
    [16] 杨飞. 分布式数据库中间件DBScale的设计与实现[硕士学位论文]. 哈尔滨: 哈尔滨工业大学, 2015.
    [17] Delcambre JML, Lisboa ET. Transaction management in a distributed database management system. Proceedings of the 3rd Conference of the European Cooperation in Informatics Trends in Information Processing Systems. Munich, Germany. 1981. 224.
    [18] Gray J. The Transaction concept: Virtues and limitations (invited paper). Proceedings of the 7th International Conference on Very Large Data Bases (VLDB). Cannes, France. 1981. 144–154.
    [19] Borthakur D. The history of RocksDB. rocksdb.blogspot. com. 2013.
    [20] O’Neil P, Cheng E, Gawlick D, et al. The log-structured merge-tree (LSM-tree). Acta Informatica, 1996, 33(4): 351–385. [doi: 10.1007/s002360050048
    [21] 张晨东, 郭进伟, 刘柏众, 等. 基于Raft一致性协议的高可用性实现. 华东师范大学学报(自然科学版), 2015, (5): 172–184
    [22] 陈陆, 黄树成, 徐克辉. 改进的Raft一致性算法及其研究. 江苏科技大学学报(自然科学版), 2018, 32(4): 559–563
    [23] Junqueira FP, Reed BC, Serafini M. Zab: High-performance broadcast for primary-backup systems. Proceedings of the IEEE/IFIP 41st International Conference on Dependable Systems & Networks. Hong Kong, China. 2011. 245–256.
    引证文献
    网友评论
    网友评论
    分享到微博
    发 布
引用本文

朱哲哲,赵振海,李鹏,吴海洋,向小佳.分布式关系型数据库研究与金融行业应用.计算机系统应用,2021,30(6):75-81

复制
分享
文章指标
  • 点击次数:952
  • 下载次数: 2023
  • HTML阅读次数: 1729
  • 引用次数: 0
历史
  • 收稿日期:2020-10-19
  • 最后修改日期:2020-11-18
  • 在线发布日期: 2021-06-05
文章二维码
您是第11184380位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号