Methods of Massive Data Query Optimization for Urban Rail Transit Network
CSTR:
Author:
  • Article
  • | |
  • Metrics
  • |
  • Reference [10]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    The center of urban rail network needs to collect the data of all the urban rail lines and the size of table records will reach billions. The data query on urban rail network will need too much time and the system efficient is very low. We propose the program to optimize the system architecture by database cluster and middleware, which improves query efficiency because of more powerful storage and parallel processing capacity than that of a single database. An sharding method that divide the data horizontally by lines to avoid the expensive table joins crossing databases and the new rail line can be easily extended just by adding more database nodes. Serveral technologies, such as table partitioning, index, materialized view and SQL etc. are used also to optimize the reaction time when standalone inquiring. A special light-weight database access middleware used in the system architecture is designed to solved some key problems such as SQL parsing, route inquiring and result data merging etc.. The experiments are carrieded out on data from Guangzhou Metro as verifying the scheme of this paper. The results show that the reaction time of all types of queries is reduced 90% at least.

    Reference
    1 Taniar D, Khaw HY, Tjioe HC, et al. The use of Hints in SQL-Nested query optimization. Information sciences, 2007, 177(12):2493-2521.
    2 仰燕兰,叶桦,费树岷.车辆定位监控系统数据库的设计与优化.东南大学学报(自然科学版),2010,40(S1):44-47.
    3 刘晓娜,杜永文.物化视图在移动数据库查询优化中的应用.通化师范学院学报,2013,34(1):36-37.
    4 张银玲,武彤.常用OLAP查询优化方法性能分析.计算机技术与发展,2014,24(1):39-42.
    5 武彤,赵雪,赵洵.动态更新实物化视图以提高OLAP查询效率.计算机科学,2012,39(B06):315-317.
    6 杨悦.基于海量卫星测控数据存储与查询方法.科学技术与工程,2013,13(25):7352-7356.
    7 杨玉娟.地铁AFC系统数据库设计.维护和优化.铁路计算机应用,2011,20(3):56-58.
    8 李展涛,曹英忠.基于Oracle数据库的SOL语句优化.微型机与应用,2011,30(21):11-13.
    9 郭珉.ORACLE数据库SQL优化原则.计算机系统应用, 2010,19(4):170-173,165.
    10 子柳.淘宝技术这十年.北京:电子工业出版社,2013.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

赵驰,刘建委,饶里强,刘琼.面向城轨线网的海量数据查询优化方法.计算机系统应用,2015,24(12):157-162

Copy
Share
Article Metrics
  • Abstract:1502
  • PDF: 2128
  • HTML: 0
  • Cited by: 0
History
  • Received:March 27,2015
  • Revised:June 03,2015
  • Online: December 04,2015
Article QR Code
You are the first990534Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063