Real-Time Analysis Storage System for Fake Plate Vehicle Based on Kafka and Storm
CSTR:
Author:
  • Article
  • | |
  • Metrics
  • |
  • Reference [10]
  • |
  • Related
  • |
  • Cited by
  • | |
  • Comments
    Abstract:

    With the increase of the number of motor vehicles and vehicle traffic in the city, the phenomenon of fake plate vehicle appears repeatedly. In order to solve the problem of fake plate monitoring, the traffic management departments adopt traditional identification methods, such as manual identification, license plate recognition, radio frequency identification, etc. Nevertheless, facing the massive log records, these methods generally have problems of low efficiency and poor real-time performance. So big data technology was introduced, and fake plate vehicle real-time analysis storage system based on Kafka and Storm was proposed. Kafka can be used as a middleware for caching, improving the synchronization of data collection and data analysis, and avoiding data loss. The Storm framework can realize real-time calculation of log information, and then store the information of the fake plate vehicles in the specified document. The entire system has real-time, distributed storage, stability, scalability, and so on.

    Reference
    [1] 李悦,刘晨.基于历史车牌识别数据的套牌车并行检测方法.计算机应用, 2016, 36(3):864-870.[doi:10.11772/j.issn.1001-9081.2016.03.864
    [2] 乔通,赵卓峰,丁维龙.面向套牌甄别的流式计算系统.计算机应用, 2017, 37(1):153-158.[doi:10.11772/j.issn.1001-9081.2017.01.0153
    [3] 俞东进,平利强,李万清,等.一种基于Hadoop的套牌车识别方法:CN, 104035954A. 2014-09-10.
    [4] Dean J, Ghemawat S. MapReduce:Simplified data processing on large clusters. Proceedings of the Sixth Conference on Symposium on Operating Systems Design&Implementation. San Francisco, CA, USA. 2004. 10.
    [5] Li JJ, Wang J, Lyu B, et al. An improved algorithm for optimizing MapReduce based on locality and overlapping. Tsinghua Science and Technology, 2018, 23(6):744-753.[doi:10.26599/TST.2018.9010115
    [6] 王涛,王顺,沈益民.交通流大数据中的套牌车并行检测算法.湖北工程学院学报, 2014, 34(6):29-32.[doi:10.3969/j.issn.2095-4824.2014.06.006
    [7] 杨航,朱永利.基于Storm的局部放电信号集合经验模态分解.计算机工程与应用(网络出版). 1-8. http://kns.cnki.net/kcms/detail/11.2127.TP.20190408.1724.002.html, 2019-04-11.
    [8] 周波.一种基于Flume的海量数据分流方案.电信科学, 2016, 32(S1):220-225
    [9] 彭灿华. Redis在高速缓存系统中的序列化算法研究.现代电子技术, 2017, 40(22):122-124
    [10] 刘芬,王芳,田昊.基于Zookeeper的分布式锁服务及性能优化.计算机研究与发展, 2014, 51(S1):229-234
    Related
    Cited by
Get Citation

任培花,苏铭.基于Kafka和Storm的车辆套牌实时分析存储系统.计算机系统应用,2019,28(10):74-79

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:March 12,2019
  • Revised:April 04,2019
  • Online: October 15,2019
  • Published: October 15,2019
Article QR Code
You are the first992101Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063