本文已被:浏览 892次 下载 2123次
Received:August 04, 2020 Revised:August 28, 2020
Received:August 04, 2020 Revised:August 28, 2020
中文摘要: 针对大数据时代下, 海军航空部队存在的种种数据治理问题, 设计了一种基于Spark的航空信息服务平台, 平台实现了航空数据的存储, 分析与挖掘等功能. 平台采用4层体系架构, 使用了HDFS分布式文件存储框架和Hive数据仓库工具实现了数据的存储和管理. 最后, 通过仿真实验, 比较在不同数据量下航空信息服务平台与传统航空数据仓库的性能优劣. 通过海军航空信息服务平台建设, 可以有效为海军航空部队实训提供数据支撑, 为平台使用者提供辅助决策.
Abstract:In response to the data governance problems about naval aviation in the era of big data, a Spark-based aviation information service platform is designed, enabling data storage, analysis, and mining. The platform has a four-tier architecture, with the Hadoop Distributed File System (HDFS) and Hive for data storage and management. Finally, the performances of the aviation information service platform and the traditional aviation data warehouse are compared through simulation experiments regarding different data volumes. The naval aviation information service platform can serve as a strong data support for naval aviation training and assist users for decision-making.
文章编号: 中图分类号: 文献标志码:
基金项目:
Author Name | Affiliation | |
YAN Ting-Long | Naval Aviation University, Yantai 264001, China | 1724332258@qq.com |
LI Ying | Naval Aviation University, Yantai 264001, China | |
WANG Feng-Qin | Naval Aviation University, Yantai 264001, China |
Author Name | Affiliation | |
YAN Ting-Long | Naval Aviation University, Yantai 264001, China | 1724332258@qq.com |
LI Ying | Naval Aviation University, Yantai 264001, China | |
WANG Feng-Qin | Naval Aviation University, Yantai 264001, China |
引用文本:
颜廷龙,李瑛,王凤芹.基于Spark的航空信息服务平台.计算机系统应用,2021,30(4):77-81
YAN Ting-Long,LI Ying,WANG Feng-Qin.Aviation Public Information Service Platform Based on Spark.COMPUTER SYSTEMS APPLICATIONS,2021,30(4):77-81
颜廷龙,李瑛,王凤芹.基于Spark的航空信息服务平台.计算机系统应用,2021,30(4):77-81
YAN Ting-Long,LI Ying,WANG Feng-Qin.Aviation Public Information Service Platform Based on Spark.COMPUTER SYSTEMS APPLICATIONS,2021,30(4):77-81