本文已被:浏览 1799次 下载 3044次
Received:April 25, 2017 Revised:May 09, 2017
Received:April 25, 2017 Revised:May 09, 2017
中文摘要: 为了解决具有密度高、关联复杂的异构大数据网络的数据挖掘效率低下问题,基于多维关联架构,结合细粒度控制提出了数据挖掘算法.首先,在异构大数据网络存储与转发、处理的数据个性特征和差异化的基础上,给出了异构大数据网络数据定义和多维关联模型.接着,基于大数据网络多维关联初始化进程,通过大数据单位重构、维度置换、细粒度化和粒度均衡等,提出了多维关联细粒度数据挖掘算法.最后,通过与粗粒度算法、线性化结构数据挖掘算法对比了在不同网络规模和数据规模下的执行效率.实验结果表明,所提算法具有更佳的执行效率.
Abstract:In order to improve the low efficiency of data mining with high density and complex heterogeneous data network, a data mining algorithm based on multi dimension association structure is proposed. Firstly, on the basis of the data personality characteristics and the differences of the data storage, forwarding and processing in the heterogeneous large data network, the data definition and multi-dimensional correlation model of the heterogeneous data network are given. Then, based on the large data network, the paper proposes a multidimensional association fine-grained data mining algorithm based on the reconstruction of the large data units, the dimension replacement, the granularity and the granularity. Finally, the efficiency of the algorithm is compared with the coarse grained algorithm and the linear structured data mining algorithm. The experimental results show that the proposed algorithm has better performance.
keywords: Heterogeneous big data large scale network data mining fine-grained Multidimensional association
文章编号: 中图分类号: 文献标志码:
基金项目:
引用文本:
陆江东,郑奋,戴卓臣.异构大数据网络的多维关联细粒度数据挖掘算法.计算机系统应用,2018,27(3):186-190
LU Jiang-Dong,ZHENG Fen,DAI Zhuo-Chen.Multidimensional Association Fine-Grained Data Mining Algorithm for Heterogeneous Big Data Networks.COMPUTER SYSTEMS APPLICATIONS,2018,27(3):186-190
陆江东,郑奋,戴卓臣.异构大数据网络的多维关联细粒度数据挖掘算法.计算机系统应用,2018,27(3):186-190
LU Jiang-Dong,ZHENG Fen,DAI Zhuo-Chen.Multidimensional Association Fine-Grained Data Mining Algorithm for Heterogeneous Big Data Networks.COMPUTER SYSTEMS APPLICATIONS,2018,27(3):186-190