本文已被:浏览 2028次 下载 4289次
Received:April 03, 2010 Revised:May 06, 2010
Received:April 03, 2010 Revised:May 06, 2010
中文摘要: 介绍了Hadoop开源框架、Map/Reduce编程模型以及语句相似度计算原理,利用Hadoop框架下的Map/Reduce编程模型实现了句群相似度并行计算方法。通过实验验证了该算法的稳定性和处理大量数据的可行性。
中文关键词: Hadoop 句群相似度 Map/Reduce
Abstract:Based on the introduction of Open Source Framework of Hadoop, encoded pattern of Map/Reduce and the calculated formula of sentence similarity, the present paper adopts the method of sentence group similarity parallel computing to the encoded pattern of Map/Reduce in terms of Hadoop. And it verifies the stability and feasibility of dealing with tremendous data.
keywords: Hadoop sentence group similarity Map/Reduce
文章编号: 中图分类号: 文献标志码:
基金项目:全国教育科学“十一五”规划课题 (CA070275);新疆师范大学研究生科技创新项目(20091106)
Author Name | Affiliation |
宁可为 | 新疆师范大学 教育科学学院 新疆 乌鲁木齐 830054 |
王炜 | |
李园伟 |
Author Name | Affiliation |
宁可为 | 新疆师范大学 教育科学学院 新疆 乌鲁木齐 830054 |
王炜 | |
李园伟 |
引用文本:
宁可为,王炜,李园伟.基于Hadoop的句群相似度计算.计算机系统应用,2010,19(12):59-63
.Calculation of Sentence Group Similarity Based on Hadoop.COMPUTER SYSTEMS APPLICATIONS,2010,19(12):59-63
宁可为,王炜,李园伟.基于Hadoop的句群相似度计算.计算机系统应用,2010,19(12):59-63
.Calculation of Sentence Group Similarity Based on Hadoop.COMPUTER SYSTEMS APPLICATIONS,2010,19(12):59-63