Application of Distributed Search Engine Based on MapReduce
DOI:
CSTR:
Author:
Affiliation:

Clc Number:

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    MapReduce is a distributed parallelized programming model. It can implement the processing and generating large data sets. Lucene is a Search Engine API under Apache. When the index file growing, the Lucene Search performance is a bottleneck. Based on the MapReduce, this system maps the parallelized search request to the cluster server for Mapping operation. It is mapped by dividing the index file by city strategy. And then the Map Function get the search results with the lucene. The results will be returned to the user by Reduce Function. According to the experimental results, this design does not only resolve the paralleized search bottleneck, but also improves the performance by 66.7%.

    Reference
    Related
    Cited by
Get Citation

吴文忠,易平. MapReduce 在分布式搜索引擎中的应用.计算机系统应用,2012,21(2):249-251,224

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:March 17,2011
  • Revised:April 26,2011
  • Adopted:
  • Online:
  • Published:
Article QR Code
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-3
Address:4# South Fourth Street, Zhongguancun,Haidian, Beijing,Postal Code:100190
Phone:010-62661041 Fax: Email:csa (a) iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063