###
DOI:
计算机系统应用英文版:2014,23(10):57-62
本文二维码信息
码上扫一扫!
资讯类新闻套图系统
江浩亮1,2, 左春1,2,3
(1.中国科学院软件研究所 软件工程技术研发中心, 北京 100190;2.中国科学院大学, 北京 100190;3.中科软科技股份有限公司, 北京 100190)
Web Information Extraction and Knowledge Presentation System
(1.Software engineering center, Institute of Software, Chinese Academy Of Sciences, Beijing 100190, China;2.University of Chinese Academy of Sciences, Beijing 100190, China;3.Sinosoft, Beijing 100190, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 2002次   下载 2807
Received:February 28, 2014    Revised:March 25, 2014
中文摘要: 考虑到图片具有对事件诠释力强,传播便利的特点,研究了从大量数据密集的新闻Web页面中自动提取数据,并组织成套图结构展现给用户. 基于页面模板实现动态页面抽取和解析,处理转换为对应的套图数据结构. 基于余弦相关性对来自不同网站的新闻套图数据进行去重,并根据相应的标准,为数据集进行评分排序. 考虑巨大的新闻数据和用户数量,本系统基于hadoop分布式平台,满足系统的高可扩展性. 本文将详细描述我们的系统设计和实现,并公布在百度资讯图片栏目上的运行结果.
Abstract:Considering the picture has the futures that a strong interpretation of events and convenient disseminating, this paper studies extraction of data from a large number of news web pages, and organizational structure chart presented to the users. It achieves dynamic pages based on page template extraction and analysis, processing converted to the corresponding sets of datastructure. Based on the news cosine correlation graph data sets from different sites are differentiated, and in accordance with the appropriate standards for data collection to score sorted. This system is based on hadoop distributed platform, considering the large number of users and imgsets. This paper will describe the design and implementation of our system in detail, and report the results of running the system on Baidu news image column.
文章编号:     中图分类号:    文献标志码:
基金项目:“核高基”重大专项(2010ZX01045-001-006)
引用文本:
江浩亮,左春.资讯类新闻套图系统.计算机系统应用,2014,23(10):57-62
JIANG Hao-Liang,ZUO Chun.Web Information Extraction and Knowledge Presentation System.COMPUTER SYSTEMS APPLICATIONS,2014,23(10):57-62