本文已被：浏览 1652次 下载 3146次
Received:November 03, 2011 Revised:December 01, 2011
Received:November 03, 2011 Revised:December 01, 2011
中文摘要: 为了能够充分利用WEB上丰富的文献资源,设计了一个专业的WEB文献资料采集系统WLES。该系统集成了网页抓取和网页清洗两方面技术,并且引入机器学习方法到网页清洗中,通过机器对训练语料的学习得到一个清洗模型,然后用该模型来实施网页清洗。实验证明该系统在网页抓取和网页清洗方面都具有优良的性能,能够满足使用者的文献采集需求。
Abstract:In order to take advantage of the rich literature resources on the WEB, this paper designed a professional web literature collection system WLES. The WLES integrates Web crawling and Web cleaning technology. The machine learning method is introduced to the study of Web cleaning. Machine learning on the training data can get a clean model, and then use the model to implement web cleaning. Experiments show: WLES in web crawling and web page cleaning has an excellent performance, to meet the needs of the user's literature collection.
文章编号： 中图分类号： 文献标志码：
基金项目:国家社科基金重大项目(10&ZD117);江苏高校重点研究基地重大项目(2010JDXM023);江苏省教育厅高校哲学社会科学基金(2011SJB7400 10); 江苏省高校自然科学研究项目(11KJD520009)
| Author Name | Affiliation |
| MA Chuang-Xin | College of Liberal Arts, Nanjing Normal University, Nanjing 210097,China |
| Author Name | Affiliation |
| MA Chuang-Xin | College of Liberal Arts, Nanjing Normal University, Nanjing 210097,China |
引用文本：
马创新.WEB文献资料采集系统.计算机系统应用,2012,21(7):9-12,37
MA Chuang-Xin.Web Literature Collection System.COMPUTER SYSTEMS APPLICATIONS,2012,21(7):9-12,37
马创新.WEB文献资料采集系统.计算机系统应用,2012,21(7):9-12,37
MA Chuang-Xin.Web Literature Collection System.COMPUTER SYSTEMS APPLICATIONS,2012,21(7):9-12,37
