计算机科学 ›› 2009, Vol. 36 ›› Issue (11): 235-237.

• 人工智能 • 上一篇    下一篇

基于DOM模型扩展的Web信息提取

顾韵华,田伟   

  1. (南京信息工程大学计算机与软件学院 南京210044)
  • 出版日期:2018-11-16 发布日期:2018-11-16
  • 基金资助:
    本文受江苏省产业技术研究与开发基金项目(苏发改高技发「2006]1106号)资助。

Extraction of Information from Web Pages Based on Extended DOM Tree

GU Yun-hua,TIAN Wei   

  • Online:2018-11-16 Published:2018-11-16

摘要: 提出了一种基于DOM模型扩展的Web信息提取方法。将Web页面表示为DOM树结构,对DOM树结点进行语义扩展并计算其影响度因子,依据结点的影响度因子进行剪枝,进而提取Wcb页面信息内容。该方法不要求 对网页的结构有预先认识,具有自动和通用的特点。提取结果除可以直接用于W cb浏览外,还可用于互联网数据挖掘、基于主题的搜索引擎等应用中。

关键词: 文档对象模型,Web信息提取,影响度因子,DOM树扩展

Abstract: A method of information extraction from Web pages was presented, and it is based on extended DOM tree. Web pages were firstly transformed to DOM tree, then the DOM tree was extended by adding semantic expression to node and influence degree was calculated for each node. According to influence degree of nodes, the DOM tree was pruned,and it can automatically extract the useful relevant content from Web pages. This approach is a universal method, which does not recauire to pre-know the structure of the Web page. The results of the information extraction are used not only for browsing but also for further Web information process, such as Internet data mining, topic-based search engine.

Key words: DOM,Extraction of information from Web pages,Influence degree,Extended DOM tree

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!