Entropy-based link analysis for mining web informative structures

Hung-Yu Kao, Shian Hua Lin, Jan Ming Ho, Ming Syan Chen

Research output: Contribution to conferencePaper

24 Citations (Scopus)

Abstract

In this paper, we study the problem of mining the informative structure of a news Web site which consists of thousands of byperlinked documents. We define the informative structure of a news Web site as a set of index pages (or referred to as TOC. i.e., table of contents, pages) and a set of article pages linked by TOC pages through informative links. It is noted that the Hyperlink Induced Topics Search (HITS) algorithm has been employed to provide a solution to analyzing authorities and hubs of pages. However, most of the content sites tend to contain some extra hyperlinks, such as navigation panels, advertisements and banners, so as to increase the add-on values of their Web pages. Therefore, due to the structure induced by these extra hyperlinks, HITS is found to be insufficient to provide a good precision in solving the problem. To remedy this, we develop an algorithm to utilize entropy-based Link Analysis on Mining Web Informative Structures. This algorithm is referred to as LAM1S. The key idea of LAMIS is to utilize information entropy for representing the knowledge that corresponds to the amount of information in a link or a page in the link analysis. Experiments on several real news Web sites show that the precision and the recall of LAMIS are much superior to those obtained by heuristic methods and conventional ink analysis methods.

Original languageEnglish
Pages574-581
Number of pages8
Publication statusPublished - 2002 Dec 1
EventProceedings of the Eleventh International Conference on Information and Knowledge Management (CIKM 2002) - McLean, VA, United States
Duration: 2002 Nov 42002 Nov 9

Other

OtherProceedings of the Eleventh International Conference on Information and Knowledge Management (CIKM 2002)
CountryUnited States
CityMcLean, VA
Period02-11-0402-11-09

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Decision Sciences(all)
  • Business, Management and Accounting(all)

Cite this

Kao, H-Y., Lin, S. H., Ho, J. M., & Chen, M. S. (2002). Entropy-based link analysis for mining web informative structures. 574-581. Paper presented at Proceedings of the Eleventh International Conference on Information and Knowledge Management (CIKM 2002), McLean, VA, United States.