A novel topic selection algorithm based on word distribution

Chun Wei Tsai, Ko Wei Huang, Heng Yao Hsu, Ming Chao Chiang, Chu Sing Yang

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Over the past decade, more and more users of the Internet rely on the search engines to help them find the information they need. However, the information they find depends, to a large extent, on the ranking mechanism of the search engines they use. Not surprisingly, it generally consists of a large amount of information that is completely irrelevant. To help users of the Internet find the information they are looking for quickly, an efficient algorithm for building the summaries of a collection of documents found by a search engine in response to a user query, called DiSco (Distribution Scoring), is proposed. The main idea in the design of DiSco is to balance the rate of coverage and overlap in the selection of topic words for document summarization, especially when the datasets are large. Moreover, several measure methods such as coverage, overlap, and the computation time are employed in evaluating the performance of the proposed algorithm. All our simulation results indicate that the proposed algorithm outperforms all the state- of-the-art algorithms evaluated in terms of not only the quality of the summarizations but also the computation time.

Original languageEnglish
Pages (from-to)1843-1864
Number of pages22
JournalInternational Journal of Innovative Computing, Information and Control
Volume6
Issue number4
Publication statusPublished - 2010 Apr

All Science Journal Classification (ASJC) codes

  • Software
  • Theoretical Computer Science
  • Information Systems
  • Computational Theory and Mathematics

Fingerprint

Dive into the research topics of 'A novel topic selection algorithm based on word distribution'. Together they form a unique fingerprint.

Cite this