A fuzzy self-constructing feature clustering algorithm for text classification

Jung Yi Jiang, Ren Jia Liou, Shie Jue Lee

Research output: Contribution to journalArticle

109 Citations (Scopus)

Abstract

Feature clustering is a powerful method to reduce the dimensionality of feature vectors for text classification. In this paper, we propose a fuzzy similarity-based self-constructing algorithm for feature clustering. The words in the feature vector of a document set are grouped into clusters, based on similarity test. Words that are similar to each other are grouped into the same cluster. Each cluster is characterized by a membership function with statistical mean and deviation. When all the words have been fed in, a desired number of clusters are formed automatically. We then have one extracted feature for each cluster. The extracted feature, corresponding to a cluster, is a weighted combination of the words contained in the cluster. By this algorithm, the derived membership functions match closely with and describe properly the real distribution of the training data. Besides, the user need not specify the number of extracted features in advance, and trial-and-error for determining the appropriate number of extracted features can then be avoided. Experimental results show that our method can run faster and obtain better extracted features than other methods.

Original languageEnglish
Article number5530315
Pages (from-to)335-349
Number of pages15
JournalIEEE Transactions on Knowledge and Data Engineering
Volume23
Issue number3
DOIs
Publication statusPublished - 2011 Jan 31

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Science Applications
  • Computational Theory and Mathematics

Fingerprint Dive into the research topics of 'A fuzzy self-constructing feature clustering algorithm for text classification'. Together they form a unique fingerprint.

  • Cite this