A learning method for the class imbalance problem with medical data sets

Der Chiang Li, Chiao Wen Liu, Susan C. Hu

Research output: Contribution to journalArticlepeer-review

106 Citations (Scopus)

Abstract

In medical data sets, data are predominately composed of "normal" samples with only a small percentage of "abnormal" ones, leading to the so-called class imbalance problems. In class imbalance problems, inputting all the data into the classifier to build up the learning model will usually lead a learning bias to the majority class. To deal with this, this paper uses a strategy which over-samples the minority class and under-samples the majority one to balance the data sets. For the majority class, this paper builds up the Gaussian type fuzzy membership function and α-cut to reduce the data size; for the minority class, we use the mega-trend diffusion membership function to generate virtual samples for the class. Furthermore, after balancing the data size of classes, this paper extends the data attribute dimension into a higher dimension space using classification related information to enhance the classification accuracy. Two medical data sets, Pima Indians' diabetes and the BUPA liver disorders, are employed to illustrate the approach presented in this paper. The results indicate that the proposed method has better classification performance than SVM, C4.5 decision tree and two other studies.

Original languageEnglish
Pages (from-to)509-518
Number of pages10
JournalComputers in Biology and Medicine
Volume40
Issue number5
DOIs
Publication statusPublished - 2010 May

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Health Informatics

Fingerprint Dive into the research topics of 'A learning method for the class imbalance problem with medical data sets'. Together they form a unique fingerprint.

Cite this