Using structure-based data transformation method to improve prediction accuracies for small data sets

Der Chiang Li, Chih Chieh Chang, Chiao Wen Liu

Research output: Contribution to journalArticlepeer-review

13 Citations (Scopus)

Abstract

Small data set problems have been widely considered in many fields, where increasing the prediction ability is the most important goal. This study considers the data structure to identify new data points in a more precise manner, and is thus able to achieve improved prediction capability. The proposed method, named structure-based data transformation, consists of two steps. The first step is using the density-based spatial clustering of applications with noise (DBSCAN) algorithm to separate data sets into clusters, which generates the number of clusters dynamically. The second step is to build up the data transformation function, in which the new attributes are computed using fuzzy membership functions obtained by the corresponding membership grades in each cluster. Three real cases are selected to compare the proposed forecasting model with the linear regression (LR), backpropagation neural network (BPNN), and support vector machine for regression (SVR) methods. The result show that the structure-based data transformation method has better performance than when using the raw data with regard to the error improving rate, mean square error (MSE), and standard deviation (STD).

Original languageEnglish
Pages (from-to)748-756
Number of pages9
JournalDecision Support Systems
Volume52
Issue number3
DOIs
Publication statusPublished - 2012 Feb 1

All Science Journal Classification (ASJC) codes

  • Management Information Systems
  • Information Systems
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)
  • Information Systems and Management

Fingerprint Dive into the research topics of 'Using structure-based data transformation method to improve prediction accuracies for small data sets'. Together they form a unique fingerprint.

Cite this