A genetic algorithm-based virtual sample generation technique to improve small data set learning

Der-Chiang Li, I. Hsiang Wen

Research output: Contribution to journalArticle

33 Citations (Scopus)

Abstract

While back-propagation neural networks (BPNN) are effective learning tools for building non-linear models, they are often unstable when using small-data-sets. Therefore, in order to solve this problem, we construct artificial samples, called virtual samples, to improve the learning robustness. This research develops a novel method of virtual sample generation (VSG), named genetic algorithm-based virtual sample generation (GABVSG), which considers the integrated effects and constraints of data attributes. We first determine the acceptable range by using mega-trend diffusion (MTD) functions, and construct the feasibility-based programming (FBP) model with BPNN. A genetic algorithm (GA) is then applied to accelerate the generation of the most-feasible virtual samples. Finally, we use two real cases to verify the performance of the proposed method by comparing the results with two well-known forecasting models, BPNN, support vector machine for regression (SVR) and one newly published approach MTD method [1]. The experimental results indicate that the performance of the GABVSG method is superior to that of using original training data without artificial samples. Consequently, the proposed method can improve learning performance significantly when working with small samples.

Original languageEnglish
Pages (from-to)222-230
Number of pages9
JournalNeurocomputing
Volume143
DOIs
Publication statusPublished - 2014 Nov 2

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'A genetic algorithm-based virtual sample generation technique to improve small data set learning'. Together they form a unique fingerprint.

  • Cite this