A novel data transformation model for small data-set learning

Der Chiang Li, I. Hsiang Wen, Wen Chih Chen

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


In most highly competitive manufacturing industries, the sample sizes are usually very small in pilot runs, in order to quickly launch new products. However, it is always difficult for engineers to improve the quality in mass production runs based on the limited data obtained in this way. Past research has demonstrated that adding artificial samples can be an effective approach when learning with small data-sets. However, a prior analysis of the data is needed to deduce the appropriate sample distributions within which the artificial samples are generated. Johnson transformation is one of the well-known models that can be applied to bring data close to a normal distribution with the satisfaction of certain statistical assumptions. The sample size required for such data transformation methods is usually large, and this thus motivates the efforts of the current study to develop a new method which is suitable for small data-sets. Accordingly, this research proposes the small Johnson Data Transformation method to transform small raw data to normal distributions to generate virtual samples. When compared with four other methods, the results obtained with a real small data-set drawn from the Film Transistor Liquid Crystal Display industry in Taiwan demonstrate that the proposed method is able to effectively improve the forecasting ability with small sample sizes.

Original languageEnglish
Pages (from-to)7453-7463
Number of pages11
JournalInternational Journal of Production Research
Issue number24
Publication statusPublished - 2016 Dec 16

All Science Journal Classification (ASJC) codes

  • Strategy and Management
  • Management Science and Operations Research
  • Industrial and Manufacturing Engineering

Fingerprint Dive into the research topics of 'A novel data transformation model for small data-set learning'. Together they form a unique fingerprint.

Cite this