LiDA: Language-Independent Data Augmentation for Text Classification

Yudianto Sujana, Hung Yu Kao

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

Developing a high-performance text classification model in a low-resource language is challenging due to the lack of labeled data. Meanwhile, collecting large amounts of labeled data is cost-inefficient. One approach to increase the amount of labeled data is to create synthetic data using data augmentation techniques. However, most of the available data augmentation techniques work on English data and are highly language-dependent as they perform at the word and sentence level, such as replacing some words or paraphrasing a sentence. We present Language-independent Data Augmentation (LiDA), a technique that utilizes a multilingual language model to create synthetic data from the available training dataset. Unlike other methods, our approach worked on the sentence embedding level independent of any particular language. We evaluated LiDA in three languages on various fractions of the dataset, and the result showed improved performance in both the LSTM and BERT models. Furthermore, we conducted an ablation study to determine the impact of the components in our method on overall performance. The source code of LiDA is available at https://github.com/yest/LiDA.

Original languageEnglish
Pages (from-to)10894-10901
Number of pages8
JournalIEEE Access
Volume11
DOIs
Publication statusPublished - 2023

All Science Journal Classification (ASJC) codes

  • General Engineering
  • General Materials Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'LiDA: Language-Independent Data Augmentation for Text Classification'. Together they form a unique fingerprint.

Cite this