LiDA: Language-Independent Data Augmentation for Text Classification

Yudianto Sujana, Hung Yu Kao

研究成果: Article同行評審

6 引文 斯高帕斯(Scopus)

摘要

Developing a high-performance text classification model in a low-resource language is challenging due to the lack of labeled data. Meanwhile, collecting large amounts of labeled data is cost-inefficient. One approach to increase the amount of labeled data is to create synthetic data using data augmentation techniques. However, most of the available data augmentation techniques work on English data and are highly language-dependent as they perform at the word and sentence level, such as replacing some words or paraphrasing a sentence. We present Language-independent Data Augmentation (LiDA), a technique that utilizes a multilingual language model to create synthetic data from the available training dataset. Unlike other methods, our approach worked on the sentence embedding level independent of any particular language. We evaluated LiDA in three languages on various fractions of the dataset, and the result showed improved performance in both the LSTM and BERT models. Furthermore, we conducted an ablation study to determine the impact of the components in our method on overall performance. The source code of LiDA is available at https://github.com/yest/LiDA.

原文English
頁(從 - 到)10894-10901
頁數8
期刊IEEE Access
11
DOIs
出版狀態Published - 2023

All Science Journal Classification (ASJC) codes

  • 一般工程
  • 一般材料科學
  • 一般電腦科學

指紋

深入研究「LiDA: Language-Independent Data Augmentation for Text Classification」主題。共同形成了獨特的指紋。

引用此