Training Classifiers that are Universally Robust to All Label Noise Levels

Jingyi Xu, Tony Q.S. Quek, Kai Fong Ernest Chong

研究成果: Conference contribution

摘要

For classification tasks, deep neural networks are prone to overfitting in the presence of label noise. Although existing methods are able to alleviate this problem at low noise levels, they encounter significant performance reduction at high noise levels, or even at medium noise levels when the label noise is asymmetric. To train classifiers that are universally robust to all noise levels, and that are not sensitive to any variation in the noise model, we propose a distillation-based framework that incorporates a new subcategory of Positive-Unlabeled learning. In particular, we shall assume that a small subset of any given noisy dataset is known to have correct labels, which we treat as 'positive', while the remaining noisy subset is treated as 'unlabeled'. Our framework consists of the following two components: (1) We shall generate, via iterative updates, an augmented clean subset with additional reliable 'positive' samples filtered from 'unlabeled' samples; (2) We shall train a teacher model on this larger augmented clean set. With the guidance of the teacher model, we then train a student model on the whole dataset. Experiments were conducted on the CIFAR-10 dataset with synthetic label noise at multiple noise levels for both symmetric and asymmetric noise. The results show that our framework generally outperforms at medium to high noise levels. We also evaluated our framework on Clothing1M, a real-world noisy dataset, and we achieved 2.94% improvement in accuracy over existing state-of-the-art methods.

原文English
主出版物標題IJCNN 2021 - International Joint Conference on Neural Networks, Proceedings
發行者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子)9780738133669
DOIs
出版狀態Published - 2021 七月 18
事件2021 International Joint Conference on Neural Networks, IJCNN 2021 - Virtual, Shenzhen, China
持續時間: 2021 七月 182021 七月 22

出版系列

名字Proceedings of the International Joint Conference on Neural Networks
2021-July

Conference

Conference2021 International Joint Conference on Neural Networks, IJCNN 2021
國家/地區China
城市Virtual, Shenzhen
期間21-07-1821-07-22

All Science Journal Classification (ASJC) codes

  • 軟體
  • 人工智慧

指紋

深入研究「Training Classifiers that are Universally Robust to All Label Noise Levels」主題。共同形成了獨特的指紋。

引用此