Toward Fast Personalized Semi-Supervised Federated Learning in Edge Networks: Algorithm Design and Theoretical Guarantee

Shuai Wang, Yanqing Xu, Yanli Yuan, Tony Q.S. Quek

研究成果: Article同行評審

摘要

Recent years have witnessed a huge demand for artificial intelligence and machine learning applications in wireless edge networks to assist individuals with real-time services. Federated learning (FL) has emerged as a suitable and appealing distributed learning paradigm to deploy these applications at the network edge. Despite the many successful efforts made to apply FL to wireless edge networks, the adopted algorithms mostly follow the same spirit as FedAvg, thereby heavily suffering from the practical challenges of label deficiency and device heterogeneity. These challenges not only decelerate the model training in FL but also downgrade the application performance. In this paper, we focus on the algorithm design and address these challenges by investigating the personalized semi-supervised FL problem and proposing an effective algorithm, named FedCPSL. In particular, the techniques of pseudo-labeling, and interpolation-based model personalization are judiciously combined to provide a new problem formulation for personalized semi-supervised FL. The proposed FedCPSL algorithm employs novel strategies, including adaptive client variance reduction, local momentum, and normalized global aggregation, to combat the challenge of device heterogeneity and boost algorithm convergence. The convergence property of FedCPSL is also thoroughly analyzed and shows that FedCPSL is resilient to both statistical and system heterogeneity, obtaining a sublinear convergence rate. Experimental results on image classification tasks are presented to demonstrate that the proposed approach outperforms its counterparts in terms of both convergence speed and application performance.

原文English
頁(從 - 到)1170-1183
頁數14
期刊IEEE Transactions on Wireless Communications
23
發行號2
DOIs
出版狀態Published - 2024 2月 1

All Science Journal Classification (ASJC) codes

  • 電腦科學應用
  • 電氣與電子工程
  • 應用數學

指紋

深入研究「Toward Fast Personalized Semi-Supervised Federated Learning in Edge Networks: Algorithm Design and Theoretical Guarantee」主題。共同形成了獨特的指紋。

引用此