TY - GEN
T1 - Towards Fast and Energy-Efficient Hierarchical Federated Edge Learning
T2 - 2022 IEEE International Conference on Communications, ICC 2022
AU - Wen, Wanli
AU - Yang, Howard H.
AU - Xia, Wenchao
AU - Quek, Tony Q.S.
N1 - Funding Information:
This work was sponsored by the Natural Science Foundation of Chongqing, China (cstc2021jcyj-msxmX0458), the open research fund of National Mobile Communications Research Laboratory, Southeast University (2022D06), the Zhejiang Provincial Natural Science Foundation of China (LGJ22F010001), the Zhejiang University/University of Illinois at Urbana-Champaign Institute Starting Fund, the ZJU-UIUC Joint Research Center Project (DREMES 202003), the Natural Science Foundation on Frontier Leading Technology Basic Research Project of Jiangsu (BK20212001), and the Natural Science Research Project of Jiangsu Higher Education Institutions (21KJB510034).
Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Hierarchical federated edge learning (H-FEEL) has been recently proposed to enhance the federated learning model. Such a system generally consists of three entities, i.e., the server, helpers, and clients. Each helper collects the trained gradients from users nearby, aggregates them, and sends the result to the server for model update. Due to limited communication resources, only a portion of helpers can upload their aggregated gradients to the server, thereby necessitating a well design for helper scheduling and communication resources allocation. In this paper, we develop a training algorithm for H-FEEL which involves local gradient computing, weighted gradient uploading, and model updating phases. By characterizing these phases mathematically and analyzing the one-round convergence bound of the training algorithm, we formulate a problem to achieve the scheduling and resource allocation scheme. To solve the problem, we first transform it into an equivalent problem and then decompose the transformed problem into two subproblems: bit and sub-channel allocation problem and helper scheduling problem. For the first subproblem, we obtain a low-complexity suboptimal solution by using a four-stage method. For the second subproblem, we obtain a stationary point by using the penalty convex-concave procedure. The efficacy of our scheme is demonstrated via simulations, and the analytical framework is shown to provide valuable insights for the design of practical H-FEEL system.
AB - Hierarchical federated edge learning (H-FEEL) has been recently proposed to enhance the federated learning model. Such a system generally consists of three entities, i.e., the server, helpers, and clients. Each helper collects the trained gradients from users nearby, aggregates them, and sends the result to the server for model update. Due to limited communication resources, only a portion of helpers can upload their aggregated gradients to the server, thereby necessitating a well design for helper scheduling and communication resources allocation. In this paper, we develop a training algorithm for H-FEEL which involves local gradient computing, weighted gradient uploading, and model updating phases. By characterizing these phases mathematically and analyzing the one-round convergence bound of the training algorithm, we formulate a problem to achieve the scheduling and resource allocation scheme. To solve the problem, we first transform it into an equivalent problem and then decompose the transformed problem into two subproblems: bit and sub-channel allocation problem and helper scheduling problem. For the first subproblem, we obtain a low-complexity suboptimal solution by using a four-stage method. For the second subproblem, we obtain a stationary point by using the penalty convex-concave procedure. The efficacy of our scheme is demonstrated via simulations, and the analytical framework is shown to provide valuable insights for the design of practical H-FEEL system.
UR - http://www.scopus.com/inward/record.url?scp=85137264113&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85137264113&partnerID=8YFLogxK
U2 - 10.1109/ICC45855.2022.9838950
DO - 10.1109/ICC45855.2022.9838950
M3 - Conference contribution
AN - SCOPUS:85137264113
T3 - IEEE International Conference on Communications
SP - 5378
EP - 5383
BT - ICC 2022 - IEEE International Conference on Communications
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 16 May 2022 through 20 May 2022
ER -