TY - GEN
T1 - A Robust Hierarchical Learning Approach for dynamic MEC Networks
AU - Wu, Yi Chen
AU - Lin, Che
AU - Quek, Tony Q.S.
N1 - Funding Information:
§This work is supported by the Ministry of Science and Technology, R.O.C., under Grants MOST107-2221-E-002 -196 -MY3.
Publisher Copyright:
© 2020 IEEE.
PY - 2020/12
Y1 - 2020/12
N2 - We consider a dynamic mobile edge computing (MEC) network with multiple computational access points (CAPs) that serve user equipment (UEs). We assume that UEs could join or leave the network due to mobility, resulting in the dynamic change in the network topology. To fully exploit the computational resource in the MEC network, the offloading decision, transmission power, and the computational resource should be appropriately allocated, and a robust design that addresses the above issues is necessary. In this work, we propose a robust hierarchical learning approach that applies deep Q networks (DQNs) and deep neural networks (DNNs) at the UEs and CAPs, respectively. Each UE interacts with the network environment and learns the best offloading decision policy in a local scope. Via sharing the local best policy learned by the UEs to the CAPs, the CAPs learn the relation between the UE location and the locally best strategy. The proposed robust approach suppresses the peak in cost caused by the dynamic topology change by up to 160% compared with a non-robust algorithm in the simulation. This demonstrates the necessity and benefit of robust design in a more realistic and dynamic MEC network.
AB - We consider a dynamic mobile edge computing (MEC) network with multiple computational access points (CAPs) that serve user equipment (UEs). We assume that UEs could join or leave the network due to mobility, resulting in the dynamic change in the network topology. To fully exploit the computational resource in the MEC network, the offloading decision, transmission power, and the computational resource should be appropriately allocated, and a robust design that addresses the above issues is necessary. In this work, we propose a robust hierarchical learning approach that applies deep Q networks (DQNs) and deep neural networks (DNNs) at the UEs and CAPs, respectively. Each UE interacts with the network environment and learns the best offloading decision policy in a local scope. Via sharing the local best policy learned by the UEs to the CAPs, the CAPs learn the relation between the UE location and the locally best strategy. The proposed robust approach suppresses the peak in cost caused by the dynamic topology change by up to 160% compared with a non-robust algorithm in the simulation. This demonstrates the necessity and benefit of robust design in a more realistic and dynamic MEC network.
UR - http://www.scopus.com/inward/record.url?scp=85100409974&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85100409974&partnerID=8YFLogxK
U2 - 10.1109/GLOBECOM42002.2020.9322513
DO - 10.1109/GLOBECOM42002.2020.9322513
M3 - Conference contribution
AN - SCOPUS:85100409974
T3 - 2020 IEEE Global Communications Conference, GLOBECOM 2020 - Proceedings
BT - 2020 IEEE Global Communications Conference, GLOBECOM 2020 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2020 IEEE Global Communications Conference, GLOBECOM 2020
Y2 - 7 December 2020 through 11 December 2020
ER -