A Robust Hierarchical Learning Approach for dynamic MEC Networks

Yi Chen Wu, Che Lin, Tony Q.S. Quek

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We consider a dynamic mobile edge computing (MEC) network with multiple computational access points (CAPs) that serve user equipment (UEs). We assume that UEs could join or leave the network due to mobility, resulting in the dynamic change in the network topology. To fully exploit the computational resource in the MEC network, the offloading decision, transmission power, and the computational resource should be appropriately allocated, and a robust design that addresses the above issues is necessary. In this work, we propose a robust hierarchical learning approach that applies deep Q networks (DQNs) and deep neural networks (DNNs) at the UEs and CAPs, respectively. Each UE interacts with the network environment and learns the best offloading decision policy in a local scope. Via sharing the local best policy learned by the UEs to the CAPs, the CAPs learn the relation between the UE location and the locally best strategy. The proposed robust approach suppresses the peak in cost caused by the dynamic topology change by up to 160% compared with a non-robust algorithm in the simulation. This demonstrates the necessity and benefit of robust design in a more realistic and dynamic MEC network.

Original languageEnglish
Title of host publication2020 IEEE Global Communications Conference, GLOBECOM 2020 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728182988
DOIs
Publication statusPublished - 2020 Dec
Event2020 IEEE Global Communications Conference, GLOBECOM 2020 - Virtual, Taipei, Taiwan
Duration: 2020 Dec 72020 Dec 11

Publication series

Name2020 IEEE Global Communications Conference, GLOBECOM 2020 - Proceedings

Conference

Conference2020 IEEE Global Communications Conference, GLOBECOM 2020
CountryTaiwan
CityVirtual, Taipei
Period20-12-0720-12-11

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Modelling and Simulation
  • Instrumentation
  • Artificial Intelligence
  • Computer Networks and Communications
  • Hardware and Architecture
  • Software
  • Safety, Risk, Reliability and Quality

Fingerprint Dive into the research topics of 'A Robust Hierarchical Learning Approach for dynamic MEC Networks'. Together they form a unique fingerprint.

Cite this