Lim Ducsun, Joe Inwhee
Department of Computer Software, Hanyang University, Seoul 04763, Republic of Korea.
Sensors (Basel). 2024 Dec 4;24(23):7760. doi: 10.3390/s24237760.
This paper presents a novel algorithm to address resource allocation and network-slicing challenges in multiaccess edge computing (MEC) networks. Network slicing divides a physical network into virtual slices, each tailored to efficiently allocate resources and meet diverse service requirements. To maximize the completion rate of user-computing tasks within these slices, the problem is decomposed into two subproblems: efficient core-to-edge slicing (ECS) and autonomous resource slicing (ARS). ECS facilitates collaborative resource distribution through cooperation among edge servers, while ARS dynamically manages resources based on real-time network conditions. The proposed solution, a multiagent actor-critic resource scheduling (MAARS) algorithm, employs a reinforcement learning framework. Specifically, MAARS utilizes a multiagent deep deterministic policy gradient (MADDPG) for efficient resource distribution in ECS and a soft actor-critic (SAC) technique for robust real-time resource management in ARS. Simulation results demonstrate that MAARS outperforms benchmark algorithms, including heuristic-based, DQN-based, and A2C-based methods, in terms of task completion rates, resource utilization, and convergence speed. Thus, this study offers a scalable and efficient framework for resource optimization and network slicing in MEC networks, providing practical benefits for real-world deployments and setting a new performance benchmark in dynamic environments.
本文提出了一种新颖的算法,以应对多接入边缘计算(MEC)网络中的资源分配和网络切片挑战。网络切片将物理网络划分为虚拟切片,每个虚拟切片都经过定制,以有效地分配资源并满足多样化的服务需求。为了最大化这些切片内用户计算任务的完成率,该问题被分解为两个子问题:高效的核心到边缘切片(ECS)和自主资源切片(ARS)。ECS通过边缘服务器之间的协作促进资源的协同分配,而ARS则根据实时网络状况动态管理资源。所提出的解决方案是一种多智能体演员-评论家资源调度(MAARS)算法,采用了强化学习框架。具体而言,MAARS在ECS中利用多智能体深度确定性策略梯度(MADDPG)进行高效的资源分配,并在ARS中利用软演员-评论家(SAC)技术进行稳健的实时资源管理。仿真结果表明,MAARS在任务完成率、资源利用率和收敛速度方面优于包括基于启发式、基于深度Q网络(DQN)和基于异步优势演员-评论家(A2C)的方法在内的基准算法。因此,本研究为MEC网络中的资源优化和网络切片提供了一个可扩展且高效的框架,为实际部署带来了实际益处,并在动态环境中设定了新的性能基准。