• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

MAARS:多接入边缘计算中用于资源分配和网络切片的多智能体演员-评论家方法。

MAARS: Multiagent Actor-Critic Approach for Resource Allocation and Network Slicing in Multiaccess Edge Computing.

作者信息

Lim Ducsun, Joe Inwhee

机构信息

Department of Computer Software, Hanyang University, Seoul 04763, Republic of Korea.

出版信息

Sensors (Basel). 2024 Dec 4;24(23):7760. doi: 10.3390/s24237760.

DOI:10.3390/s24237760
PMID:39686297
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11645020/
Abstract

This paper presents a novel algorithm to address resource allocation and network-slicing challenges in multiaccess edge computing (MEC) networks. Network slicing divides a physical network into virtual slices, each tailored to efficiently allocate resources and meet diverse service requirements. To maximize the completion rate of user-computing tasks within these slices, the problem is decomposed into two subproblems: efficient core-to-edge slicing (ECS) and autonomous resource slicing (ARS). ECS facilitates collaborative resource distribution through cooperation among edge servers, while ARS dynamically manages resources based on real-time network conditions. The proposed solution, a multiagent actor-critic resource scheduling (MAARS) algorithm, employs a reinforcement learning framework. Specifically, MAARS utilizes a multiagent deep deterministic policy gradient (MADDPG) for efficient resource distribution in ECS and a soft actor-critic (SAC) technique for robust real-time resource management in ARS. Simulation results demonstrate that MAARS outperforms benchmark algorithms, including heuristic-based, DQN-based, and A2C-based methods, in terms of task completion rates, resource utilization, and convergence speed. Thus, this study offers a scalable and efficient framework for resource optimization and network slicing in MEC networks, providing practical benefits for real-world deployments and setting a new performance benchmark in dynamic environments.

摘要

本文提出了一种新颖的算法,以应对多接入边缘计算(MEC)网络中的资源分配和网络切片挑战。网络切片将物理网络划分为虚拟切片,每个虚拟切片都经过定制,以有效地分配资源并满足多样化的服务需求。为了最大化这些切片内用户计算任务的完成率,该问题被分解为两个子问题:高效的核心到边缘切片(ECS)和自主资源切片(ARS)。ECS通过边缘服务器之间的协作促进资源的协同分配,而ARS则根据实时网络状况动态管理资源。所提出的解决方案是一种多智能体演员-评论家资源调度(MAARS)算法,采用了强化学习框架。具体而言,MAARS在ECS中利用多智能体深度确定性策略梯度(MADDPG)进行高效的资源分配,并在ARS中利用软演员-评论家(SAC)技术进行稳健的实时资源管理。仿真结果表明,MAARS在任务完成率、资源利用率和收敛速度方面优于包括基于启发式、基于深度Q网络(DQN)和基于异步优势演员-评论家(A2C)的方法在内的基准算法。因此,本研究为MEC网络中的资源优化和网络切片提供了一个可扩展且高效的框架,为实际部署带来了实际益处,并在动态环境中设定了新的性能基准。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/66a3b5eafc0c/sensors-24-07760-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/3dc6c51f6ec9/sensors-24-07760-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/3a270be0f89a/sensors-24-07760-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/1e4945b490c3/sensors-24-07760-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/963002010927/sensors-24-07760-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/25cfaa9e7238/sensors-24-07760-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/ff6fdae25230/sensors-24-07760-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/4e7b5daedbee/sensors-24-07760-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/c25ec01c226a/sensors-24-07760-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/4d8f02be86be/sensors-24-07760-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/064ae5dae53a/sensors-24-07760-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/66a3b5eafc0c/sensors-24-07760-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/3dc6c51f6ec9/sensors-24-07760-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/3a270be0f89a/sensors-24-07760-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/1e4945b490c3/sensors-24-07760-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/963002010927/sensors-24-07760-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/25cfaa9e7238/sensors-24-07760-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/ff6fdae25230/sensors-24-07760-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/4e7b5daedbee/sensors-24-07760-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/c25ec01c226a/sensors-24-07760-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/4d8f02be86be/sensors-24-07760-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/064ae5dae53a/sensors-24-07760-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e02e/11645020/66a3b5eafc0c/sensors-24-07760-g011.jpg

相似文献

1
MAARS: Multiagent Actor-Critic Approach for Resource Allocation and Network Slicing in Multiaccess Edge Computing.MAARS:多接入边缘计算中用于资源分配和网络切片的多智能体演员-评论家方法。
Sensors (Basel). 2024 Dec 4;24(23):7760. doi: 10.3390/s24237760.
2
Utility-Driven End-to-End Network Slicing for Diverse IoT Users in MEC: A Multi-Agent Deep Reinforcement Learning Approach.用于多接入边缘计算(MEC)中不同物联网用户的效用驱动端到端网络切片:一种多智能体深度强化学习方法。
Sensors (Basel). 2024 Aug 28;24(17):5558. doi: 10.3390/s24175558.
3
Task Offloading Decision-Making Algorithm for Vehicular Edge Computing: A Deep-Reinforcement-Learning-Based Approach.车载边缘计算的任务卸载决策算法:一种基于深度强化学习的方法。
Sensors (Basel). 2023 Sep 1;23(17):7595. doi: 10.3390/s23177595.
4
Two Tier Slicing Resource Allocation Algorithm Based on Deep Reinforcement Learning and Joint Bidding in Wireless Access Networks.基于深度强化学习和联合竞价的无线接入网络双层切片资源分配算法
Sensors (Basel). 2022 May 4;22(9):3495. doi: 10.3390/s22093495.
5
Intelligent Task Dispatching and Scheduling Using a Deep Q-Network in a Cluster Edge Computing System.在集群边缘计算系统中使用深度Q网络的智能任务调度与分配
Sensors (Basel). 2022 May 28;22(11):4098. doi: 10.3390/s22114098.
6
Deep Reinforcement Learning for Computation Offloading and Resource Allocation in Unmanned-Aerial-Vehicle Assisted Edge Computing.无人机辅助边缘计算中用于计算卸载和资源分配的深度强化学习
Sensors (Basel). 2021 Sep 29;21(19):6499. doi: 10.3390/s21196499.
7
Deep Deterministic Policy Gradient-Based Resource Allocation Considering Network Slicing and Device-to-Device Communication in Mobile Networks.移动网络中基于深度确定性策略梯度的考虑网络切片和设备到设备通信的资源分配
Sensors (Basel). 2024 Sep 20;24(18):6079. doi: 10.3390/s24186079.
8
Deep Reinforcement Learning for Resource Management on Network Slicing: A Survey.深度强化学习在网络切片资源管理中的应用研究综述。
Sensors (Basel). 2022 Apr 15;22(8):3031. doi: 10.3390/s22083031.
9
Deep reinforcement learning based offloading decision algorithm for vehicular edge computing.基于深度强化学习的车载边缘计算卸载决策算法
PeerJ Comput Sci. 2022 Oct 11;8:e1126. doi: 10.7717/peerj-cs.1126. eCollection 2022.
10
Deep Reinforcement Learning-Empowered Resource Allocation for Mobile Edge Computing in Cellular V2X Networks.深度强化学习助力蜂窝车联网网络中移动边缘计算的资源分配
Sensors (Basel). 2021 Jan 7;21(2):372. doi: 10.3390/s21020372.

本文引用的文献

1
Human-level control through deep reinforcement learning.通过深度强化学习实现人类水平的控制。
Nature. 2015 Feb 26;518(7540):529-33. doi: 10.1038/nature14236.