• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于强化学习的车到基础设施通信中的联合波束宽度与波束对准间隔优化

Reinforcement Learning-Based Joint Beamwidth and Beam Alignment Interval Optimization in V2I Communications.

作者信息

Lee Jihun, Kim Hun, So Jaewoo

机构信息

Department of Electronic Engineering, Sogang University, Seoul 04107, Republic of Korea.

出版信息

Sensors (Basel). 2024 Jan 27;24(3):837. doi: 10.3390/s24030837.

DOI:10.3390/s24030837
PMID:38339554
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10856984/
Abstract

The directional antenna combined with beamforming is one of the attractive solutions to accommodate high data rate applications in 5G vehicle communications. However, the directional nature of beamforming requires beam alignment between the transmitter and the receiver, which incurs significant signaling overhead. Hence, we need to find the optimal parameters for directional beamforming, i.e., the antenna beamwidth and beam alignment interval, that maximize the throughput, taking the beam alignment overhead into consideration. In this paper, we propose a reinforcement learning (RL)-based beamforming scheme in a vehicle-to-infrastructure system, where we jointly determine the antenna beamwidth and the beam alignment interval, taking into account the past and future rewards. The simulation results show that the proposed RL-based joint beamforming scheme outperforms conventional beamforming schemes in terms of the average throughput and the average link stability ratio.

摘要

结合波束赋形的定向天线是在5G车辆通信中适应高数据速率应用的有吸引力的解决方案之一。然而,波束赋形的定向特性要求发射机和接收机之间进行波束对准,这会产生大量的信令开销。因此,我们需要找到定向波束赋形的最优参数,即天线波束宽度和波束对准间隔,在考虑波束对准开销的情况下最大化吞吐量。在本文中,我们提出了一种基于强化学习(RL)的车辆到基础设施系统中的波束赋形方案,在该方案中,我们综合考虑过去和未来的奖励,联合确定天线波束宽度和波束对准间隔。仿真结果表明,所提出的基于RL的联合波束赋形方案在平均吞吐量和平均链路稳定性方面优于传统波束赋形方案。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/a4bfd6c91775/sensors-24-00837-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/c02b668c5030/sensors-24-00837-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/91e33de55b15/sensors-24-00837-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/903006a50e44/sensors-24-00837-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/c32c02afe8ba/sensors-24-00837-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/bf91ef66ca55/sensors-24-00837-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/86d99b68d7cc/sensors-24-00837-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/46d4b918b91b/sensors-24-00837-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/e8bd6aca31b5/sensors-24-00837-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/e627b69d1cf8/sensors-24-00837-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/5e33dcd04310/sensors-24-00837-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/a4bfd6c91775/sensors-24-00837-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/c02b668c5030/sensors-24-00837-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/91e33de55b15/sensors-24-00837-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/903006a50e44/sensors-24-00837-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/c32c02afe8ba/sensors-24-00837-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/bf91ef66ca55/sensors-24-00837-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/86d99b68d7cc/sensors-24-00837-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/46d4b918b91b/sensors-24-00837-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/e8bd6aca31b5/sensors-24-00837-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/e627b69d1cf8/sensors-24-00837-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/5e33dcd04310/sensors-24-00837-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6177/10856984/a4bfd6c91775/sensors-24-00837-g011.jpg

相似文献

1
Reinforcement Learning-Based Joint Beamwidth and Beam Alignment Interval Optimization in V2I Communications.基于强化学习的车到基础设施通信中的联合波束宽度与波束对准间隔优化
Sensors (Basel). 2024 Jan 27;24(3):837. doi: 10.3390/s24030837.
2
Deep Reinforcement Learning Assisted Beam Tracking and Data Transmission for 5G V2X Networks.用于5G车联网网络的深度强化学习辅助波束跟踪与数据传输
IEEE trans Intell Transp Syst. 2023;24(9). doi: 10.1109/tits.2023.3272548.
3
Attractor selection based limited feedback hybrid precoding for uplink V2I communications.用于上行链路车到基础设施通信的基于吸引子选择的有限反馈混合预编码
IEEE Trans Veh Technol. 2020;69(4). doi: 10.1109/tvt.2020.2971420.
4
Deep Reinforcement Learning-Based Coordinated Beamforming for mmWave Massive MIMO Vehicular Networks.基于深度强化学习的毫米波大规模 MIMO 车联网协同波束成形。
Sensors (Basel). 2023 Mar 3;23(5):2772. doi: 10.3390/s23052772.
5
Analysis of Beamforming Antenna for Practical Indoor Location-Tracking Application.用于实际室内位置跟踪应用的波束形成天线分析
Sensors (Basel). 2019 Jul 10;19(14):3040. doi: 10.3390/s19143040.
6
Random Beam-Based Non-Orthogonal Multiple Access for Low Latency K-User MISO Broadcast Channels.基于随机波束的非正交多址接入在低延迟 K 用户 MISO 广播信道中的应用
Sensors (Basel). 2021 Jun 26;21(13):4373. doi: 10.3390/s21134373.
7
Neuroevolution-Based Adaptive Antenna Array Beamforming Scheme to Improve the V2V Communication Performance at Intersections.基于神经进化的自适应天线阵波束形成方案,提高交叉口 V2V 通信性能。
Sensors (Basel). 2021 Apr 23;21(9):2956. doi: 10.3390/s21092956.
8
Ultra-Reliable Deep-Reinforcement-Learning-Based Intelligent Downlink Scheduling for 5G New Radio-Vehicle to Infrastructure Scenarios.基于超可靠深度强化学习的5G新无线电车到基础设施场景智能下行链路调度
Sensors (Basel). 2023 Oct 13;23(20):8454. doi: 10.3390/s23208454.
9
Investigation on Beam Alignment of a Microstrip-Line Butler Matrix and an SIW Butler Matrix for 5G Beamforming Antennas through RF-to-RF Wireless Sensing and 64-QAM Tests.通过射频到射频无线传感和64-QAM测试对用于5G波束成形天线的微带线巴特勒矩阵和基片集成波导巴特勒矩阵的波束对准进行研究。
Sensors (Basel). 2021 Oct 14;21(20):6830. doi: 10.3390/s21206830.
10
Reinforcement learning-based adaptive beam alignment in a photodiode-integrated array antenna module.基于强化学习的光电二极管集成阵列天线模块中的自适应波束对准
Opt Lett. 2024 Feb 1;49(3):666-669. doi: 10.1364/OL.502638.

引用本文的文献

1
Distributed Multi-Agent Deep Reinforcement Learning-Based Transmit Power Control in Cellular Networks.基于分布式多智能体深度强化学习的蜂窝网络发射功率控制
Sensors (Basel). 2025 Jun 27;25(13):4017. doi: 10.3390/s25134017.

本文引用的文献

1
Advances in MIMO Antenna Design for 5G: A Comprehensive Review.5G 多输入多输出(MIMO)天线设计进展:全面综述
Sensors (Basel). 2023 Jul 12;23(14):6329. doi: 10.3390/s23146329.
2
Energy-Efficient Resource Allocation Based on Deep Q-Network in V2V Communications.基于深度 Q 网络的车对车通信中的节能资源分配。
Sensors (Basel). 2023 Jan 23;23(3):1295. doi: 10.3390/s23031295.
3
High gain modified Vivaldi vehicular antenna for IoV communications in 5G network.用于5G网络车联网通信的高增益改进型维瓦尔第车载天线。
Heliyon. 2022 Apr 27;8(5):e09336. doi: 10.1016/j.heliyon.2022.e09336. eCollection 2022 May.
4
Wideband miniaturized patch radiator for Sub-6 GHz 5G devices.用于低于6GHz 5G设备的宽带小型化贴片辐射器。
Heliyon. 2021 Sep 3;7(9):e07931. doi: 10.1016/j.heliyon.2021.e07931. eCollection 2021 Sep.
5
Sensor-Aided V2X Beam Tracking for Connected Automated Driving: Distributed Architecture and Processing Algorithms.用于联网自动驾驶的传感器辅助V2X波束跟踪:分布式架构与处理算法
Sensors (Basel). 2020 Jun 24;20(12):3573. doi: 10.3390/s20123573.
6
Application of motion sensors for beam-tracking of mobile stations in mmWave communication systems.运动传感器在毫米波通信系统中用于移动台波束跟踪的应用。
Sensors (Basel). 2014 Oct 20;14(10):19622-38. doi: 10.3390/s141019622.