• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

深度强化学习控制可在湍流对流中实现强化传热。

Deep reinforcement learning control unlocks enhanced heat transfer in turbulent convection.

作者信息

Zhou Zisong, Zhu Xiaojue

机构信息

Max Planck Institute for Solar System Research, Göttingen 37077, Germany.

出版信息

Proc Natl Acad Sci U S A. 2025 Sep 16;122(37):e2506351122. doi: 10.1073/pnas.2506351122. Epub 2025 Sep 9.

DOI:10.1073/pnas.2506351122
PMID:40924461
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC12452834/
Abstract

Turbulent convection governs heat transport in both natural and industrial settings, yet optimizing it under extreme conditions remains a significant challenge. Traditional control strategies, such as predefined temperature modulation, struggle to achieve substantial enhancement. Here, we introduce a deep reinforcement learning (DRL) framework that autonomously discovers optimal control policies to maximize heat transfer in turbulent Rayleigh-Bénard convection. By dynamically adjusting wall temperature fluctuations, the DRL agent achieves a heat transfer enhancement of up to 38.5%, exceeding the 20 to 25% limit of conventional methods. The learned strategy reveals a nonlinear state-action relationship, inducing a fully modulated boundary layer regime. Furthermore, we distill the DRL insights into a simplified bang-bang control model, which retains comparable performance (up to 40.0% enhancement) and, crucially, generalizes to unseen, higher Rayleigh number cases without additional training. Our results demonstrate the power of machine learning in turbulence control and reveal a framework with potential for intelligent heat transfer optimization in real-world applications.

摘要

湍流对流在自然和工业环境中都控制着热传输,但在极端条件下对其进行优化仍然是一项重大挑战。传统的控制策略,如预定义的温度调制,难以实现显著增强。在此,我们引入了一种深度强化学习(DRL)框架,该框架能自主发现最优控制策略,以在湍流瑞利 - 贝纳德对流中最大化热传递。通过动态调整壁面温度波动,DRL智能体实现了高达38.5%的热传递增强,超过了传统方法20%至25%的极限。所学到的策略揭示了一种非线性的状态 - 动作关系,引发了完全调制的边界层状态。此外,我们将DRL的见解提炼成一个简化的继电控制模型,该模型保持了可比的性能(增强高达40.0%),并且至关重要的是,无需额外训练就能推广到未见过的、更高瑞利数的情况。我们的结果证明了机器学习在湍流控制中的力量,并揭示了一个在实际应用中具有智能热传递优化潜力的框架。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4f2e/12452834/06e2b105a04f/pnas.2506351122fig04.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4f2e/12452834/c6e94fae55ff/pnas.2506351122fig01.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4f2e/12452834/f0ca6b56cc4a/pnas.2506351122fig02.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4f2e/12452834/493002f69220/pnas.2506351122fig03.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4f2e/12452834/06e2b105a04f/pnas.2506351122fig04.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4f2e/12452834/c6e94fae55ff/pnas.2506351122fig01.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4f2e/12452834/f0ca6b56cc4a/pnas.2506351122fig02.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4f2e/12452834/493002f69220/pnas.2506351122fig03.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/4f2e/12452834/06e2b105a04f/pnas.2506351122fig04.jpg

相似文献

1
Deep reinforcement learning control unlocks enhanced heat transfer in turbulent convection.深度强化学习控制可在湍流对流中实现强化传热。
Proc Natl Acad Sci U S A. 2025 Sep 16;122(37):e2506351122. doi: 10.1073/pnas.2506351122. Epub 2025 Sep 9.
2
Q-learning with temporal memory to navigate turbulence.基于时间记忆的Q学习以应对动荡。
Elife. 2025 Jul 21;13:RP102906. doi: 10.7554/eLife.102906.
3
Hierarchical network of thermal plumes and their dynamics in turbulent Rayleigh-Bénard convection.湍流瑞利-贝纳德对流中热羽流的层级网络及其动力学
Proc Natl Acad Sci U S A. 2025 Aug 12;122(32):e2502972122. doi: 10.1073/pnas.2502972122. Epub 2025 Aug 5.
4
Shapley value-driven multi-modal deep reinforcement learning for complex decision-making.用于复杂决策的沙普利值驱动多模态深度强化学习
Neural Netw. 2025 Nov;191:107650. doi: 10.1016/j.neunet.2025.107650. Epub 2025 Jun 21.
5
Privacy-Preserving Glycemic Management in Type 1 Diabetes: Development and Validation of a Multiobjective Federated Reinforcement Learning Framework.1型糖尿病中保护隐私的血糖管理:多目标联邦强化学习框架的开发与验证
JMIR Diabetes. 2025 Jul 4;10:e72874. doi: 10.2196/72874.
6
Touching the classical scaling in penetrative convection.触及穿透对流中的经典标度律。
Proc Natl Acad Sci U S A. 2025 Feb 11;122(6):e2418468122. doi: 10.1073/pnas.2418468122. Epub 2025 Feb 7.
7
Deep reinforcement learning-based controller for DC-link voltage regulation and voltage sag compensation in a solar PV-integrated UPQC system.基于深度强化学习的控制器,用于光伏集成型统一电能质量调节器(UPQC)系统中的直流母线电压调节和电压暂降补偿
Sci Rep. 2025 Jul 16;15(1):25800. doi: 10.1038/s41598-025-08729-1.
8
Structure transfer and consolidation in visual implicit learning.视觉内隐学习中的结构迁移与巩固
Elife. 2025 Sep 16;13:RP100785. doi: 10.7554/eLife.100785.
9
Prescription of Controlled Substances: Benefits and Risks管制药品的处方:益处与风险
10
An novel cloud task scheduling framework using hierarchical deep reinforcement learning for cloud computing.一种用于云计算的基于分层深度强化学习的新型云任务调度框架。
PLoS One. 2025 Aug 21;20(8):e0329669. doi: 10.1371/journal.pone.0329669. eCollection 2025.

本文引用的文献

1
Flow control of three-dimensional cylinders transitioning to turbulence via multi-agent reinforcement learning.通过多智能体强化学习对三维圆柱体向湍流过渡的流动控制。
Commun Eng. 2025 Jun 18;4(1):113. doi: 10.1038/s44172-025-00446-x.
2
Ultimate Regime of Rayleigh-Bénard Turbulence: Subregimes and Their Scaling Relations for the Nusselt vs Rayleigh and Prandtl Numbers.
Phys Rev Lett. 2024 Oct 4;133(14):144001. doi: 10.1103/PhysRevLett.133.144001.
3
Deep reinforcement learning for turbulent drag reduction in channel flows.用于渠道流中湍流减阻的深度强化学习。
Eur Phys J E Soft Matter. 2023 Apr 11;46(4):27. doi: 10.1140/epje/s10189-023-00285-8.
4
Modulation of turbulent Rayleigh-Bénard convection under spatially harmonic heating.
Phys Rev E. 2022 May;105(5-2):055107. doi: 10.1103/PhysRevE.105.055107.
5
Symmetry reduction for deep reinforcement learning active control of chaotic spatiotemporal dynamics.用于混沌时空动力学深度强化学习主动控制的对称性约化
Phys Rev E. 2021 Jul;104(1-1):014210. doi: 10.1103/PhysRevE.104.014210.
6
Periodically Modulated Thermal Convection.周期性调制热对流
Phys Rev Lett. 2020 Oct 9;125(15):154502. doi: 10.1103/PhysRevLett.125.154502.
7
Vibration-induced boundary-layer destabilization achieves massive heat-transport enhancement.振动诱导的边界层失稳实现了大量的热传输增强。
Sci Adv. 2020 May 22;6(21):eaaz8239. doi: 10.1126/sciadv.aaz8239. eCollection 2020 May.
8
Self-sustained biphasic catalytic particle turbulence.自持双相催化颗粒湍流
Nat Commun. 2019 Jul 26;10(1):3333. doi: 10.1038/s41467-019-11221-w.
9
Turbulent superstructures in Rayleigh-Bénard convection.瑞利-贝纳尔对流中的湍动超结构。
Nat Commun. 2018 May 29;9(1):2118. doi: 10.1038/s41467-018-04478-0.
10
Controlling Heat Transport and Flow Structures in Thermal Turbulence Using Ratchet Surfaces.利用棘齿表面控制热湍流中的热输运和流结构。
Phys Rev Lett. 2018 Jan 26;120(4):044501. doi: 10.1103/PhysRevLett.120.044501.