Zhou Zisong, Zhu Xiaojue
Max Planck Institute for Solar System Research, Göttingen 37077, Germany.
Proc Natl Acad Sci U S A. 2025 Sep 16;122(37):e2506351122. doi: 10.1073/pnas.2506351122. Epub 2025 Sep 9.
Turbulent convection governs heat transport in both natural and industrial settings, yet optimizing it under extreme conditions remains a significant challenge. Traditional control strategies, such as predefined temperature modulation, struggle to achieve substantial enhancement. Here, we introduce a deep reinforcement learning (DRL) framework that autonomously discovers optimal control policies to maximize heat transfer in turbulent Rayleigh-Bénard convection. By dynamically adjusting wall temperature fluctuations, the DRL agent achieves a heat transfer enhancement of up to 38.5%, exceeding the 20 to 25% limit of conventional methods. The learned strategy reveals a nonlinear state-action relationship, inducing a fully modulated boundary layer regime. Furthermore, we distill the DRL insights into a simplified bang-bang control model, which retains comparable performance (up to 40.0% enhancement) and, crucially, generalizes to unseen, higher Rayleigh number cases without additional training. Our results demonstrate the power of machine learning in turbulence control and reveal a framework with potential for intelligent heat transfer optimization in real-world applications.
湍流对流在自然和工业环境中都控制着热传输,但在极端条件下对其进行优化仍然是一项重大挑战。传统的控制策略,如预定义的温度调制,难以实现显著增强。在此,我们引入了一种深度强化学习(DRL)框架,该框架能自主发现最优控制策略,以在湍流瑞利 - 贝纳德对流中最大化热传递。通过动态调整壁面温度波动,DRL智能体实现了高达38.5%的热传递增强,超过了传统方法20%至25%的极限。所学到的策略揭示了一种非线性的状态 - 动作关系,引发了完全调制的边界层状态。此外,我们将DRL的见解提炼成一个简化的继电控制模型,该模型保持了可比的性能(增强高达40.0%),并且至关重要的是,无需额外训练就能推广到未见过的、更高瑞利数的情况。我们的结果证明了机器学习在湍流控制中的力量,并揭示了一个在实际应用中具有智能热传递优化潜力的框架。