• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

SMGformer:在深度学习模型中集成STL和多头自注意力用于多步径流预测

SMGformer: integrating STL and multi-head self-attention in deep learning model for multi-step runoff forecasting.

作者信息

Wang Wen-Chuan, Gu Miao, Hong Yang-Hao, Hu Xiao-Xue, Zang Hong-Fei, Chen Xiao-Nan, Jin Yan-Guo

机构信息

College of Water Resources, North China University of Water Resources and Electric Power, Zhengzhou, 450046, China.

China South-to-North Water Diversion Middle Route Corporation Limited, Beijing, 100038, China.

出版信息

Sci Rep. 2024 Oct 9;14(1):23550. doi: 10.1038/s41598-024-74329-0.

DOI:10.1038/s41598-024-74329-0
PMID:39384833
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11464814/
Abstract

Accurate runoff forecasting is of great significance for water resource allocation flood control and disaster reduction. However, due to the inherent strong randomness of runoff sequences, this task faces significant challenges. To address this challenge, this study proposes a new SMGformer runoff forecast model. The model integrates Seasonal and Trend decomposition using Loess (STL), Informer's Encoder layer, Bidirectional Gated Recurrent Unit (BiGRU), and Multi-head self-attention (MHSA). Firstly, in response to the nonlinear and non-stationary characteristics of the runoff sequence, the STL decomposition is used to extract the runoff sequence's trend, period, and residual terms, and a multi-feature set based on 'sequence-sequence' is constructed as the input of the model, providing a foundation for subsequent models to capture the evolution of runoff. The key features of the input set are then captured using the Informer's Encoder layer. Next, the BiGRU layer is used to learn the temporal information of these features. To further optimize the output of the BiGRU layer, the MHSA mechanism is introduced to emphasize the impact of important information. Finally, accurate runoff forecasting is achieved by transforming the output of the MHSA layer through the Fully connected layer. To verify the effectiveness of the proposed model, monthly runoff data from two hydrological stations in China are selected, and eight models are constructed to compare the performance of the proposed model. The results show that compared with the Informer model, the 1th step MAE of the SMGformer model decreases by 42.2% and 36.6%, respectively; RMSE decreases by 37.9% and 43.6% respectively; NSE increases from 0.936 to 0.975 and from 0.487 to 0.837, respectively. In addition, the KGE of the SMGformer model at the 3th step are 0.960 and 0.805, both of which can maintain above 0.8. Therefore, the model can accurately capture key information in the monthly runoff sequence and extend the effective forecast period of the model.

摘要

准确的径流预测对于水资源配置、防洪减灾具有重要意义。然而,由于径流序列固有的强随机性,这项任务面临重大挑战。为应对这一挑战,本研究提出了一种新的SMGformer径流预测模型。该模型集成了使用局部加权回归散点平滑法(STL)的季节性和趋势分解、Informer的编码器层、双向门控循环单元(BiGRU)和多头自注意力机制(MHSA)。首先,针对径流序列的非线性和非平稳特性,采用STL分解提取径流序列的趋势、周期和残差项,并构建基于“序列-序列”的多特征集作为模型的输入,为后续模型捕捉径流演变提供基础。然后使用Informer的编码器层捕捉输入集的关键特征。接下来,BiGRU层用于学习这些特征的时间信息。为进一步优化BiGRU层的输出,引入MHSA机制以强调重要信息的影响。最后,通过全连接层对MHSA层的输出进行变换,实现准确的径流预测。为验证所提模型的有效性,选取了中国两个水文站的月径流数据,并构建了八个模型来比较所提模型的性能。结果表明,与Informer模型相比,SMGformer模型第1步的平均绝对误差(MAE)分别降低了42.2%和36.6%;均方根误差(RMSE)分别降低了37.9%和43.6%;纳什效率系数(NSE)分别从0.936提高到0.975以及从0.487提高到0.837。此外,SMGformer模型在第3步的Kling-Gupta效率系数(KGE)分别为0.960和0.805,两者均能保持在0.8以上。因此,该模型能够准确捕捉月径流序列中的关键信息,并延长模型的有效预测期。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/b94a5311c066/41598_2024_74329_Fig16_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/3e985772783e/41598_2024_74329_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/14d2f6794419/41598_2024_74329_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/9d06fff9a3f9/41598_2024_74329_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/84ea694d4e57/41598_2024_74329_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/b98481b30f2a/41598_2024_74329_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/a778415b819c/41598_2024_74329_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/80cea7f6b16c/41598_2024_74329_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/97a93d762856/41598_2024_74329_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/a00028647fc2/41598_2024_74329_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/4bf69f7133b7/41598_2024_74329_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/6a0c0adb8703/41598_2024_74329_Fig11_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/aa39e5542d0f/41598_2024_74329_Fig12_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/6260ca995f5d/41598_2024_74329_Fig13_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/25f42e0de41f/41598_2024_74329_Fig14_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/27ffbfd6f846/41598_2024_74329_Fig15_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/b94a5311c066/41598_2024_74329_Fig16_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/3e985772783e/41598_2024_74329_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/14d2f6794419/41598_2024_74329_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/9d06fff9a3f9/41598_2024_74329_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/84ea694d4e57/41598_2024_74329_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/b98481b30f2a/41598_2024_74329_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/a778415b819c/41598_2024_74329_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/80cea7f6b16c/41598_2024_74329_Fig7_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/97a93d762856/41598_2024_74329_Fig8_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/a00028647fc2/41598_2024_74329_Fig9_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/4bf69f7133b7/41598_2024_74329_Fig10_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/6a0c0adb8703/41598_2024_74329_Fig11_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/aa39e5542d0f/41598_2024_74329_Fig12_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/6260ca995f5d/41598_2024_74329_Fig13_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/25f42e0de41f/41598_2024_74329_Fig14_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/27ffbfd6f846/41598_2024_74329_Fig15_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1259/11464814/b94a5311c066/41598_2024_74329_Fig16_HTML.jpg

相似文献

1
SMGformer: integrating STL and multi-head self-attention in deep learning model for multi-step runoff forecasting.SMGformer:在深度学习模型中集成STL和多头自注意力用于多步径流预测
Sci Rep. 2024 Oct 9;14(1):23550. doi: 10.1038/s41598-024-74329-0.
2
Stepwise decomposition-integration-prediction framework for runoff forecasting considering boundary correction.考虑边界修正的径流预测分步分解-集成-预测框架。
Sci Total Environ. 2022 Dec 10;851(Pt 2):158342. doi: 10.1016/j.scitotenv.2022.158342. Epub 2022 Aug 26.
3
Exploring a similarity search-based data-driven framework for multi-step-ahead flood forecasting.探索基于相似性搜索的数据驱动型多步洪水预报框架。
Sci Total Environ. 2023 Sep 15;891:164494. doi: 10.1016/j.scitotenv.2023.164494. Epub 2023 May 26.
4
Mid-long term forecasting of reservoir inflow using the coupling of time-varying filter-based empirical mode decomposition and gated recurrent unit.基于时变滤波器的经验模态分解与门控循环单元耦合的水库入库流量中长期预测
Environ Sci Pollut Res Int. 2022 Dec;29(58):87200-87217. doi: 10.1007/s11356-022-21634-8. Epub 2022 Jul 8.
5
A new strategy for groundwater level prediction using a hybrid deep learning model under Ecological Water Replenishment.基于生态补水的地下水水位预测的混合深度学习模型新策略
Environ Sci Pollut Res Int. 2024 Apr;31(16):23951-23967. doi: 10.1007/s11356-024-32330-0. Epub 2024 Mar 4.
6
Monthly-scale hydro-climatic forecasting and climate change impact evaluation based on a novel DCNN-Transformer network.基于新型深度卷积神经网络-Transformer网络的月尺度水文气候预测与气候变化影响评估
Environ Res. 2023 Nov 1;236(Pt 2):116821. doi: 10.1016/j.envres.2023.116821. Epub 2023 Aug 2.
7
Water quality forecasting based on data decomposition, fuzzy clustering and deep learning neural network.基于数据分解、模糊聚类和深度学习神经网络的水质预测。
Environ Pollut. 2022 Jun 15;303:119136. doi: 10.1016/j.envpol.2022.119136. Epub 2022 Mar 10.
8
Long-term trend forecast of chlorophyll-a concentration over eutrophic lakes based on time series decomposition and deep learning algorithm.基于时间序列分解和深度学习算法的富营养化湖泊叶绿素-a 浓度长期趋势预测。
Sci Total Environ. 2024 Nov 15;951:175451. doi: 10.1016/j.scitotenv.2024.175451. Epub 2024 Aug 10.
9
Decomposition-Based Multi-Step Forecasting Model for the Environmental Variables of Rabbit Houses.基于分解的兔舍环境变量多步预测模型
Animals (Basel). 2023 Feb 3;13(3):546. doi: 10.3390/ani13030546.
10
Spatiotemporal informer: A new approach based on spatiotemporal embedding and attention for air quality forecasting.时空信息器:一种基于时空嵌入和注意力机制的空气质量预测新方法。
Environ Pollut. 2023 Nov 1;336:122402. doi: 10.1016/j.envpol.2023.122402. Epub 2023 Aug 17.

引用本文的文献

1
A hybrid AI model integrating BKA-VMD and deep neural networks for industrial power load prediction.一种集成BKA-VMD和深度神经网络的混合人工智能模型用于工业电力负荷预测。
PLoS One. 2025 Aug 14;20(8):e0329630. doi: 10.1371/journal.pone.0329630. eCollection 2025.
2
A novel hybrid model by integrating TCN with TVFEMD and permutation entropy for monthly non-stationary runoff prediction.一种将时间卷积网络(TCN)与变分模态分解(TVFEMD)和排列熵相结合的新型混合模型用于月非平稳径流预测。
Sci Rep. 2024 Dec 30;14(1):31699. doi: 10.1038/s41598-024-81574-w.

本文引用的文献

1
Application of a hybrid algorithm of LSTM and Transformer based on random search optimization for improving rainfall-runoff simulation.基于随机搜索优化的长短期记忆网络(LSTM)与变换器(Transformer)混合算法在改进降雨径流模拟中的应用
Sci Rep. 2024 May 16;14(1):11184. doi: 10.1038/s41598-024-62127-7.
2
Real-time prediction of ROP based on GRU-Informer.基于门控循环单元-信息者网络的早产儿视网膜病变实时预测
Sci Rep. 2024 Jan 25;14(1):2133. doi: 10.1038/s41598-024-52261-7.
3
A runoff prediction method based on hyperparameter optimisation of a kernel extreme learning machine with multi-step decomposition.
一种基于核极限学习机超参数优化与多步分解的径流预测方法。
Sci Rep. 2023 Nov 7;13(1):19341. doi: 10.1038/s41598-023-46682-z.
4
STL-decomposition ensemble deep learning models for daily reservoir inflow forecast for hydroelectricity production.用于水电生产日水库入库流量预测的STL分解集成深度学习模型。
Heliyon. 2023 May 30;9(6):e16456. doi: 10.1016/j.heliyon.2023.e16456. eCollection 2023 Jun.
5
Electricity price forecast based on the STL-TCN-NBEATS model.基于STL-TCN-NBEATS模型的电价预测
Heliyon. 2023 Jan 14;9(1):e13029. doi: 10.1016/j.heliyon.2023.e13029. eCollection 2023 Jan.
6
Stepwise decomposition-integration-prediction framework for runoff forecasting considering boundary correction.考虑边界修正的径流预测分步分解-集成-预测框架。
Sci Total Environ. 2022 Dec 10;851(Pt 2):158342. doi: 10.1016/j.scitotenv.2022.158342. Epub 2022 Aug 26.
7
A fast learning algorithm for deep belief nets.一种用于深度信念网络的快速学习算法。
Neural Comput. 2006 Jul;18(7):1527-54. doi: 10.1162/neco.2006.18.7.1527.