• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

通过样本选择偏差校正提高数据驱动损伤模型的可转移性

Improved Transferability of Data-Driven Damage Models Through Sample Selection Bias Correction.

作者信息

Wagenaar Dennis, Hermawan Tiaravanni, van den Homberg Marc J C, Aerts Jeroen C J H, Kreibich Heidi, de Moel Hans, Bouwer Laurens M

机构信息

Deltares, Delft, The Netherlands.

Institute for Environmental Studies, VU University Amsterdam, The Netherlands.

出版信息

Risk Anal. 2021 Jan;41(1):37-55. doi: 10.1111/risa.13575. Epub 2020 Aug 24.

DOI:10.1111/risa.13575
PMID:32830337
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC7891600/
Abstract

Damage models for natural hazards are used for decision making on reducing and transferring risk. The damage estimates from these models depend on many variables and their complex sometimes nonlinear relationships with the damage. In recent years, data-driven modeling techniques have been used to capture those relationships. The available data to build such models are often limited. Therefore, in practice it is usually necessary to transfer models to a different context. In this article, we show that this implies the samples used to build the model are often not fully representative for the situation where they need to be applied on, which leads to a "sample selection bias." In this article, we enhance data-driven damage models by applying methods, not previously applied to damage modeling, to correct for this bias before the machine learning (ML) models are trained. We demonstrate this with case studies on flooding in Europe, and typhoon wind damage in the Philippines. Two sample selection bias correction methods from the ML literature are applied and one of these methods is also adjusted to our problem. These three methods are combined with stochastic generation of synthetic damage data. We demonstrate that for both case studies, the sample selection bias correction techniques reduce model errors, especially for the mean bias error this reduction can be larger than 30%. The novel combination with stochastic data generation seems to enhance these techniques. This shows that sample selection bias correction methods are beneficial for damage model transfer.

摘要

自然灾害的损失模型用于降低和转移风险的决策。这些模型的损失估计取决于许多变量以及它们与损失之间复杂的有时是非线性的关系。近年来,数据驱动的建模技术已被用于捕捉这些关系。用于构建此类模型的可用数据通常有限。因此,在实践中通常有必要将模型转移到不同的背景中。在本文中,我们表明这意味着用于构建模型的样本通常不能完全代表需要应用该模型的情况,这会导致“样本选择偏差”。在本文中,我们通过应用以前未应用于损失建模的方法来增强数据驱动的损失模型,以便在训练机器学习(ML)模型之前纠正这种偏差。我们通过欧洲洪水和菲律宾台风风灾的案例研究来证明这一点。应用了机器学习文献中的两种样本选择偏差校正方法,其中一种方法也针对我们的问题进行了调整。这三种方法与合成损失数据的随机生成相结合。我们证明,对于这两个案例研究,样本选择偏差校正技术都能减少模型误差,特别是对于平均偏差误差,这种减少幅度可能超过30%。与随机数据生成的新颖结合似乎增强了这些技术。这表明样本选择偏差校正方法对损失模型转移是有益的。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f82f/7891600/e58b75ced784/RISA-41-37-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f82f/7891600/c1132374a967/RISA-41-37-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f82f/7891600/d9f40066aae0/RISA-41-37-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f82f/7891600/e58b75ced784/RISA-41-37-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f82f/7891600/c1132374a967/RISA-41-37-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f82f/7891600/d9f40066aae0/RISA-41-37-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f82f/7891600/e58b75ced784/RISA-41-37-g003.jpg

相似文献

1
Improved Transferability of Data-Driven Damage Models Through Sample Selection Bias Correction.通过样本选择偏差校正提高数据驱动损伤模型的可转移性
Risk Anal. 2021 Jan;41(1):37-55. doi: 10.1111/risa.13575. Epub 2020 Aug 24.
2
Measurement error correction in the least absolute shrinkage and selection operator model when validation data are available.在验证数据可用的情况下,最小绝对收缩和选择算子模型中的测量误差修正。
Stat Methods Med Res. 2019 Mar;28(3):670-680. doi: 10.1177/0962280217734241. Epub 2017 Nov 23.
3
Data-driven modeling and prediction of blood glucose dynamics: Machine learning applications in type 1 diabetes.基于数据驱动的血糖动力学建模与预测:机器学习在 1 型糖尿病中的应用。
Artif Intell Med. 2019 Jul;98:109-134. doi: 10.1016/j.artmed.2019.07.007. Epub 2019 Jul 26.
4
The productivity of mental health care: an instrumental variable approach.精神卫生保健的生产力:一种工具变量法。
J Ment Health Policy Econ. 1999 Jun 1;2(2):59-71. doi: 10.1002/(sici)1099-176x(199906)2:2<59::aid-mhp47>3.0.co;2-j.
5
Transferability of artificial neural networks for clinical document classification across hospitals: A case study on abnormality detection from radiology reports.医院间临床文档分类的人工神经网络可转移性:以放射学报告异常检测为例的研究。
J Biomed Inform. 2018 Sep;85:68-79. doi: 10.1016/j.jbi.2018.07.017. Epub 2018 Jul 17.
6
Comparison of Machine Learning and Land Use Regression for fine scale spatiotemporal estimation of ambient air pollution: Modeling ozone concentrations across the contiguous United States.机器学习和土地利用回归在精细时空估算环境空气污染中的比较:在美国大陆范围内模拟臭氧浓度。
Environ Int. 2020 Sep;142:105827. doi: 10.1016/j.envint.2020.105827. Epub 2020 Jun 25.
7
Next generation testing strategy for assessment of genomic damage: A conceptual framework and considerations.用于评估基因组损伤的下一代检测策略:一个概念框架及考量因素
Environ Mol Mutagen. 2017 Jun;58(5):264-283. doi: 10.1002/em.22045. Epub 2016 Sep 21.
8
Exposure and vulnerability estimation for modelling flood losses to commercial assets in Europe.欧洲商业资产洪水损失建模的暴露度与脆弱性评估
Sci Total Environ. 2020 Oct 1;737:140011. doi: 10.1016/j.scitotenv.2020.140011. Epub 2020 Jun 16.
9
Hybrid Modelling by Machine Learning Corrections of Analytical Model Predictions towards High-Fidelity Simulation Solutions.通过机器学习对分析模型预测进行校正以实现高保真模拟解决方案的混合建模
Materials (Basel). 2021 Apr 10;14(8):1883. doi: 10.3390/ma14081883.
10
Addressing small sample size bias in multiple-biomarker trials: Inclusion of biomarker-negative patients and Firth correction.解决多生物标志物试验中的小样本量偏差:纳入生物标志物阴性患者及费思校正。
Biom J. 2018 Mar;60(2):275-287. doi: 10.1002/bimj.201600226. Epub 2017 Aug 1.

本文引用的文献

1
Predictive risk mapping of an environmentally-driven infectious disease using spatial Bayesian networks: A case study of leptospirosis in Fiji.使用空间贝叶斯网络预测环境驱动的传染病风险:以斐济钩端螺旋体病为例。
PLoS Negl Trop Dis. 2018 Oct 11;12(10):e0006857. doi: 10.1371/journal.pntd.0006857. eCollection 2018 Oct.
2
Machine learning methods reveal the temporal pattern of dengue incidence using meteorological factors in metropolitan Manila, Philippines.机器学习方法揭示了菲律宾马尼拉大都市使用气象因素的登革热发病率的时间模式。
BMC Infect Dis. 2018 Apr 17;18(1):183. doi: 10.1186/s12879-018-3066-0.
3
Comparison between Random Forests, Artificial Neural Networks and Gradient Boosted Machines Methods of On-Line Vis-NIR Spectroscopy Measurements of Soil Total Nitrogen and Total Carbon.
随机森林、人工神经网络和梯度提升机方法用于土壤总氮和总碳的在线可见-近红外光谱测量的比较
Sensors (Basel). 2017 Oct 24;17(10):2428. doi: 10.3390/s17102428.
4
A Review of Flood Loss Models as Basis for Harmonization and Benchmarking.作为协调与基准制定基础的洪水损失模型综述
PLoS One. 2016 Jul 25;11(7):e0159791. doi: 10.1371/journal.pone.0159791. eCollection 2016.
5
Uncertainty and sensitivity of flood risk calculations for a dike ring in the south of the Netherlands.荷兰南部堤防圈洪水风险计算的不确定性和敏感性。
Sci Total Environ. 2014 Mar 1;473-474:224-34. doi: 10.1016/j.scitotenv.2013.12.015. Epub 2013 Dec 25.
6
Power outage estimation for tropical cyclones: improved accuracy with simpler models.热带气旋的停电估计:用更简单的模型提高准确性。
Risk Anal. 2014 Jun;34(6):1069-78. doi: 10.1111/risa.12131. Epub 2013 Oct 23.
7
High resolution population distribution maps for Southeast Asia in 2010 and 2015.2010 年和 2015 年东南亚高分辨率人口分布地图。
PLoS One. 2013;8(2):e55882. doi: 10.1371/journal.pone.0055882. Epub 2013 Feb 13.
8
Comparison and validation of statistical methods for predicting power outage durations in the event of hurricanes.比较和验证预测飓风事件中停电持续时间的统计方法。
Risk Anal. 2011 Dec;31(12):1897-906. doi: 10.1111/j.1539-6924.2011.01618.x. Epub 2011 Apr 13.
9
Future economic damage from tropical cyclones: sensitivities to societal and climate changes.热带气旋未来造成的经济损失:对社会和气候变化的敏感性
Philos Trans A Math Phys Eng Sci. 2007 Nov 15;365(1860):2717-29. doi: 10.1098/rsta.2007.2086.