• Suppr超能文献
  • 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
定价套餐&价格
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Win 客户端微信小程序
定价
会员套餐积分包API 积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

正在获取文献详情

最多等待 10 秒,若超时请稍后重试。

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

正在获取文献详情

最多等待 10 秒,若超时请稍后重试。

停止为高风险决策解释黑箱机器学习模型,转而使用可解释模型。

Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead.

机构信息

Duke University.

出版信息

Nat Mach Intell. 2019 May;1(5):206-215. doi: 10.1038/s42256-019-0048-x. Epub 2019 May 13.

DOI:10.1038/s42256-019-0048-x
PMID:35603010
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9122117/
Abstract

Black box machine learning models are currently being used for high stakes decision-making throughout society, causing problems throughout healthcare, criminal justice, and in other domains. People have hoped that creating methods for explaining these black box models will alleviate some of these problems, but trying to black box models, rather than creating models that are in the first place, is likely to perpetuate bad practices and can potentially cause catastrophic harm to society. There is a way forward - it is to design models that are inherently interpretable. This manuscript clarifies the chasm between explaining black boxes and using inherently interpretable models, outlines several key reasons why explainable black boxes should be avoided in high-stakes decisions, identifies challenges to interpretable machine learning, and provides several example applications where interpretable models could potentially replace black box models in criminal justice, healthcare, and computer vision.

摘要

黑箱机器学习模型目前正被用于全社会的高风险决策,在整个医疗保健、刑事司法和其他领域引发了问题。人们曾希望创建解释这些黑箱模型的方法能缓解其中一些问题,但试图解释黑箱模型,而不是一开始就创建可解释的模型,可能会使不良做法长期存在,并可能对社会造成灾难性危害。有一条前进的道路——那就是设计本质上可解释的模型。本文阐述了解释黑箱模型和使用本质上可解释的模型之间的差距,概述了在高风险决策中应避免使用可解释黑箱模型的几个关键原因,确定了可解释机器学习面临的挑战,并提供了几个示例应用,说明在刑事司法、医疗保健和计算机视觉领域,可解释模型有可能取代黑箱模型。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/755d1968e143/nihms-1058031-f0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/6234e775c4eb/nihms-1058031-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/b30905ce8ad4/nihms-1058031-f0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/9c953218f868/nihms-1058031-f0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/082c6bf2e01a/nihms-1058031-f0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/755d1968e143/nihms-1058031-f0005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/6234e775c4eb/nihms-1058031-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/b30905ce8ad4/nihms-1058031-f0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/9c953218f868/nihms-1058031-f0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/082c6bf2e01a/nihms-1058031-f0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/edb8/9122117/755d1968e143/nihms-1058031-f0005.jpg

相关文献

1Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead.PubMed译停止为高风险决策解释黑箱机器学习模型,转而使用可解释模型。

Nat Mach Intell. 2019 May;1(5):206-215. doi: 10.1038/s42256-019-0048-x. Epub 2019 May 13.

2Opening the Black Box: The Promise and Limitations of Explainable Machine Learning in Cardiology.PubMed译揭开黑箱:可解释机器学习在心脏病学中的前景与局限。

Jeremy Petch, Shuang Di, Walter Nelson
Can J Cardiol. 2022 Feb;38(2):204-213. doi: 10.1016/j.cjca.2021.09.004. Epub 2021 Sep 14.

3Explainable, trustworthy, and ethical machine learning for healthcare: A survey.PubMed译面向医疗保健的可解释、可信赖和合乎道德的机器学习:调查。

Khansa Rasheed, Adnan Qayyum, Mohammed Ghaly, et al.
Comput Biol Med. 2022 Oct;149:106043. doi: 10.1016/j.compbiomed.2022.106043. Epub 2022 Sep 7.

4Interpretable machine learning models for hospital readmission prediction: a two-step extracted regression tree approach.PubMed译可解释的机器学习模型在医院再入院预测中的应用:一种两步提取回归树方法。

Xiaoquan Gao, Sabriya Alam, Pengyi Shi, et al.
BMC Med Inform Decis Mak. 2023 Jun 5;23(1):104. doi: 10.1186/s12911-023-02193-5.

5Explainable Machine Learning Framework for Image Classification Problems: Case Study on Glioma Cancer Prediction.PubMed译用于图像分类问题的可解释机器学习框架:脑胶质瘤癌症预测案例研究

et al.
J Imaging. 2020 May 28;6(6):37. doi: 10.3390/jimaging6060037.

6Open your black box classifier.PubMed译打开你的黑箱分类器。

Healthc Technol Lett. 2023 Aug 29;11(4):210-212. doi: 10.1049/htl2.12050. eCollection 2024 Aug.

7The Virtues of Interpretable Medical AI.PubMed译可解释医学人工智能的优点

Camb Q Healthc Ethics. 2024 Jul;33(3):323-332. doi: 10.1017/S0963180122000664. Epub 2023 Jan 10.

8The Virtues of Interpretable Medical Artificial Intelligence.PubMed译可解释医学人工智能的优点

Camb Q Healthc Ethics. 2022 Dec 16:1-10. doi: 10.1017/S0963180122000305.

9Inherently interpretable position-aware convolutional motif kernel networks for biological sequencing data.PubMed译用于生物测序数据的固有可解释位置感知卷积基元核网络。

Jonas C Ditz, Bernhard Reuter, Nico Pfeifer
Sci Rep. 2023 Oct 11;13(1):17216. doi: 10.1038/s41598-023-44175-7.

10Why did AI get this one wrong? - Tree-based explanations of machine learning model predictions.PubMed译为什么 AI 会犯这个错误?——机器学习模型预测的基于树的解释。

Enea Parimbelli, Tommaso Mario Buonocore, Giovanna Nicora, et al.
Artif Intell Med. 2023 Jan;135:102471. doi: 10.1016/j.artmed.2022.102471. Epub 2022 Dec 1.

相关文献

1A review of image processing and analysis of computed tomography images using deep learning methods.PubMed译使用深度学习方法对计算机断层扫描图像进行图像处理与分析的综述。

et al.
Phys Eng Sci Med. 2025 Sep 3. doi: 10.1007/s13246-025-01635-w.

相关文献

1Definitions, methods, and applications in interpretable machine learning.PubMed译可解释机器学习中的定义、方法和应用。

W James Murdoch, Chandan Singh, Karl Kumbier, et al.
Proc Natl Acad Sci U S A. 2019 Oct 29;116(44):22071-22080. doi: 10.1073/pnas.1900654116. Epub 2019 Oct 16.

2Radiomics Quality Score 2.0: towards radiomics readiness levels and clinical translation for personalized medicine.PubMed译放射组学质量评分2.0:迈向个性化医疗的放射组学准备水平及临床转化

et al.
Nat Rev Clin Oncol. 2025 Sep 3. doi: 10.1038/s41571-025-01067-1.

3Towards the genome-scale discovery of bivariate monotonic classifiers.PubMed译迈向双变量单调分类器的全基因组规模发现。

et al.
BMC Bioinformatics. 2025 Sep 2;26(1):228. doi: 10.1186/s12859-025-06253-7.

4Explainable AI in medicine: challenges of integrating XAI into the future clinical routine.PubMed译医学中的可解释人工智能:将可解释人工智能集成到未来临床常规中的挑战。

Front Radiol. 2025 Aug 5;5:1627169. doi: 10.3389/fradi.2025.1627169. eCollection 2025.

5Feasibility of fully automatic assessment of cervical canal stenosis using MRI via deep learning.PubMed译通过深度学习利用磁共振成像(MRI)对颈椎管狭窄进行全自动评估的可行性。

et al.
Quant Imaging Med Surg. 2025 Sep 1;15(9):8457-8470. doi: 10.21037/qims-2025-67. Epub 2025 Aug 19.

6Transforming Population Health Screening for Atherosclerotic Cardiovascular Disease with AI-Enhanced ECG Analytics: Opportunities and Challenges.PubMed译利用人工智能增强的心电图分析改变动脉粥样硬化性心血管疾病的人群健康筛查:机遇与挑战。

et al.
Curr Atheroscler Rep. 2025 Sep 1;27(1):86. doi: 10.1007/s11883-025-01337-4.

7The efficacy of machine learning algorithms in evaluating factors associated with shunt-dependent hydrocephalus after subarachnoid hemorrhage: a systematic review and meta-analysis.PubMed译机器学习算法在评估蛛网膜下腔出血后与分流依赖型脑积水相关因素中的疗效:一项系统评价和荟萃分析

et al.
Neurosurg Rev. 2025 Sep 1;48(1):629. doi: 10.1007/s10143-025-03773-x.

8Improving deceased donor kidney utilization: predicting risk of nonuse with interpretable models.PubMed译提高 deceased 捐赠者肾脏利用率:使用可解释模型预测未使用风险。 (注:“deceased”直译为“已故的”,这里结合语境意译为“ deceased 捐赠者”即“死亡后器官捐赠者” )

et al.
Front Artif Intell. 2025 Aug 13;8:1638574. doi: 10.3389/frai.2025.1638574. eCollection 2025.

9AdapTor: Adaptive Topological Regression for quantitative structure-activity relationship modeling.PubMed译AdapTor:用于定量构效关系建模的自适应拓扑回归

J Cheminform. 2025 Aug 28;17(1):128. doi: 10.1186/s13321-025-01071-8.

10Beyond Post hoc Explanations: A Comprehensive Framework for Accountable AI in Medical Imaging Through Transparency, Interpretability, and Explainability.PubMed译超越事后解释:通过透明度、可解释性和可说明性实现医学成像中可问责人工智能的综合框架。

et al.
Bioengineering (Basel). 2025 Aug 15;12(8):879. doi: 10.3390/bioengineering12080879.

2Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: A cross-sectional study.PubMed译深度学习模型检测胸片肺炎的可变泛化性能:一项横断面研究。

John R Zech, Marcus A Badgeley, Manway Liu, et al.
PLoS Med. 2018 Nov 6;15(11):e1002683. doi: 10.1371/journal.pmed.1002683. eCollection 2018 Nov.

3Modeling recovery curves with application to prostatectomy.PubMed译用模型拟合恢复曲线,并将其应用于前列腺切除术。

Fulton Wang, Cynthia Rudin, Tyler H Mccormick, et al.
Biostatistics. 2019 Oct 1;20(4):549-564. doi: 10.1093/biostatistics/kxy002.

4On the Safety of Machine Learning: Cyber-Physical Systems, Decision Sciences, and Data Products.PubMed译机器学习的安全性:网络物理系统、决策科学和数据产品。

Kush R Varshney, Homa Alemzadeh
Big Data. 2017 Sep;5(3):246-255.

5The World Health Organization Adult Attention-Deficit/Hyperactivity Disorder Self-Report Screening Scale for DSM-5.PubMed译世界卫生组织成人注意缺陷多动障碍自我报告筛查量表(适用于《精神疾病诊断与统计手册》第5版)

et al.
JAMA Psychiatry. 2017 May 1;74(5):520-527. doi: 10.1001/jamapsychiatry.2017.0298.

6Population-Level Prediction of Type 2 Diabetes From Claims Data and Analysis of Risk Factors.PubMed译从索赔数据预测 2 型糖尿病的人群水平及危险因素分析。

Narges Razavian, Saul Blecker, Ann Marie Schmidt, et al.
Big Data. 2015 Dec;3(4):277-87. doi: 10.1089/big.2015.0020.

7The Magical Mystery Four: How is Working Memory Capacity Limited, and Why?PubMed译神奇的谜团之四:工作记忆容量是如何受限的,以及为何受限?

Curr Dir Psychol Sci. 2010 Feb 1;19(1):51-57. doi: 10.1177/0963721409359277.

8The magical number seven plus or minus two: some limits on our capacity for processing information.PubMed译神奇的数字七,加二或减二:我们信息处理能力的某些局限。

Psychol Rev. 1956 Mar;63(2):81-97.