• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

建立和评估可信人工智能:概述与研究挑战

Establishing and evaluating trustworthy AI: overview and research challenges.

作者信息

Kowald Dominik, Scher Sebastian, Pammer-Schindler Viktoria, Müllner Peter, Waxnegger Kerstin, Demelius Lea, Fessl Angela, Toller Maximilian, Mendoza Estrada Inti Gabriel, Šimić Ilija, Sabol Vedran, Trügler Andreas, Veas Eduardo, Kern Roman, Nad Tomislav, Kopeinik Simone

机构信息

Know Center Research GmbH, Graz, Austria.

Institute of Interactive Systems and Data Science, Graz University of Technology, Graz, Austria.

出版信息

Front Big Data. 2024 Nov 29;7:1467222. doi: 10.3389/fdata.2024.1467222. eCollection 2024.

DOI:10.3389/fdata.2024.1467222
PMID:39677583
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11638207/
Abstract

Artificial intelligence (AI) technologies (re-)shape modern life, driving innovation in a wide range of sectors. However, some AI systems have yielded unexpected or undesirable outcomes or have been used in questionable manners. As a result, there has been a surge in public and academic discussions about aspects that AI systems must fulfill to be considered trustworthy. In this paper, we synthesize existing conceptualizations of trustworthy AI along six requirements: (1) human agency and oversight, (2) fairness and non-discrimination, (3) transparency and explainability, (4) robustness and accuracy, (5) privacy and security, and (6) accountability. For each one, we provide a definition, describe how it can be established and evaluated, and discuss requirement-specific research challenges. Finally, we conclude this analysis by identifying overarching research challenges across the requirements with respect to (1) interdisciplinary research, (2) conceptual clarity, (3) context-dependency, (4) dynamics in evolving systems, and (5) investigations in real-world contexts. Thus, this paper synthesizes and consolidates a wide-ranging and active discussion currently taking place in various academic sub-communities and public forums. It aims to serve as a reference for a broad audience and as a basis for future research directions.

摘要

人工智能(AI)技术正在(重新)塑造现代生活,推动着众多领域的创新。然而,一些人工智能系统产生了意想不到的或不良的结果,或者被以可疑的方式使用。因此,关于人工智能系统要被视为可信必须满足的各个方面,公众和学术讨论激增。在本文中,我们沿着六个要求综合了可信人工智能的现有概念:(1)人类能动性与监督,(2)公平与非歧视,(3)透明度与可解释性,(4)稳健性与准确性,(5)隐私与安全,以及(6)问责制。对于每一项要求,我们给出定义,描述如何建立和评估它,并讨论特定要求的研究挑战。最后,我们通过确定跨这些要求在以下方面的总体研究挑战来结束此分析:(1)跨学科研究,(2)概念清晰度,(3)上下文依赖性,(4)不断演进的系统中的动态变化,以及(5)在现实世界背景下的调查。因此,本文综合并巩固了目前在各个学术子领域和公共论坛中广泛且活跃的讨论。它旨在为广大读者提供参考,并作为未来研究方向的基础。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b90c/11638207/354047b9bea3/fdata-07-1467222-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b90c/11638207/8e7cfc197b33/fdata-07-1467222-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b90c/11638207/5cd4a35ad4c6/fdata-07-1467222-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b90c/11638207/672c06dcd1ae/fdata-07-1467222-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b90c/11638207/354047b9bea3/fdata-07-1467222-g0004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b90c/11638207/8e7cfc197b33/fdata-07-1467222-g0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b90c/11638207/5cd4a35ad4c6/fdata-07-1467222-g0002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b90c/11638207/672c06dcd1ae/fdata-07-1467222-g0003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/b90c/11638207/354047b9bea3/fdata-07-1467222-g0004.jpg

相似文献

1
Establishing and evaluating trustworthy AI: overview and research challenges.建立和评估可信人工智能:概述与研究挑战
Front Big Data. 2024 Nov 29;7:1467222. doi: 10.3389/fdata.2024.1467222. eCollection 2024.
2
Data stewardship and curation practices in AI-based genomics and automated microscopy image analysis for high-throughput screening studies: promoting robust and ethical AI applications.基于人工智能的基因组学和用于高通量筛选研究的自动显微镜图像分析中的数据管理与整理实践:推动可靠且符合伦理的人工智能应用。
Hum Genomics. 2025 Feb 23;19(1):16. doi: 10.1186/s40246-025-00716-x.
3
Requirements for Trustworthy Artificial Intelligence and its Application in Healthcare.可信人工智能的要求及其在医疗保健中的应用。
Healthc Inform Res. 2023 Oct;29(4):315-322. doi: 10.4258/hir.2023.29.4.315. Epub 2023 Oct 31.
4
Shaping the Future of Healthcare: Ethical Clinical Challenges and Pathways to Trustworthy AI.塑造医疗保健的未来:伦理临床挑战与可信人工智能之路。
J Clin Med. 2025 Feb 27;14(5):1605. doi: 10.3390/jcm14051605.
5
Principles for enhancing trust in artificial intelligence systems among medical imaging professionals in Ghana: A nationwide cross-sectional study.加纳医学影像专业人员增强对人工智能系统信任的原则:一项全国性横断面研究。
Radiography (Lond). 2025 May;31(3):102953. doi: 10.1016/j.radi.2025.102953. Epub 2025 Apr 13.
6
Enhancing education for children with ASD: a review of evaluation and measurement in AI tool implementation.加强自闭症谱系障碍儿童的教育:人工智能工具实施中的评估与测量综述
Disabil Rehabil Assist Technol. 2025 Mar 13:1-18. doi: 10.1080/17483107.2025.2477678.
7
Toward a responsible future: recommendations for AI-enabled clinical decision support.迈向负责任的未来:人工智能支持的临床决策支持的建议。
J Am Med Inform Assoc. 2024 Nov 1;31(11):2730-2739. doi: 10.1093/jamia/ocae209.
8
Fairness of artificial intelligence in healthcare: review and recommendations.人工智能在医疗保健中的公平性:综述与建议。
Jpn J Radiol. 2024 Jan;42(1):3-15. doi: 10.1007/s11604-023-01474-3. Epub 2023 Aug 4.
9
Large language models and generative AI in telehealth: a responsible use lens.大语言模型和生成式人工智能在远程医疗中的应用:负责任使用的视角。
J Am Med Inform Assoc. 2024 Sep 1;31(9):2125-2136. doi: 10.1093/jamia/ocae035.
10
Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care.值得信赖的人工智能和道德设计:公众对基于人工智能的决策支持工具在产时护理背景下的可信度的看法。
BMC Med Ethics. 2023 Jun 20;24(1):42. doi: 10.1186/s12910-023-00917-w.

本文引用的文献

1
Towards algorithm auditing: managing legal, ethical and technological risks of AI, ML and associated algorithms.迈向算法审计:管理人工智能、机器学习及相关算法的法律、伦理和技术风险。
R Soc Open Sci. 2024 May 15;11(5):230859. doi: 10.1098/rsos.230859. eCollection 2024 May.
2
Differential privacy in collaborative filtering recommender systems: a review.协同过滤推荐系统中的差分隐私:综述
Front Big Data. 2023 Oct 12;6:1249997. doi: 10.3389/fdata.2023.1249997. eCollection 2023.
3
The assessment list for trustworthy artificial intelligence: A review and recommendations.
可信人工智能评估清单:综述与建议
Front Artif Intell. 2023 Mar 9;6:1020592. doi: 10.3389/frai.2023.1020592. eCollection 2023.
4
AI Technologies, Privacy, and Security.人工智能技术、隐私与安全。
Front Artif Intell. 2022 Apr 13;5:826737. doi: 10.3389/frai.2022.826737. eCollection 2022.
5
AI in health and medicine.人工智能在医疗中的应用。
Nat Med. 2022 Jan;28(1):31-38. doi: 10.1038/s41591-021-01614-0. Epub 2022 Jan 20.
6
Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations.人工智能算法应用于服务不足患者人群的胸部 X 光片时的漏诊偏倚。
Nat Med. 2021 Dec;27(12):2176-2182. doi: 10.1038/s41591-021-01595-0. Epub 2021 Dec 10.
7
Accountable Artificial Intelligence: Holding Algorithms to Account.可问责的人工智能:追究算法的责任。
Public Adm Rev. 2021 Sep-Oct;81(5):825-836. doi: 10.1111/puar.13293. Epub 2020 Nov 11.
8
Artificial intelligence explainability: the technical and ethical dimensions.人工智能可解释性:技术和伦理维度。
Philos Trans A Math Phys Eng Sci. 2021 Oct 4;379(2207):20200363. doi: 10.1098/rsta.2020.0363. Epub 2021 Aug 16.
9
Actionable Principles for Artificial Intelligence Policy: Three Pathways.人工智能政策的可行原则:三条路径。
Sci Eng Ethics. 2021 Feb 19;27(1):15. doi: 10.1007/s11948-020-00277-3.
10
Implicit Bias Is Behavior: A Functional-Cognitive Perspective on Implicit Bias.内隐偏见即行为:内隐偏见的功能认知透视。
Perspect Psychol Sci. 2019 Sep;14(5):835-840. doi: 10.1177/1745691619855638. Epub 2019 Aug 2.