Suppr超能文献

人工智能/机器学习中的伦理与偏见考量

Ethical and Bias Considerations in Artificial Intelligence/Machine Learning.

作者信息

Hanna Matthew G, Pantanowitz Liron, Jackson Brian, Palmer Octavia, Visweswaran Shyam, Pantanowitz Joshua, Deebajah Mustafa, Rashidi Hooman H

机构信息

Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh, Pittsburgh, Pennsylvania.

Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania; Computational Pathology and AI Center of Excellence (CPACE), University of Pittsburgh, Pittsburgh, Pennsylvania.

出版信息

Mod Pathol. 2025 Mar;38(3):100686. doi: 10.1016/j.modpat.2024.100686. Epub 2024 Dec 16.

Abstract

As artificial intelligence (AI) gains prominence in pathology and medicine, the ethical implications and potential biases within such integrated AI models will require careful scrutiny. Ethics and bias are important considerations in our practice settings, especially as an increased number of machine learning (ML) systems are being integrated within our various medical domains. Such ML-based systems have demonstrated remarkable capabilities in specified tasks such as, but not limited to, image recognition, natural language processing, and predictive analytics. However, the potential bias that may exist within such AI-ML models can also inadvertently lead to unfair and potentially detrimental outcomes. The source of bias within such ML models can be due to numerous factors but is typically categorized into 3 main buckets (data bias, development bias, and interaction bias). These could be due to the training data, algorithmic bias, feature engineering and selection issues, clinic and institutional bias (ie, practice variability), reporting bias, and temporal bias (ie, changes in technology, clinical practice, or disease patterns). Therefore, despite the potential of these AI-ML applications, their deployment in our day-to-day practice also raises noteworthy ethical concerns. To address ethics and bias in medicine, a comprehensive evaluation process is required, which will encompass all aspects of such systems, from model development through clinical deployment. Addressing these biases is crucial to ensure that AI-ML systems remain fair, transparent, and beneficial to all. This review will discuss the relevant ethical and bias considerations in AI-ML specifically within the pathology and medical domain.

摘要

随着人工智能(AI)在病理学和医学领域日益突出,此类集成AI模型中的伦理影响和潜在偏差需要仔细审查。伦理和偏差是我们实践环境中的重要考量因素,尤其是随着越来越多的机器学习(ML)系统被集成到我们的各个医学领域。此类基于ML的系统在特定任务中展现出了卓越能力,如但不限于图像识别、自然语言处理和预测分析。然而,此类AI-ML模型中可能存在的潜在偏差也可能无意中导致不公平且可能有害的结果。此类ML模型中的偏差来源可能有众多因素,但通常可分为3个主要类别(数据偏差、开发偏差和交互偏差)。这些偏差可能源于训练数据、算法偏差、特征工程和选择问题、临床和机构偏差(即实践差异)、报告偏差以及时间偏差(即技术、临床实践或疾病模式的变化)。因此,尽管这些AI-ML应用具有潜力,但它们在我们日常实践中的部署也引发了值得关注的伦理问题。为了解决医学中的伦理和偏差问题,需要一个全面的评估过程,该过程将涵盖此类系统从模型开发到临床部署的所有方面。解决这些偏差对于确保AI-ML系统保持公平、透明并对所有人有益至关重要。本综述将讨论AI-ML中特别是病理学和医学领域内的相关伦理和偏差考量。

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验