Norori Natalia, Hu Qiyang, Aellen Florence Marcelle, Faraci Francesca Dalia, Tzovara Athina
Institute of Computer Science, University of Bern, Neubrückstrasse 10 3012 Bern, Switzerland.
Population Health Sciences, Bristol Medical School, University of Bristol, Bristol BS8 1UD, UK.
Patterns (N Y). 2021 Oct 8;2(10):100347. doi: 10.1016/j.patter.2021.100347.
Artificial intelligence (AI) has an astonishing potential in assisting clinical decision making and revolutionizing the field of health care. A major open challenge that AI will need to address before its integration in the clinical routine is that of algorithmic bias. Most AI algorithms need big datasets to learn from, but several groups of the human population have a long history of being absent or misrepresented in existing biomedical datasets. If the training data is misrepresentative of the population variability, AI is prone to reinforcing bias, which can lead to fatal outcomes, misdiagnoses, and lack of generalization. Here, we describe the challenges in rendering AI algorithms fairer, and we propose concrete steps for addressing bias using tools from the field of open science.
人工智能在辅助临床决策和变革医疗保健领域方面具有惊人的潜力。在将人工智能整合到临床常规应用之前,它需要解决的一个主要开放性挑战是算法偏差问题。大多数人工智能算法需要大量数据集来进行学习,但在现有的生物医学数据集中,有几类人群长期缺失或代表性不足。如果训练数据不能代表人群的变异性,人工智能就容易强化偏差,这可能导致致命后果、误诊以及缺乏泛化能力。在此,我们描述了使人工智能算法更加公平所面临的挑战,并提出了使用开放科学领域的工具来解决偏差的具体步骤。