Centre for Global eHealth Innovation, Techna Institute, University Health Network, Toronto, ON, Canada.
Institute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada.
J Med Internet Res. 2021 Feb 10;23(2):e22320. doi: 10.2196/22320.
There is clear evidence to suggest that diabetes does not affect all populations equally. Among adults living with diabetes, those from ethnoracial minority communities-foreign-born, immigrant, refugee, and culturally marginalized-are at increased risk of poor health outcomes. Artificial intelligence (AI) is actively being researched as a means of improving diabetes management and care; however, several factors may predispose AI to ethnoracial bias. To better understand whether diabetes AI interventions are being designed in an ethnoracially equitable manner, we conducted a secondary analysis of 141 articles included in a 2018 review by Contreras and Vehi entitled "Artificial Intelligence for Diabetes Management and Decision Support: Literature Review." Two members of our research team independently reviewed each article and selected those reporting ethnoracial data for further analysis. Only 10 articles (7.1%) were ultimately selected for secondary analysis in our case study. Of the 131 excluded articles, 118 (90.1%) failed to mention participants' ethnic or racial backgrounds. The included articles reported ethnoracial data under various categories, including race (n=6), ethnicity (n=2), race/ethnicity (n=3), and percentage of Caucasian participants (n=1). Among articles specifically reporting race, the average distribution was 69.5% White, 17.1% Black, and 3.7% Asian. Only 2 articles reported inclusion of Native American participants. Given the clear ethnic and racial differences in diabetes biomarkers, prevalence, and outcomes, the inclusion of ethnoracial training data is likely to improve the accuracy of predictive models. Such considerations are imperative in AI-based tools, which are predisposed to negative biases due to their black-box nature and proneness to distributional shift. Based on our findings, we propose a short questionnaire to assess ethnoracial equity in research describing AI-based diabetes interventions. At this unprecedented time in history, AI can either mitigate or exacerbate disparities in health care. Future accounts of the infancy of diabetes AI must reflect our early and decisive action to confront ethnoracial inequities before they are coded into our systems and perpetuate the very biases we aim to eliminate. If we take deliberate and meaningful steps now toward training our algorithms to be ethnoracially inclusive, we can architect innovations in diabetes care that are bound by the diverse fabric of our society.
有明确的证据表明,糖尿病并非对所有人群的影响都是均等的。在患有糖尿病的成年人中,来自族裔少数群体——移民、难民和文化边缘群体——的人更有可能出现不良健康结果。人工智能(AI)正在被积极研究,以作为改善糖尿病管理和护理的一种手段;然而,有几个因素可能使 AI 容易产生族裔偏见。为了更好地了解糖尿病 AI 干预措施是否以族裔公平的方式进行设计,我们对 Contreras 和 Vehi 于 2018 年发表的题为“用于糖尿病管理和决策支持的人工智能:文献综述”的综述中包含的 141 篇文章进行了二次分析。我们研究团队的两名成员独立审查了每篇文章,并选择了报告族裔数据的文章进行进一步分析。在我们的案例研究中,最终只有 10 篇文章(7.1%)被选入二次分析。在被排除的 131 篇文章中,有 118 篇(90.1%)没有提到参与者的族裔或种族背景。包含的文章在各种类别下报告了族裔数据,包括种族(n=6)、族裔(n=2)、种族/族裔(n=3)和白种人参与者的百分比(n=1)。在专门报告种族的文章中,平均分布为 69.5%的白种人、17.1%的黑种人、3.7%的亚洲人。只有 2 篇文章报告了包括美洲原住民参与者。鉴于糖尿病生物标志物、患病率和结果存在明显的族裔和种族差异,纳入族裔培训数据可能会提高预测模型的准确性。在基于 AI 的工具中,由于其黑盒性质和容易发生分布转移,因此必须考虑这些因素,因为这些工具容易产生负面偏见。根据我们的发现,我们提出了一个简短的问卷,以评估描述基于 AI 的糖尿病干预措施的研究中的族裔公平性。在历史上前所未有的这个时刻,人工智能既可以减轻也可以加剧医疗保健方面的差距。未来对糖尿病人工智能的早期描述必须反映出我们在将族裔不平等编入我们的系统之前,及早果断地采取行动来应对这些不平等,以免这些不平等被我们的系统所延续,从而消除我们试图消除的偏见。如果我们现在就采取深思熟虑和有意义的步骤来训练我们的算法,使其具有族裔包容性,我们就可以在糖尿病护理方面进行创新,这些创新受到我们社会多元化的限制。