Applied Artificial Intelligence Institute, Deakin University, Geelong, Australia.
Applied Artificial Intelligence Institute, Deakin University, Geelong, Australia.
Artif Intell Med. 2022 Feb;124:102158. doi: 10.1016/j.artmed.2021.102158. Epub 2021 Aug 28.
Our title alludes to the three Christmas ghosts encountered by Ebenezer Scrooge in A Christmas Carol, who guide Ebenezer through the past, present, and future of Christmas holiday events. Similarly, our article takes readers through a journey of the past, present, and future of medical AI. In doing so, we focus on the crux of modern machine learning: the reliance on powerful but intrinsically opaque models. When applied to the healthcare domain, these models fail to meet the needs for transparency that their clinician and patient end-users require. We review the implications of this failure, and argue that opaque models (1) lack quality assurance, (2) fail to elicit trust, and (3) restrict physician-patient dialogue. We then discuss how upholding transparency in all aspects of model design and model validation can help ensure the reliability and success of medical AI.
我们的标题暗指 Ebenezer Scrooge 在《圣诞颂歌》中遇到的三个圣诞鬼魂,他们引导 Ebenezer 经历了过去、现在和未来的圣诞假期活动。同样,我们的文章带读者经历了医疗 AI 的过去、现在和未来的旅程。在这样做的过程中,我们关注现代机器学习的关键:对强大但本质上不透明的模型的依赖。当将这些模型应用于医疗保健领域时,它们无法满足临床医生和患者最终用户对透明度的需求。我们回顾了这一失败的影响,并认为不透明的模型 (1) 缺乏质量保证,(2) 未能赢得信任,(3) 限制了医患对话。然后,我们讨论了如何在模型设计和模型验证的所有方面坚持透明度,可以帮助确保医疗 AI 的可靠性和成功。