Küster Dennis, Schultz Tanja
Cognitive Systems Lab, Universität Bremen, Enrique-Schmidt-Str. 5, 28359, Bremen, Deutschland.
Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2023 Feb;66(2):176-183. doi: 10.1007/s00103-022-03653-5. Epub 2023 Jan 17.
Artificial intelligence (AI) is becoming increasingly important in healthcare. This development triggers serious concerns that can be summarized by six major "worst-case scenarios". From AI spreading disinformation and propaganda, to a potential new arms race between major powers, to a possible rule of algorithms ("algocracy") based on biased gatekeeper intelligence, the real dangers of an uncontrolled development of AI are by no means to be underestimated, especially in the health sector. However, fear of AI could cause humanity to miss the opportunity to positively shape the development of our society together with an AI that is friendly to us.Use cases in healthcare play a primary role in this discussion, as both the risks and the opportunities of new AI-based systems become particularly clear here. For example, would older people with dementia (PWD) be allowed to entrust aspects of their autonomy to AI-based assistance systems so that they may continue to independently manage other aspects of their daily lives? In this paper, we argue that the classic balancing act between the dangers and opportunities of AI in healthcare can be at least partially overcome by taking a long-term ethical approach toward a symbiotic relationship between humans and AI. We exemplify this approach by showcasing our I‑CARE system, an AI-based recommendation system for tertiary prevention of dementia. This system has been in development since 2015 as the I‑CARE Project at the University of Bremen, where it is still being researched today.
人工智能(AI)在医疗保健领域正变得越来越重要。这一发展引发了严重关切,可概括为六大“最坏情况”。从人工智能传播虚假信息和宣传,到大国之间可能出现的新的军备竞赛,再到基于有偏见的把关智能的算法统治(“算法ocracy”),人工智能不受控制地发展所带来的真正危险绝不可低估,尤其是在卫生领域。然而,对人工智能的恐惧可能会导致人类错过与对我们友好的人工智能一起积极塑造我们社会发展的机会。医疗保健领域的用例在这场讨论中起着主要作用,因为基于人工智能的新系统的风险和机遇在这里变得尤为明显。例如,患有痴呆症的老年人(PWD)是否可以将其自主权的某些方面委托给基于人工智能的辅助系统,以便他们能够继续独立管理日常生活的其他方面?在本文中,我们认为,通过对人类与人工智能之间的共生关系采取长期的伦理方法,至少可以部分克服医疗保健中人工智能的危险与机遇之间的经典平衡行为。我们通过展示我们的I-CARE系统来举例说明这种方法,这是一个用于痴呆症三级预防的基于人工智能的推荐系统。该系统自2015年起作为不来梅大学的I-CARE项目进行开发,至今仍在该校进行研究。