Faculty of Law, Bar Ilan University, Ramat Gan, Israel.
The Samueli Initiative for Responsible AI in Medicine, Tel Aviv University, Tel Aviv, Israel.
JMIR Ment Health. 2024 Sep 19;11:e58493. doi: 10.2196/58493.
This article contends that the responsible artificial intelligence (AI) approach-which is the dominant ethics approach ruling most regulatory and ethical guidance-falls short because it overlooks the impact of AI on human relationships. Focusing only on responsible AI principles reinforces a narrow concept of accountability and responsibility of companies developing AI. This article proposes that applying the ethics of care approach to AI regulation can offer a more comprehensive regulatory and ethical framework that addresses AI's impact on human relationships. This dual approach is essential for the effective regulation of AI in the domain of mental health care. The article delves into the emergence of the new "therapeutic" area facilitated by AI-based bots, which operate without a therapist. The article highlights the difficulties involved, mainly the absence of a defined duty of care toward users, and shows how implementing ethics of care can establish clear responsibilities for developers. It also sheds light on the potential for emotional manipulation and the risks involved. In conclusion, the article proposes a series of considerations grounded in the ethics of care for the developmental process of AI-powered therapeutic tools.
本文认为,负责任的人工智能(AI)方法——它是主导大多数监管和伦理指导的伦理方法——存在缺陷,因为它忽略了 AI 对人际关系的影响。仅关注负责任 AI 的原则,强化了对开发 AI 的公司的狭隘的问责和责任观念。本文提出,将关怀伦理方法应用于 AI 监管,可以提供一个更全面的监管和伦理框架,解决 AI 对人际关系的影响。这种双重方法对于有效监管心理健康护理领域的 AI 至关重要。本文深入探讨了人工智能驱动的聊天机器人在新的“治疗”领域的出现,这些机器人在没有治疗师的情况下运作。文章强调了其中涉及的困难,主要是缺乏对用户的明确关怀义务,并展示了如何通过关怀伦理来为开发者确立明确的责任。它还揭示了情感操纵的可能性和涉及的风险。最后,本文提出了一系列基于关怀伦理的考虑,用于 AI 驱动的治疗工具的开发过程。