Division of Humanities, Arts and Social Sciences, Colorado School of Mines, Golden, USA.
Department of Computer Science, Colorado School of Mines, Golden, USA.
Sci Eng Ethics. 2020 Oct;26(5):2511-2526. doi: 10.1007/s11948-020-00246-w.
Empirical studies have suggested that language-capable robots have the persuasive power to shape the shared moral norms based on how they respond to human norm violations. This persuasive power presents cause for concern, but also the opportunity to persuade humans to cultivate their own moral development. We argue that a truly socially integrated and morally competent robot must be willing to communicate its objection to humans' proposed violations of shared norms by using strategies such as blame-laden rebukes, even if doing so may violate other standing norms, such as politeness. By drawing on Confucian ethics, we argue that a robot's ability to employ blame-laden moral rebukes to respond to unethical human requests is crucial for cultivating a flourishing "moral ecology" of human-robot interaction. Such positive moral ecology allows human teammates to develop their own moral reflection skills and grow their own virtues. Furthermore, this ability can and should be considered as one criterion for assessing artificial moral agency. Finally, this paper discusses potential implications of the Confucian theories for designing socially integrated and morally competent robots.
实证研究表明，具备语言能力的机器人具有说服力，可以根据它们对人类违反规范行为的反应方式来塑造共同的道德规范。这种说服力令人担忧，但也为说服人类培养自己的道德发展提供了机会。我们认为，一个真正具有社会融合性和道德能力的机器人必须愿意通过使用谴责性的批评等策略来表达对人类提议的违反共同规范的反对，即使这样做可能会违反其他现行规范，如礼貌。通过借鉴儒家伦理，我们认为，机器人有能力使用谴责性的道德批评来回应不道德的人类请求，这对于培养繁荣的人机交互“道德生态”至关重要。这种积极的道德生态允许人类队友发展自己的道德反思技能并培养自己的美德。此外，这种能力可以而且应该被视为评估人工智能道德代理的一个标准。最后，本文讨论了儒家理论对设计具有社会融合性和道德能力的机器人的潜在影响。
