Birhane Abeba
School of Computer Science, University College Dublin, Ireland & Lero-The Irish Software Research Centre, Dublin, Ireland.
Patterns (N Y). 2021 Feb 12;2(2):100205. doi: 10.1016/j.patter.2021.100205.
It has become trivial to point out that algorithmic systems increasingly pervade the social sphere. Improved efficiency-the hallmark of these systems-drives their mass integration into day-to-day life. However, as a robust body of research in the area of algorithmic injustice shows, algorithmic systems, especially when used to sort and predict social outcomes, are not only inadequate but also perpetuate harm. In particular, a persistent and recurrent trend within the literature indicates that society's most vulnerable are disproportionally impacted. When algorithmic injustice and harm are brought to the fore, most of the solutions on offer (1) revolve around technical solutions and (2) do not center disproportionally impacted communities. This paper proposes a fundamental shift-from rational to relational-in thinking about personhood, data, justice, and everything in between, and places ethics as something that goes above and beyond technical solutions. Outlining the idea of ethics built on the foundations of relationality, this paper calls for a rethinking of justice and ethics as a set of broad, contingent, and fluid concepts and down-to-earth practices that are best viewed as a habit and not a mere methodology for data science. As such, this paper mainly offers critical examinations and reflection and not "solutions."
指出算法系统日益渗透到社会领域已变得轻而易举。这些系统的标志性特征——提高效率,推动了它们大规模融入日常生活。然而,正如算法不公正领域大量有力的研究所表明的那样,算法系统,尤其是在用于对社会结果进行分类和预测时,不仅不够完善,而且还会使伤害持续存在。特别是,文献中一个持续且反复出现的趋势表明,社会中最弱势群体受到的影响尤为严重。当算法不公正和伤害被凸显出来时,现有的大多数解决方案(1)围绕技术解决方案展开,(2)没有以受影响尤为严重的社区为核心。本文提出了一种根本性的转变——从理性思维转向关系思维——来思考人格、数据、正义以及其间的一切,并将伦理置于超越技术解决方案的位置。本文概述了基于关系性基础构建的伦理观念,呼吁将正义和伦理重新思考为一组宽泛、偶然且灵活的概念以及切实可行的实践,这些最好被视为一种习惯,而不仅仅是数据科学的一种方法。因此,本文主要提供批判性审视和反思,而非“解决方案”。