Bristol University, Bristol, UK.
Soc Stud Sci. 2023 Jun;53(3):427-448. doi: 10.1177/03063127231152915. Epub 2023 Feb 6.
The Research Excellence Framework (REF) is a UK policy tool for distributing government funding and an important indicator of the academic status of a UK university. The legitimacy of the policy comes from peers' consensus on what academic quality is. We are interested in how the REF enables this funding distribution by determining the academic quality of a broad array of different forms of research through a single peer-review process. As they search for academic quality that is contingent to a specific epistemology and requires more time than the REF allows, how do academics agree to agree, and within constraints of a given timeframe? Interviews with REF panellists and their accounts of the process lead us to suggest that the consensus is enacted by setting up a situation: the mechanics of the REF with its practices of benchmarking, scoring, calibrating, and normalizing. This situation sets the boundaries of reviewing and, in doing so, propels peers to shift from assessment contingent on epistemic commitments to evaluation on a single scale. We argue that this shift renders academic quality distinct from scientific or epistemic quality.
研究卓越框架(REF)是英国政府分配资金的政策工具,也是英国大学学术地位的重要指标。该政策的合法性来自于同行对学术质量的共识。我们感兴趣的是,REF 如何通过单一的同行评审过程来确定广泛的不同形式的研究的学术质量,从而实现这种资金分配。当学者们在寻找特定认识论所需要的、比 REF 允许的时间更长的学术质量时,他们是如何达成一致的,并且在给定的时间限制内是如何达成一致的呢?对 REF 评审小组成员的采访以及他们对这一过程的描述使我们得出这样的结论:这种共识是通过设定一种情境来实现的:REF 的机制及其基准测试、评分、校准和规范化的实践。这种情境设定了评审的边界,并促使同行们从基于认识论承诺的评估转向单一尺度的评价。我们认为,这种转变使得学术质量有别于科学或认识论质量。