Department of Pediatrics, Children's Hospital of Philadelphia, Philadelphia, USA.
School of Health Professions Education (SHE), Maastricht University, Maastricht, The Netherlands.
Adv Health Sci Educ Theory Pract. 2024 Mar;29(1):199-216. doi: 10.1007/s10459-023-10260-9. Epub 2023 Jun 23.
Intrinsic inequity in assessment refers to sources of harmful discrimination inherent in the design of assessment tools and systems. This study seeks to understand intrinsic inequity in assessment systems by studying assessment policies and associated procedures in residency training, using general pediatrics as a discourse case study. Foucauldian discourse analysis (FDA) was conducted on assessment policy and procedure documents. Two authors independently prepared structured analytic notes using guiding questions. Documents and respective analytic notes were subsequently reviewed independently by all authors. Each author prepared further unstructured analytic notes on the documents' discourse. The authors then compared notes and constructed truth statements (i.e., interpretations of what the discourse establishes as true about the construct under study) and sub-strands (i.e., themes) that were repeated and legitimized across the documents via iterative discussion. Based on analysis, the authors constructed two truth statements. These truth statements, "good assessment is equitable assessment," and "everyone is responsible for inequity," conceptualized inequity in assessment as an isolated or individual-level aberration in an otherwise effective or neutral system. Closer examination of the truth statements and sub-strands in the discourse presented an alternative view, suggesting that inequity may in fact not be an aberration but rather an inherent feature of assessment systems.
内在不公平评估是指评估工具和系统设计中固有的有害歧视来源。本研究旨在通过研究居住培训中的评估政策和相关程序,以一般儿科学为话语案例研究,来了解评估系统中的内在不公平。对评估政策和程序文件进行了福柯话语分析(FDA)。两位作者使用指导问题独立编写了结构化分析笔记。随后,所有作者都独立审查了文件和相应的分析笔记。每位作者都在文件的话语上编写了进一步的非结构化分析笔记。然后,作者通过迭代讨论比较笔记并构建真实陈述(即,对研究结构下话语确立的真实内容的解释)和子线索(即,主题),这些陈述和子线索在文件中重复并合法化。基于分析,作者构建了两个真实陈述。这些真实陈述,“良好的评估是公平的评估”和“每个人都对不公平负责”,将评估中的不公平视为在原本有效或中立的系统中孤立或个体层面的偏差。对话语中的真实陈述和子线索进行更仔细的检查表明,不公平实际上可能不是偏差,而是评估系统的固有特征。