Suppr超能文献

运用文化历史活动理论反思客观结构化临床考试执考者判断中的社会性文化复杂性。

Using cultural historical activity theory to reflect on the sociocultural complexities in OSCE examiners' judgements.

机构信息

School of Education and Faculty of Medicine, The University of Queensland, Brisbane, QLD, 4072, Australia.

School of Nursing and Midwifery, Queen's University Belfast, Belfast, BT9 7BL, UK.

出版信息

Adv Health Sci Educ Theory Pract. 2023 Mar;28(1):27-46. doi: 10.1007/s10459-022-10139-1. Epub 2022 Aug 9.

Abstract

Examiners' judgements play a critical role in competency-based assessments such as objective structured clinical examinations (OSCEs). The standardised nature of OSCEs and their alignment with regulatory accountability assure their wide use as high-stakes assessment in medical education. Research into examiner behaviours has predominantly explored the desirable psychometric characteristics of OSCEs, or investigated examiners' judgements from a cognitive rather than a sociocultural perspective. This study applies cultural historical activity theory (CHAT) to address this gap in exploring examiners' judgements in a high-stakes OSCE. Based on the idea that OSCE examiners' judgements are socially constructed and mediated by their clinical roles, the objective was to explore the sociocultural factors that influenced examiners' judgements of student competence and use the findings to inform examiner training to enhance assessment practice. Seventeen semi-structured interviews were conducted with examiners who assessed medical student competence in progressing to the next stage of training in a large-scale OSCE at one Australian university. The initial thematic analysis provided a basis for applying CHAT iteratively to explore the sociocultural factors and, specifically, the contradictions created by interactions between different elements such as examiners and rules, thus highlighting the factors influencing examiners' judgements. The findings indicated four key factors that influenced examiners' judgements: examiners' contrasting beliefs about the purpose of the OSCE; their varying perceptions of the marking criteria; divergent expectations of student competence; and idiosyncratic judgement practices. These factors were interrelated with the activity systems of the medical school's assessment practices and the examiners' clinical work contexts. Contradictions were identified through the guiding principles of multi-voicedness and historicity. The exploration of the sociocultural factors that may influence the consistency of examiners' judgements was facilitated by applying CHAT as an analytical framework. Reflecting upon these factors at organisational and system levels generated insights for creating fit-for-purpose examiner training to enhance assessment practice.

摘要

考官的判断在基于能力的评估中起着至关重要的作用,例如客观结构化临床考试(OSCE)。OSCE 的标准化性质及其与监管问责制的一致性确保了它们作为医学教育中高风险评估的广泛使用。对考官行为的研究主要探讨了 OSCE 的理想心理测量特征,或者从认知而不是社会文化的角度研究了考官的判断。本研究应用文化历史活动理论(CHAT)来解决这一差距,即在高风险 OSCE 中探索考官的判断。基于 OSCE 考官的判断是由他们的临床角色构建和调节的观点,本研究的目的是探讨影响考官对学生能力判断的社会文化因素,并利用这些发现为考官培训提供信息,以提高评估实践。在澳大利亚一所大学的大规模 OSCE 中,对评估医学生是否进入下一阶段培训的能力的考官进行了 17 次半结构化访谈。初始主题分析为应用 CHAT 提供了基础,以探讨社会文化因素,特别是不同元素(如考官和规则)之间相互作用产生的矛盾,从而突出影响考官判断的因素。研究结果表明,有四个关键因素影响了考官的判断:考官对 OSCE 目的的信念差异;他们对评分标准的不同看法;对学生能力的不同期望;以及独特的判断实践。这些因素与医学院评估实践的活动系统以及考官的临床工作环境相互关联。通过多声部和历史性的指导原则,确定了矛盾。通过应用 CHAT 作为分析框架,探讨了可能影响考官判断一致性的社会文化因素。在组织和系统层面上思考这些因素,为创造适合目的的考官培训提供了见解,以提高评估实践。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/f646/9992227/17a0fb03f149/10459_2022_10139_Fig1_HTML.jpg

相似文献

1
Using cultural historical activity theory to reflect on the sociocultural complexities in OSCE examiners' judgements.
Adv Health Sci Educ Theory Pract. 2023 Mar;28(1):27-46. doi: 10.1007/s10459-022-10139-1. Epub 2022 Aug 9.
2
Engaging clinical examiners with structured feedback to enhance assessment practices.
Med Teach. 2022 Aug;44(8):914-921. doi: 10.1080/0142159X.2022.2049734. Epub 2022 Mar 26.
3
Examiners' Perceptions in Surgical Education: The Blind Spot in the Assessment of OSCEs.
J Surg Educ. 2021 Mar-Apr;78(2):590-596. doi: 10.1016/j.jsurg.2020.07.024. Epub 2020 Aug 18.
4
Standardized examinees: development of a new tool to evaluate factors influencing OSCE scores and to train examiners.
GMS J Med Educ. 2020 Jun 15;37(4):Doc40. doi: 10.3205/zma001333. eCollection 2020.
5
Examiners' decision-making processes in observation-based clinical examinations.
Med Educ. 2021 Mar;55(3):344-353. doi: 10.1111/medu.14357. Epub 2020 Sep 9.
7
The sights and insights of examiners in objective structured clinical examinations.
J Educ Eval Health Prof. 2017 Dec 27;14:34. doi: 10.3352/jeehp.2017.14.34. eCollection 2017.
10
Examining Skills and Abilities During the Pandemic - Psychology Students' and Examiners' Perceptions of a Digital OSCE.
Psychol Learn Teach. 2022 Jul 22;21(3):278-295. doi: 10.1177/14757257221114038. eCollection 2022 Sep.

引用本文的文献

2
Towards a more nuanced conceptualisation of differential examiner stringency in OSCEs.
Adv Health Sci Educ Theory Pract. 2024 Jul;29(3):919-934. doi: 10.1007/s10459-023-10289-w. Epub 2023 Oct 16.
3
Better together: An assessor support roadmap.
Clin Teach. 2024 Feb;21(1):e13640. doi: 10.1111/tct.13640. Epub 2023 Aug 31.

本文引用的文献

1
The hunter and the lion: Amplifying health care consumers' voices in health care education.
Med Educ. 2022 Jul;56(7):693-695. doi: 10.1111/medu.14817. Epub 2022 May 12.
2
Conjunctive standards in OSCEs: The why and the how of number of stations passed criteria.
Med Teach. 2021 Apr;43(4):448-455. doi: 10.1080/0142159X.2020.1856353. Epub 2020 Dec 8.
3
Performance assessment: Consensus statement and recommendations from the 2020 Ottawa Conference.
Med Teach. 2021 Jan;43(1):58-67. doi: 10.1080/0142159X.2020.1830052. Epub 2020 Oct 14.
4
Harnessing insights from an activity system - OSCEs past and present expanding future assessments.
Med Teach. 2021 Jan;43(1):44-49. doi: 10.1080/0142159X.2020.1795100. Epub 2020 Jul 31.
5
Shining a spotlight on scoring in the OSCE: Checklists and item weighting.
Med Teach. 2020 Sep;42(9):1037-1042. doi: 10.1080/0142159X.2020.1781072. Epub 2020 Jul 1.
6
Scenes, symbols and social roles: raising the curtain on OSCE performances.
Perspect Med Educ. 2021 Jan;10(1):14-22. doi: 10.1007/s40037-020-00593-1.
8
Developing a video-based method to compare and adjust examiner effects in fully nested OSCEs.
Med Educ. 2019 Mar;53(3):250-263. doi: 10.1111/medu.13783. Epub 2018 Dec 21.
9
The Power of Subjectivity in the Assessment of Medical Trainees.
Acad Med. 2019 Mar;94(3):333-337. doi: 10.1097/ACM.0000000000002495.
10
Tying knots: an activity theory analysis of student learning goals in clinical education.
Med Educ. 2017 Jul;51(7):687-698. doi: 10.1111/medu.13295. Epub 2017 Apr 12.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验