Suppr超能文献

绩效评估专业知识:评估者的视角。

Expertise in performance assessment: assessors' perspectives.

机构信息

Institute of Medical Education, Faculty of Medicine, University of Berne, Konsumstrasse 13, 3010, Berne, Switzerland,

出版信息

Adv Health Sci Educ Theory Pract. 2013 Oct;18(4):559-71. doi: 10.1007/s10459-012-9392-x. Epub 2012 Jul 31.

Abstract

The recent rise of interest among the medical education community in individual faculty making subjective judgments about medical trainee performance appears to be directly related to the introduction of notions of integrated competency-based education and assessment for learning. Although it is known that assessor expertise plays an important role in performance assessment, the roles played by different factors remain to be unraveled. We therefore conducted an exploratory study with the aim of building a preliminary model to gain a better understanding of assessor expertise. Using a grounded theory approach, we conducted seventeen semi-structured interviews with individual faculty members who differed in professional background and assessment experience. The interviews focused on participants' perceptions of how they arrived at judgments about student performance. The analysis resulted in three categories and three recurring themes within these categories: the categories assessor characteristics, assessors' perceptions of the assessment tasks, and the assessment context, and the themes perceived challenges, coping strategies, and personal development. Central to understanding the key processes in performance assessment appear to be the dynamic interrelatedness of the different factors and the developmental nature of the processes. The results are supported by literature from the field of expertise development and in line with findings from social cognition research. The conceptual framework has implications for faculty development and the design of programs of assessment.

摘要

近年来,医学教育界对个体教师对医学生表现进行主观判断的兴趣日益浓厚,这似乎与综合能力为基础的教育和学习评估的概念的引入直接相关。尽管人们知道评估者的专业知识在绩效评估中起着重要作用,但不同因素所扮演的角色仍有待阐明。因此,我们进行了一项探索性研究,旨在建立一个初步的模型,以更好地理解评估者的专业知识。我们采用扎根理论方法,对具有不同专业背景和评估经验的个体教师进行了十七次半结构化访谈。访谈重点关注参与者对他们如何对学生表现做出判断的看法。分析产生了三个类别和这些类别中的三个反复出现的主题:评估者特征、评估者对评估任务的看法以及评估背景,以及主题感知挑战、应对策略和个人发展。理解绩效评估关键过程的核心似乎是不同因素的动态相互关系和过程的发展性质。该结果得到了专业发展领域文献和社会认知研究结果的支持。该概念框架对教师发展和评估计划的设计具有启示意义。

相似文献

1
Expertise in performance assessment: assessors' perspectives.
Adv Health Sci Educ Theory Pract. 2013 Oct;18(4):559-71. doi: 10.1007/s10459-012-9392-x. Epub 2012 Jul 31.
3
From aggregation to interpretation: how assessors judge complex data in a competency-based portfolio.
Adv Health Sci Educ Theory Pract. 2018 May;23(2):275-287. doi: 10.1007/s10459-017-9793-y. Epub 2017 Oct 14.
4
Pre-clerkship EPA assessments: a thematic analysis of rater cognition.
BMC Med Educ. 2022 May 6;22(1):347. doi: 10.1186/s12909-022-03402-x.
5
Evaluating Objective Structured Clinical Assessment (OSCA) in undergraduate nursing.
Nurse Educ Pract. 2014 Sep;14(5):461-7. doi: 10.1016/j.nepr.2014.03.005. Epub 2014 Apr 16.
6
Making it fair: Learners' and assessors' perspectives of the attributes of fair judgement.
Med Educ. 2021 Sep;55(9):1056-1066. doi: 10.1111/medu.14574. Epub 2021 Jun 23.
7
From opening the 'black box' to looking behind the curtain: cognition and context in assessor-based judgements.
Adv Health Sci Educ Theory Pract. 2019 Mar;24(1):85-102. doi: 10.1007/s10459-018-9851-0. Epub 2018 Oct 9.
8
"You Want Me to Assess What?": Faculty Perceptions of Assessing Residents From Outside Their Specialty.
Acad Med. 2019 Oct;94(10):1478-1482. doi: 10.1097/ACM.0000000000002771.
9
Clinical assessors' working conceptualisations of undergraduate consultation skills: a framework analysis of how assessors make expert judgements in practice.
Adv Health Sci Educ Theory Pract. 2020 Oct;25(4):845-875. doi: 10.1007/s10459-020-09960-3. Epub 2020 Jan 29.
10
Developing a Novel 4-C Framework to Enhance Participation in Faculty Development.
Teach Learn Med. 2020 Aug-Sep;32(4):371-379. doi: 10.1080/10401334.2020.1742124. Epub 2020 Apr 6.

引用本文的文献

1
Medical students' perception of assessment and its effects on their learning in Dubai: a convergent mixed methods study.
Front Med (Lausanne). 2025 Aug 4;12:1620437. doi: 10.3389/fmed.2025.1620437. eCollection 2025.
3
The other side of the mark sheet: lessons learnt when medical students assess peers in formative clinical examinations.
Front Med (Lausanne). 2024 Jun 6;11:1395466. doi: 10.3389/fmed.2024.1395466. eCollection 2024.
4
Factors influencing clinician-educators' assessment practice in varied Southern contexts: a health behaviour theory perspective.
Adv Health Sci Educ Theory Pract. 2025 Feb;30(1):195-222. doi: 10.1007/s10459-024-10341-3. Epub 2024 May 29.
5
The Need for Standardization, Reliability and Validity in Fundamental Roots for a Successful Problem-Based Learning Program.
MedEdPublish (2016). 2019 Apr 22;8:93. doi: 10.15694/mep.2019.000093.1. eCollection 2019.
7
Clinician educators' conceptions of assessment in medical education.
Adv Health Sci Educ Theory Pract. 2023 Oct;28(4):1053-1077. doi: 10.1007/s10459-022-10197-5. Epub 2023 Jan 20.
8
Using cultural historical activity theory to reflect on the sociocultural complexities in OSCE examiners' judgements.
Adv Health Sci Educ Theory Pract. 2023 Mar;28(1):27-46. doi: 10.1007/s10459-022-10139-1. Epub 2022 Aug 9.
9
Validity as a social imperative: users' and leaders' perceptions.
Can Med Educ J. 2022 Jul 6;13(3):22-36. doi: 10.36834/cmej.73518. eCollection 2022 Jul.
10

本文引用的文献

1
Workplace-based assessment: raters' performance theories and constructs.
Adv Health Sci Educ Theory Pract. 2013 Aug;18(3):375-96. doi: 10.1007/s10459-012-9376-x. Epub 2012 May 17.
3
Workplace-based assessment: effects of rater expertise.
Adv Health Sci Educ Theory Pract. 2011 May;16(2):151-65. doi: 10.1007/s10459-010-9250-7. Epub 2010 Sep 30.
4
Toward authentic clinical evaluation: pitfalls in the pursuit of competency.
Acad Med. 2010 May;85(5):780-6. doi: 10.1097/ACM.0b013e3181d73fb6.
5
Cognitive load theory in health professional education: design principles and strategies.
Med Educ. 2010 Jan;44(1):85-93. doi: 10.1111/j.1365-2923.2009.03498.x.
6
Commentary: Assessment is an educational tool.
Acad Med. 2009 May;84(5):548-50. doi: 10.1097/ACM.0b013e31819f7fb9.
7
Is it me or is it them? Factors that influence the passing of underperforming students.
Med Educ. 2008 Aug;42(8):800-9. doi: 10.1111/j.1365-2923.2008.03113.x.
8
Naturalistic decision making.
Hum Factors. 2008 Jun;50(3):456-60. doi: 10.1518/001872008X288385.
9
Dual-processing accounts of reasoning, judgment, and social cognition.
Annu Rev Psychol. 2008;59:255-78. doi: 10.1146/annurev.psych.59.103006.093629.
10
Assessment: do we need to broaden our methodological horizons?
Med Educ. 2007 Dec;41(12):1121-3. doi: 10.1111/j.1365-2923.2007.02945.x.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验