Department of Family Medicine, American University of Beirut Medical Center, Beirut, Lebanon.
Psychology, American University of Beirut Medical Center, Beirut, Lebanon.
BMC Med Educ. 2023 Nov 16;23(1):870. doi: 10.1186/s12909-023-04845-6.
The main objective of this study is to assess the construct validity and reliability of the Grading Reflective Essays-9 (GRE-9).
This study took place in a major tertiary academic medical center in Beirut, Lebanon. 104 reflective essays written by years 1-3 residents in the department of Family Medicine at the American University of Beirut Medical Center (AUBMC) were graded by 2 trained raters who independently scored the essays using GRE-9. GRE-9 scores were then correlated with scores on communication skills OSCE stations and in-training examinations to investigate, respectively, convergent and divergent validity. One of the 2 raters scored the essays twice one month apart to assess the reliability of the GRE-9 using intra rater reliability and internal consistency.
There was a weak, non-significant correlation between GRE-9 score and In training examination (ITE) score (r = - .213, p = .395). There was a moderate, non-significant correlation between GRE-9 scores and the Objective structured clinical examination (OSCE) communication station scores (r = - .412 p = .162). The correlation coefficient between trails 1 and 2 was significant (r = .832, p = .000). Intra class correlation coefficient (ICC) analysis demonstrated almost perfect intra-rater agreement (0.819; 95% CI: 0.741-0.875) of the test ratings over time.
GRE-9, is a short, concise, easy-to-use reliable grading tool for reflective essays that has demonstrated moderate to substantial intra-rater reliability and evidence of divergent validity. The study found non-significant correlations between reflective writing scores OSCE communication scores demonstrating a lack of relationship between reflective writing and this measure of performance.
本研究的主要目的是评估九级反思性文章评分量表（GRE-9）的结构效度和信度。
本研究在黎巴嫩贝鲁特的一家主要的三级学术医学中心进行。104 篇由贝鲁特美国大学医学中心（AUBMC）家庭医学系 1 至 3 年级住院医师撰写的反思性文章由 2 名经过培训的评分员使用 GRE-9 进行独立评分。然后，将 GRE-9 评分与沟通技能 OSCE 站和在培训考试的评分进行相关分析，以分别调查收敛效度和发散效度。其中一位评分员在一个月后对这些文章进行了两次评分，以使用组内相关系数评估 GRE-9 的信度和内部一致性。
GRE-9 评分与在培训考试（ITE）评分之间存在微弱、无统计学意义的相关性（r = -0.213，p = 0.395）。GRE-9 评分与客观结构化临床考试（OSCE）沟通站评分之间存在中度、无统计学意义的相关性（r = -0.412，p = 0.162）。第一和第二轨迹之间的相关系数具有统计学意义（r = 0.832，p = 0.000）。组内相关系数（ICC）分析表明，测试评分在时间上具有几乎完美的组内一致性（0.819；95%置信区间：0.741-0.875）。
GRE-9 是一种简短、简洁、易于使用的可靠的反思性文章评分工具，具有中等至较大的组内评分者信度，且具有发散效度的证据。研究发现，反思性写作评分与 OSCE 沟通评分之间存在非显著相关性，表明反思性写作与这种表现衡量标准之间缺乏关系。
