Jafri Lena, Siddiqui Imran, Khan Aysha Habib, Tariq Muhammed, Effendi Muhammad Umer Naeem, Naseem Azra, Ahmed Sibtain, Ghani Farooq, Alidina Shahnila, Shah Nadir, Majid Hafsa
Section of Chemical Pathology, Department of Pathology and Laboratory Medicine, Aga Khan University, Karachi Pakistan Stadium Road, Karachi, 74800, Pakistan.
Department of Medicine, Aga Khan University, Karachi, Pakistan.
BMC Med Educ. 2020 Oct 23;20(1):383. doi: 10.1186/s12909-020-02299-8.
The principle of workplace based assessment (WBA) is to assess trainees at work with feedback integrated into the program simultaneously. A student driven WBA model was introduced and perception evaluation of this teaching method was done subsequently by taking feedback from the faculty as well as the postgraduate trainees (PGs) of a residency program.
Descriptive multimethod study was conducted. A WBA program was designed for PGs in Chemical Pathology on Moodle and forms utilized were case-based discussion (CBD), direct observation of practical skills (DOPS) and evaluation of clinical events (ECE). Consented assessors and PGs were trained on WBA through a workshop. Pretest and posttest to assess PGs knowledge before and after WBA were conducted. Every time a WBA form was filled, perception of PGs and assessors towards WBA, time taken to conduct single WBA and feedback were recorded. Faculty and PGs qualitative feedback on perception of WBA was taken via interviews. WBA tools data and qualitative feedback were used to evaluate the acceptability and feasibility of the new tools.
Six eligible PGs and seventeen assessors participated in this study. A total of 79 CBDs (assessors n = 7 and PGs n = 6), 12 ECEs (assessors n = 6 and PGs n = 5), and 20 DOPS (assessors n = 6 and PGs n = 6) were documented. PGs average pretest score was 55.6%, which was improved to 96.4% in posttest; p value< 0.05. Scores of annual assessment before and after implementation of WBA also showed significant improvement, p value 0.039, Overall mean time taken to evaluate PG's was 12.6 ± 9.9 min and feedback time 9.2 ± 7.4 min. Mean WBA process satisfaction of assessors and PGs on Likert scale of 1 to 10 was 8 ± 1 and 8.3 ± 0.8 respectively.
Both assessors and fellows were satisfied with introduction and implementation of WBA. It gave the fellows opportunity to interact with assessors more often and learn from their rich experience. Gain in knowledge of PGs was identified from the statistically significant improvement in PGs' assessment scores after WBA implementation.
基于工作场所的评估(WBA)原则是在工作中对实习生进行评估,并将反馈同时纳入该项目。引入了一种学生驱动的WBA模式,随后通过收集来自某住院医师培训项目的教员以及研究生学员(PG)的反馈,对这种教学方法进行了认知评估。
进行描述性多方法研究。在Moodle上为临床化学病理学的PG设计了一个WBA项目,使用的表格包括基于案例的讨论(CBD)、实践技能直接观察(DOPS)和临床事件评估(ECE)。通过一个工作坊对同意参与的评估者和PG进行WBA培训。在WBA前后对PG的知识进行前测和后测。每次填写WBA表格时,记录PG和评估者对WBA的认知、进行单次WBA所需的时间以及反馈。通过访谈收集教员和PG对WBA认知的定性反馈。使用WBA工具数据和定性反馈来评估新工具的可接受性和可行性。
六名符合条件的PG和十七名评估者参与了本研究。共记录了79次CBD(评估者7名,PG 6名)、12次ECE(评估者6名,PG 5名)和20次DOPS(评估者6名,PG 6名)。PG的前测平均分数为55.6%,后测提高到96.4%;p值<0.05。WBA实施前后年度评估的分数也显示出显著提高,p值为0.039。评估PG的总体平均时间为12.6±9.9分钟,反馈时间为9.2±7.4分钟。评估者和PG在1至10李克特量表上对WBA过程的平均满意度分别为8±1和8.3±0.8。
评估者和学员都对WBA的引入和实施感到满意。它让学员有机会更频繁地与评估者互动,并从他们丰富的经验中学习。从WBA实施后PG评估分数的统计学显著提高中可以看出PG知识的增长。