School of Medicine and Public Health, University of Newcastle, Newbolds Building, University Drive, Callaghan, NSW, 2308, Australia.
General Practice Training Valley to Coast, Mayfield, NSW, Australia.
Adv Health Sci Educ Theory Pract. 2017 Oct;22(4):915-929. doi: 10.1007/s10459-016-9722-5. Epub 2016 Oct 21.
Underperforming trainees requiring remediation may threaten patient safety and are challenging for vocational training programs. Decisions to institute remediation are high-stakes-remediation being resource-intensive and emotionally demanding on trainees. Detection of underperformance requiring remediation is particularly problematic in general (family) practice. We sought to establish early-training assessment instruments predictive of general practice (GP) trainees' subsequently requiring formal remediation. We conducted a retrospective cohort study of trainees from a large Australian regionally-based GP training organization. The outcome factor was requirement for formal remediation. Independent variables were demographic factors and a range of formative assessments conducted immediately prior to or during early-stage training. Analyses employed univariate and multivariate logistic regression of each predictor assessment modality with the outcome, adjusting for potential confounders. Of 248 trainees, 26 (10.5 %) required formal remediation. Performance on the Colleague Feedback Evaluation Tool (entailing feedback from a trainee's clinical colleagues on clinical performance, communication and probity) and External Clinical Teaching Visits (half-day sessions of the trainee's clinical consultations observed directly by an experienced GP), along with non-Australian primary medical qualification, were significantly associated with requiring remediation. There was a non-significant trend for association with performance on the Doctors Interpersonal Skills Questionnaire (patient feedback on interpersonal elements of the consultation). There were no significant associations with entry-selection scores or formative exam or assessment scores. Our finding that 'in vivo' assessments of complex behaviour, but not 'in vitro' knowledge-based assessments, predict need for remediation is consistent with theoretical understanding of the nature of remediation decision-making and should inform remediation practice in GP vocational training.
表现不佳需要补救的受训者可能会威胁到患者安全,并且对职业培训计划构成挑战。实施补救措施的决定事关重大——补救措施需要大量资源,并且对受训者的情感要求很高。在普通(家庭)实践中,发现需要补救的表现不佳的情况尤其成问题。我们试图建立早期培训评估工具,以预测普通实践(GP)受训者随后需要正式补救的情况。我们对一个大型澳大利亚地区 GP 培训组织的受训者进行了回顾性队列研究。因变量是正式补救的要求。自变量是人口统计学因素和一系列在早期培训期间或之前进行的形成性评估。分析采用了每种预测评估模式与结果的单变量和多变量逻辑回归,调整了潜在的混杂因素。在 248 名受训者中,有 26 名(10.5%)需要正式补救。同事反馈评估工具(涉及受训者临床同事对临床表现、沟通和正直的反馈)和外部临床教学访问(受训者临床咨询的半天会议,由经验丰富的全科医生直接观察)的表现,以及非澳大利亚初级医疗资格,与需要补救显著相关。与医生人际技能问卷(患者对咨询中人际要素的反馈)的表现存在非显著趋势。与入门选拔分数或形成性考试或评估分数没有显著关联。我们的发现是,“现场”评估复杂行为,但不是“体外”基于知识的评估,预测需要补救,这与补救决策性质的理论理解一致,应告知 GP 职业培训中的补救实践。