Rogers-Vizena Carolyn R, Yao Caroline A, Sideridis Georgios D, Minahan Lindsey, Saldanha Francesca Y L, Livingston Katie A, Weinstock Peter H
Department of Plastic and Oral Surgery, Boston Children's Hospital, Boston, Mass.
Boston Children's Hospital Simulator Program (SIMPeds), Boston, Mass.
Plast Reconstr Surg Glob Open. 2022 Jul 22;10(7):e4435. doi: 10.1097/GOX.0000000000004435. eCollection 2022 Jul.
Demonstrating competency before independent practice is increasingly important in surgery. This study tests the hypothesis that a high-fidelity cleft lip simulator can be used to discriminate performance between training levels, demonstrating its utility for assessing procedural competence.
During this prospective cohort study, participants performed a unilateral cleft lip repair on a high-fidelity simulator. Videos were blindly rated using the Objective Structured Assessment of Technical Skills (OSATS) and the Unilateral Cleft Lip Repair Competency Assessment Tool (UCLR). Digital measurement of symmetry was estimated. Influence of training level and cumulative prior experience on each score was estimated using Pearson r.
Participants (n = 26) ranged from postgraduate year 3 to craniofacial fellow. Training level correlated best with UCLR (R = 0.4842, = 0.0122*) and more weakly with OSATS (R = 0.3645, = 0.0671), whereas cumulative prior experience only weakly correlated with UCLR (R = 0.3450, = 0.0843) and not with OSATS (R = 0.1609, = 0.4323). UCLR subscores indicated marking the repair had little correlation with training level (R = 0.2802, = 0.1656), whereas performance and result did (R = 0.5152, = 0.0071*, R = 0.4226, = 0.0315*, respectively). Correlation between symmetry measures and training level was weak.
High-fidelity simulation paired with an appropriate procedure-specific assessment tool has the construct validity to evaluate performance for cleft lip repair. Simply being able to mark a cleft lip repair is not an accurate independent assessment method nor is symmetry of the final result.
在外科手术中,独立执业前展示能力变得越来越重要。本研究检验了这样一个假设,即高保真唇裂模拟器可用于区分不同培训水平的操作表现,证明其在评估手术能力方面的效用。
在这项前瞻性队列研究中,参与者在高保真模拟器上进行单侧唇裂修复。使用客观结构化技术技能评估(OSATS)和单侧唇裂修复能力评估工具(UCLR)对视频进行盲评。估计对称性的数字测量值。使用Pearson r估计培训水平和累积既往经验对每个分数的影响。
参与者(n = 26)从研究生三年级到颅面外科研究员不等。培训水平与UCLR的相关性最佳(R = 0.4842,P = 0.0122*),与OSATS的相关性较弱(R = 0.3645,P = 0.0671),而累积既往经验与UCLR的相关性较弱(R = 0.3450,P = 0.0843),与OSATS无相关性(R = 0.1609,P = 0.4323)。UCLR子分数表明,标记修复与培训水平的相关性较小(R = 0.2802,P = 0.1656),而操作表现和结果的相关性较大(分别为R = 0.5152,P = 0.0071*,R = 0.4226,P = 0.0315*)。对称性测量与培训水平之间的相关性较弱。
高保真模拟与适当的特定手术评估工具相结合,具有评估唇裂修复操作表现的结构效度。仅仅能够标记唇裂修复并不是一种准确的独立评估方法,最终结果的对称性也不是。