Feeley Aoife, Turley Luke, Sheehan Eoin, Merghani Khalid
Department of Trauma and Orthopaedic Surgery, Tullamore Hospital, Arden, Road, Tullamore, Co. Offaly, Ireland.
Graduate Entry Medical School, University of Limerick, Castletroy, Limerick, Ireland.
Arthrosc Sports Med Rehabil. 2021 Jul 17;3(5):e1287-e1293. doi: 10.1016/j.asmr.2021.05.009. eCollection 2021 Oct.
We evaluate the face, content, and construct validity of a portable hip arthroscopy module in a regional orthopaedic unit.
Participants were recruited from a regional orthopaedic centre, and categorized into novice (0 arthroscopies), intermediate (1-29 arthroscopies), and expert (>50 arthroscopies) groups based on reported experience in arthroscopy. Face and content validity was evaluated by feedback from users immediately following completion of modules. Objective measurements, including time taken and subjective measurements consisting of simulation software metrics including, cam lesion locations attempts, scope strikes on bone, healthy bone burred, and cam lesion burred. Scores achieved by experts were recorded, and the median score was set at the level at which proficiency was demonstrated. Participant feedback on perceived educational use was collected following completion.
In total, 20 participant results were included for analysis. Good face and content validity was expressed by participants with previous arthroscopic experience. Number of scope strikes within the simulator-derived metrics accurately discerned between levels of experience. Novices had a mean of 5 strikes per attempt (SD a mean of 5.8 strikes (SD 4.1). There was a significant difference between expert and novice groups ( = .01), and expert and intermediate groups ( = .002). No significant difference between overall performance scores achieved by participants in expert, intermediate, and novice groups (62% vs 55% vs 50% = .15). This demonstrates incomplete construct validity of the simulator software-derived metrics.
This hip arthroscopy simulator demonstrated acceptable face and content validity, with incomplete construct validity of simulator software metrics. Participants reported high levels of satisfaction with the module, highlighting that the addition of haptic feedback would be beneficial to improve procedural steps. Incorporation of tactile feedback to the modulator components would likely enable the software to accurately delineate between levels of experience.
This study demonstrates good face and content validity. The addition of haptic feedback in a hip arthroscopy simulator may improve learning.
我们在一个地区骨科单位评估了一个便携式髋关节镜模块的表面效度、内容效度和结构效度。
参与者从一个地区骨科中心招募，根据报告的关节镜经验分为新手组（0例关节镜手术）、中级组（1 - 29例关节镜手术）和专家组（>50例关节镜手术）。在模块完成后，通过用户的反馈评估表面效度和内容效度。客观测量包括所用时间，主观测量由模拟软件指标组成，包括凸轮病变定位尝试、器械撞击骨骼、健康骨面打磨和凸轮病变打磨。记录专家获得的分数，并将中位数分数设定为证明熟练程度的水平。在完成后收集参与者对感知教育用途的反馈。
总共纳入20名参与者的结果进行分析。有过关节镜经验的参与者表示该模块具有良好的表面效度和内容效度。模拟器衍生指标中的器械撞击次数能够准确区分不同经验水平。新手每次尝试的平均撞击次数为5次（标准差 中级组平均为5.8次（标准差 专家组平均为2.4次（标准差 专家组与新手组之间存在显著差异（P = 0.01），专家组与中级组之间也存在显著差异（P = 0.002）。专家组、中级组和新手组参与者的总体表现得分之间无显著差异（62% 对55% 对50% P = 0.15）。这表明模拟器软件衍生指标的结构效度不完整。
这个髋关节镜模拟器表现出可接受的表面效度和内容效度，但模拟器软件指标的结构效度不完整。参与者对该模块的满意度较高，强调增加触觉反馈将有助于改进操作步骤。在调制器组件中加入触觉反馈可能会使软件能够准确区分不同经验水平。
本研究表明该模块具有良好的表面效度和内容效度。在髋关节镜模拟器中加入触觉反馈可能会改善学习效果。
