Siddiqui Nadeem Ahmed, Hashmi Shiraz, Naz Iram, Sophie Ziad
Section of Vascular Surgery, Aga Khan University Hospital, Karachi, Pakistan.
Department of Surgery, Aga Khan University Hospital, Karachi, Pakistan.
Ann Vasc Dis. 2022 Dec 25;15(4):289-294. doi: 10.3400/avd.oa.22-00047.
To develop and validate a task-specific rating scale (TSRS) by comparing with the Global Rating Scale (GRS) for the evaluation of brachial artery embolectomy (BAE). Participants were divided into expert and novice groups who were oriented on the locally developed simulator model. The following day, an embolectomy procedure was performed independently by the participants and graded by two independent assessors using the GRS and TSRS. Validity was evaluated using Pearson's correlation coefficient (r), reliability by the interclass correlation coefficient (ICC), and agreement by Bland-Altman plots. A p-value <0.05 was considered significant. Thirty-two participants were enrolled in this study. The overall TSRS was found to be a valid assessment tool (r=0.82; 95% confidence interval [CI]: 0.66, 0.91; p<0.001). Domain-specific analyses showed a moderate positive association between all domains (p<0.05), except for instrument handling (r=0.09; 95%CI: -0.27, 0.42; p=0.642). The ICC for overall scores showed excellent reliability for both instruments, GRS and TSRS, with values of 0.97 and 0.92, respectively. The TSRS was found to be a valid and reliable assessment tool for BAE; however, for some domains, such as instrument handling and time and motion, it has limited reliability.
通过与全球评分量表（GRS）进行比较，开发并验证一种特定任务评分量表（TSRS），用于评估肱动脉取栓术（BAE）。参与者被分为专家组和新手组，他们以本地开发的模拟器模型为导向。第二天，参与者独立进行取栓手术，并由两名独立评估者使用GRS和TSRS进行评分。使用Pearson相关系数（r）评估效度，使用组内相关系数（ICC）评估信度，使用Bland-Altman图评估一致性。p值<0.05被认为具有统计学意义。本研究共纳入32名参与者。总体TSRS被发现是一种有效的评估工具（r = 0.82；95%置信区间[CI]：0.66，0.91；p < 0.001）。特定领域分析显示，除器械操作外（r = 0.09；95%CI：-0.27，0.42；p = 0.642），所有领域之间均存在中度正相关（p < 0.05）。总体评分的ICC显示，GRS和TSRS这两种工具的信度都非常好，分别为0.97和0.92。TSRS被发现是一种用于BAE的有效且可靠的评估工具；然而，对于某些领域，如器械操作以及时间和动作，其信度有限。
