Department of Orthopaedic Surgery, Morgan Stanley Children's Hospital of New York Presbyterian, Columbia University Irving Medical Center, 3959 Broadway, Suite 800 North, CHONY 8-N, New York, NY, 10032-3784, USA.
Department of Epidemiology, Mailman School of Public Health, Columbia University, 722 West 168th Street, New York, NY, 10032, USA.
Spine Deform. 2023 Jan;11(1):205-212. doi: 10.1007/s43390-022-00573-x. Epub 2022 Sep 2.
Appropriately measuring and classifying surgical complications is a critical component of research in vulnerable populations, including children with early-onset scoliosis (EOS). The purpose of this study was to assess the inter- and intra-rater reliability of a modified Clavien-Dindo-Sink system (CDS) classification system for EOS patients among a group of pediatric spinal deformity surgeons.
Thirty case scenarios were developed and presented to experienced surgeons in an international spine study group. For each case, surgeons were asked to select a level of severity based on the modified CDS system to assess inter-rater reliability. The survey was administered on two occasions to allow for assessment of intra-rater reliability. Weighted Kappa values were calculated, with 0.61 to 0.80 considered substantial agreement and 0.81 to 1.00 considered nearly perfect agreement.
11/12 (91.7%) surgeons completed the first-round survey and 8/12 (66.7%) completed the second. Inter-observer weighted kappa values for the first and second survey were 0.75 [95% CI 0.56-0.94], indicating substantial agreement, and 0.84 [95% CI 0.70-0.98], indicating nearly perfect agreement, respectively. Intra-observer reliability was 0.86 (range 0.74-0.95) between the first and second surveys, indicating nearly perfect agreement .
The modified CDS classification system demonstrated substantial to nearly perfect agreement between and within observers for the evaluation of complications following the surgical treatment of EOS patients. Adoption of this reliable classification system as a standard for reporting complications in EOS patients can be a valuable tool for future research endeavors, as we seek to ultimately improve surgical practices and patient outcomes.
Level V.
在包括早发性脊柱侧凸(EOS)患儿在内的弱势群体的研究中,恰当地测量和分类手术并发症是至关重要的。本研究的目的是评估一种改良的 Clavien-Dindo-Sink (CDS)分类系统在一组小儿脊柱畸形外科医生中用于 EOS 患者的组内和组间观察者间可靠性。
开发了 30 个病例情景,并向国际脊柱研究小组的经验丰富的外科医生展示。对于每个病例,外科医生被要求根据改良的 CDS 系统选择严重程度级别,以评估组间观察者间可靠性。该调查分两次进行,以评估组内观察者间可靠性。计算加权 Kappa 值,0.61 至 0.80 被认为是实质性一致,0.81 至 1.00 被认为是近乎完美一致。
11/12(91.7%)位外科医生完成了第一轮调查,8/12(66.7%)完成了第二轮。第一轮和第二轮调查的观察者间加权 Kappa 值分别为 0.75 [95%置信区间(CI)0.56-0.94],表明实质性一致,0.84 [95%CI 0.70-0.98],表明近乎完美一致。第一次和第二次调查的观察者内可靠性为 0.86(范围为 0.74-0.95),表明近乎完美一致。
改良的 CDS 分类系统在评估 EOS 患者手术后并发症的评估中,观察者间和观察者内具有实质性到近乎完美的一致性。采用这种可靠的分类系统作为 EOS 患者报告并发症的标准,可以成为未来研究工作的有价值的工具,因为我们旨在最终改善手术实践和患者结局。
5 级。