Noteboom Sijm H, Kho Eline, Veelo Denise P, van der Ster Björn J P, van Haeren Maite M T, Viersen Victor A, Müller Marcella C A, Hermanns Henning, Vlaar Alexander P J, Schenk Jimmy
From the Department of Anesthesiology, Amsterdam University Medical Center, University of Amsterdam, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands.
Department of Intensive Care, Amsterdam University Medical Center, University of Amsterdam, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands.
Anesth Analg. 2025 Sep 1;141(3):588-597. doi: 10.1213/ANE.0000000000007400. Epub 2025 Feb 19.
Rotational thromboelastometry (ROTEM) is widely used for point-of-care coagulation testing to reduce blood transfusions. Accurate interpretation of ROTEM data is crucial and requires substantial training. This study investigates the inter- and intrarater reliability of ROTEM interpretation among experts and compares their interpretations with a ROTEM-guided algorithm.
This study was conducted at Amsterdam University Medical Center and included 90 cardiac surgery patients. ROTEM data were collected at 4 surgical stages: before induction, after aortic declamping, postcoagulation correction, and within 2 hours of intensive care unit (ICU) admission. An international panel of 7 cardiovascular anesthesiologists and one intensivist interpreted the data. Interrater reliability was assessed using Fleiss' kappa for binary decisions and the simple matching coefficient (SMC) for multiple-choice questions. Intrarater reliability with the ROTEM-guided algorithm was also evaluated.
Three hundred forty-three ROTEM measurements were analyzed. The interrater reliability for binary decisions was substantial to almost perfect, except after declamping (Fleiss' kappa = 0.34). The SMC for determining type of abnormality and interventions ranged from good to excellent across all ROTEM measuring moments (SMC ≥0.75). Intrarater reliability was almost perfect for binary questions (intraclass correlation coefficient [ICC] ≥0.81) and showed excellent agreement for multiple-choice questions. Comparing expert recommendations with the algorithm resulted in an average SMC of 0.70 indicating differences in intervention recommendations, with experts frequently recommending fibrinogen and protamine over the algorithm's suggestions of plasma and PCC.
This study demonstrates high inter- and intrarater reliability in ROTEM interpretation among trained professionals in cardiac surgery, with almost perfect agreement on abnormalities and interventions. However, differences between expert evaluations and the ROTEM-guided algorithm underscore the need for advanced clinical decision-making tools. Future efforts should focus on developing personalized, data-driven algorithms without predefined cutoff values to improve accuracy and patient outcomes.
旋转血栓弹力图(ROTEM)广泛用于床旁凝血检测以减少输血。准确解读ROTEM数据至关重要,且需要大量培训。本研究调查了专家之间以及同一专家不同次解读ROTEM的可靠性,并将他们的解读与ROTEM指导算法进行比较。
本研究在阿姆斯特丹大学医学中心进行,纳入了90例心脏手术患者。在4个手术阶段收集ROTEM数据:诱导前、主动脉夹闭解除后、凝血纠正后以及重症监护病房(ICU)入院后2小时内。由7名心血管麻醉医生和1名重症医学专家组成的国际小组对数据进行解读。对于二元决策,使用Fleiss卡方评估评分者间信度;对于多项选择题,使用简单匹配系数(SMC)评估。还评估了同一评分者使用ROTEM指导算法时的信度。
共分析了343次ROTEM测量。除夹闭解除后(Fleiss卡方 = 0.34)外,二元决策的评分者间信度较高至几乎完美。在所有ROTEM测量时刻,确定异常类型和干预措施的SMC范围为良好至优秀(SMC≥0.75)。二元问题的同一评分者信度几乎完美(组内相关系数[ICC]≥0.81),多项选择题显示出极好的一致性。将专家建议与算法进行比较,平均SMC为0.70,表明干预建议存在差异,专家经常推荐使用纤维蛋白原和鱼精蛋白,而算法建议使用血浆和凝血酶原复合物浓缩物。
本研究表明,心脏手术领域训练有素的专业人员在解读ROTEM方面具有较高的评分者间和同一评分者信度,在异常情况和干预措施方面几乎完全一致。然而,专家评估与ROTEM指导算法之间的差异凸显了先进临床决策工具的必要性。未来的工作应专注于开发无预定义临界值的个性化、数据驱动算法,以提高准确性和患者预后。