Zhou Da, Zhong Wanting, Sun Qiu, Fu Qiang, Liu Pei, Zhong Shilin, Li Guoqing, Luo Bin, Chen Xiao, Wang Jian, Xu Chang
Huazhong University of Science and Technology, School of Public Health, Tongji Medical College, Wuhan, China.
Zhuhai People's Hospital (Zhuhai Hospital Affiliated with Jinan University), Zhuhai, China.
Digit Health. 2024 Oct 22;10:20552076241284726. doi: 10.1177/20552076241284726. eCollection 2024 Jan-Dec.
This study aims to explore a streamlined risk-adjusted cesarean section rate (RCSR) model and to compare its practical application effects with the traditional RCSR models.
Utilizing obstetric electronic health record (EHR) data from provincial multicenter hospitals, this study establishes a streamlined RCSR model alongside the traditional RCSR model and evaluates the efficacy of both models. Subsequently, the RCSRs of 56 hospitals within the province are calculated and ranked using both models. The consistency of these rankings is then quantified using Kendall's tau coefficient of concordance.
Comparison of model effectiveness evaluation of the traditional RCSR model versus the streamlined RCSR model is as follows: AUC (0.840 vs 0.839), accuracy (0.875 vs 0.872), sensitivity (0.690 vs 0.685), specificity (0.898 vs 0.892), positive predictive value (0.908 vs 0.903), negative predictive value (0.664 vs 0.660), and Brier score (0.069 vs 0.067). In the test of the consistency of hospital rankings based on two models, Kendall's tau coefficients were observed to be 0.979 (year 2017), 0.978 (year 2018), and 0.978 (year 2019) over a span of 3 years, with an aggregate coefficient of 0.974.
In the realm of model performance evaluation as well as the pragmatic application within hospital settings, the streamlined model exhibits a substantial congruence with the traditional model. Therefore, the streamlined model can effectively serve as a viable surrogate for the traditional model, potentially establishing itself as a refined paradigm for the appraisal of quality in obstetric healthcare services.
本研究旨在探索一种简化的风险调整剖宫产率(RCSR)模型,并将其实际应用效果与传统的RCSR模型进行比较。
利用省级多中心医院的产科电子健康记录(EHR)数据,本研究建立了一个简化的RCSR模型以及传统的RCSR模型,并评估了这两种模型的有效性。随后,使用这两种模型计算并排名该省内56家医院的RCSR。然后使用肯德尔和谐系数对这些排名的一致性进行量化。
传统RCSR模型与简化RCSR模型的模型有效性评估比较如下:曲线下面积(0.840对0.839)、准确率(0.875对0.872)、灵敏度(0.690对0.685)、特异度(0.898对0.892)、阳性预测值(0.908对0.903)、阴性预测值(0.664对0.660)和布里尔评分(0.069对0.067)。在基于两种模型的医院排名一致性测试中,在3年的时间跨度内,观察到肯德尔系数在2017年为0.979,2018年为0.978,2019年为0.978,总系数为0.974。
在模型性能评估以及医院环境中的实际应用方面,简化模型与传统模型表现出高度一致性。因此,简化模型可以有效地作为传统模型的可行替代方案,有可能成为产科医疗服务质量评估的优化范例。