Novant Health Cognitive Computing, Novant Health, Inc, Winston-Salem, NC, USA.
Novant Health Presbyterian Medical Center, Novant Health, Inc, Charlotte, NC, USA.
J Orthop Surg Res. 2024 May 10;19(1):287. doi: 10.1186/s13018-024-04774-0.
The Center for Medicare and Medicaid Services (CMS) imposes payment penalties for readmissions following total joint replacement surgeries. This study focuses on total hip, knee, and shoulder arthroplasty procedures as they account for most joint replacement surgeries. Apart from being a burden to healthcare systems, readmissions are also troublesome for patients. There are several studies which only utilized structured data from Electronic Health Records (EHR) without considering any gender and payor bias adjustments.
For this study, dataset of 38,581 total knee, hip, and shoulder replacement surgeries performed from 2015 to 2021 at Novant Health was gathered. This data was used to train a random forest machine learning model to predict the combined endpoint of emergency department (ED) visit or unplanned readmissions within 30 days of discharge or discharge to Skilled Nursing Facility (SNF) following the surgery. 98 features of laboratory results, diagnoses, vitals, medications, and utilization history were extracted. A natural language processing (NLP) model finetuned from Clinical BERT was used to generate an NLP risk score feature for each patient based on their clinical notes. To address societal biases, a feature bias analysis was performed in conjunction with propensity score matching. A threshold optimization algorithm from the Fairlearn toolkit was used to mitigate gender and payor biases to promote fairness in predictions.
The model achieved an Area Under the Receiver Operating characteristic Curve (AUROC) of 0.738 (95% confidence interval, 0.724 to 0.754) and an Area Under the Precision-Recall Curve (AUPRC) of 0.406 (95% confidence interval, 0.384 to 0.433). Considering an outcome prevalence of 16%, these metrics indicate the model's ability to accurately discriminate between readmission and non-readmission cases within the context of total arthroplasty surgeries while adjusting patient scores in the model to mitigate bias based on patient gender and payor.
This work culminated in a model that identifies the most predictive and protective features associated with the combined endpoint. This model serves as a tool to empower healthcare providers to proactively intervene based on these influential factors without introducing bias towards protected patient classes, effectively mitigating the risk of negative outcomes and ultimately improving quality of care regardless of socioeconomic factors.
医疗保险和医疗补助服务中心(CMS)对全关节置换手术后的再入院实施罚款。本研究主要关注全髋关节、膝关节和肩关节置换手术,因为它们占大多数关节置换手术。除了给医疗系统带来负担外,再入院也给患者带来了麻烦。有几项研究仅利用电子健康记录(EHR)中的结构化数据,而没有考虑任何性别和支付方偏见调整。
在这项研究中,收集了 2015 年至 2021 年期间在诺万健康进行的 38581 例全膝关节、髋关节和肩关节置换手术的数据。该数据用于训练随机森林机器学习模型,以预测手术后 30 天内出院或出院到熟练护理设施(SNF)时急诊就诊或计划外再入院的联合终点。提取了实验室结果、诊断、生命体征、药物和利用历史的 98 个特征。使用从 Clinical BERT 微调的自然语言处理(NLP)模型,根据患者的临床记录为每位患者生成一个 NLP 风险评分特征。为了解决社会偏见问题,与倾向评分匹配相结合进行了特征偏差分析。使用 Fairlearn 工具包中的阈值优化算法来减轻性别和支付方的偏见,以促进预测的公平性。
该模型的接收者操作特征曲线下面积(AUROC)为 0.738(95%置信区间,0.724 至 0.754),精度-召回曲线下面积(AUPRC)为 0.406(95%置信区间,0.384 至 0.433)。考虑到结果的患病率为 16%,这些指标表明,该模型能够在全关节置换手术背景下准确区分再入院和非再入院病例,同时调整模型中患者的分数,以减轻基于患者性别和支付方的偏见。
这项工作最终形成了一个模型,可以识别与联合终点相关的最具预测性和保护性的特征。该模型是一种工具,可以使医疗保健提供者能够根据这些影响因素主动干预,而不会对受保护的患者群体产生偏见,有效降低负面结果的风险,最终无论社会经济因素如何,都能提高护理质量。