Center for Mathematical Modeling (CNRS IRL2807), University of Chile, Santiago, Chile.
Departamento de Ciencia de la Computación and Instituto de Matemática Computacional, Pontificia Universidad Católica de Chile, Santiago, Chile.
Health Care Manag Sci. 2023 Jun;26(2):313-329. doi: 10.1007/s10729-022-09626-z. Epub 2023 Jan 28.
The Chilean public health system serves 74% of the country's population, and 19% of medical appointments are missed on average because of no-shows. The national goal is 15%, which coincides with the average no-show rate reported in the private healthcare system. Our case study, Doctor Luis Calvo Mackenna Hospital, is a public high-complexity pediatric hospital and teaching center in Santiago, Chile. Historically, it has had high no-show rates, up to 29% in certain medical specialties. Using machine learning algorithms to predict no-shows of pediatric patients in terms of demographic, social, and historical variables. To propose and evaluate metrics to assess these models, accounting for the cost-effective impact of possible intervention strategies to reduce no-shows. We analyze the relationship between a no-show and demographic, social, and historical variables, between 2015 and 2018, through the following traditional machine learning algorithms: Random Forest, Logistic Regression, Support Vector Machines, AdaBoost and algorithms to alleviate the problem of class imbalance, such as RUS Boost, Balanced Random Forest, Balanced Bagging and Easy Ensemble. These class imbalances arise from the relatively low number of no-shows to the total number of appointments. Instead of the default thresholds used by each method, we computed alternative ones via the minimization of a weighted average of type I and II errors based on cost-effectiveness criteria. 20.4% of the 395,963 appointments considered presented no-shows, with ophthalmology showing the highest rate among specialties at 29.1%. Patients in the most deprived socioeconomic group according to their insurance type and commune of residence and those in their second infancy had the highest no-show rate. The history of non-attendance is strongly related to future no-shows. An 8-week experimental design measured a decrease in no-shows of 10.3 percentage points when using our reminder strategy compared to a control group. Among the variables analyzed, those related to patients' historical behavior, the reservation delay from the creation of the appointment, and variables that can be associated with the most disadvantaged socioeconomic group, are the most relevant to predict a no-show. Moreover, the introduction of new cost-effective metrics significantly impacts the validity of our prediction models. Using a prototype to call patients with the highest risk of no-shows resulted in a noticeable decrease in the overall no-show rate.
智利的公共卫生系统为全国 74%的人口提供服务,平均有 19%的医疗预约因患者失约而被取消。智利的目标是将这一比例降低到 15%,这与私人医疗保健系统报告的平均失约率相吻合。我们的案例研究对象是智利圣地亚哥的 Luis Calvo Mackenna 医生医院,这是一家公共的高复杂性儿科医院和教学中心。该医院历史上一直存在很高的失约率,某些科室甚至高达 29%。我们使用机器学习算法根据人口统计学、社会和历史变量预测儿科患者的失约情况。为了提出和评估衡量这些模型的指标,我们需要考虑到降低失约率的可能干预策略的成本效益影响。我们分析了 2015 年至 2018 年期间,失约与人口统计学、社会和历史变量之间的关系,使用了以下传统机器学习算法:随机森林、逻辑回归、支持向量机、AdaBoost 以及缓解类不平衡问题的算法,如 RUS Boost、平衡随机森林、平衡套袋和简单集成。这些类不平衡现象是由于失约人数相对于总预约人数相对较少而导致的。我们没有使用每种方法的默认阈值,而是根据成本效益标准,通过最小化基于 I 型和 II 型错误的加权平均值来计算替代阈值。在所考虑的 395963 次预约中,有 20.4%的预约失约,其中眼科的失约率最高,为 29.1%。根据保险类型和居住地所在社区,属于社会经济条件最不利群体的患者以及处于第二个婴儿期的患者失约率最高。就诊记录与未来失约有很强的相关性。一个为期 8 周的实验设计表明,与对照组相比,使用我们的提醒策略可以将失约率降低 10.3 个百分点。在所分析的变量中,与患者历史行为相关的变量、从预约创建到预约保留的延迟时间,以及可以与最不利的社会经济群体相关联的变量,是预测失约最相关的变量。此外,引入新的具有成本效益的指标会显著影响我们的预测模型的有效性。使用原型给失约风险最高的患者打电话,可显著降低整体失约率。