Department of Health Sciences, Faculty of Science, Vrije Universiteit Amsterdam, De Boelelaan 1085, 1081 HV, Amsterdam, The Netherlands.
Department of Political Science and Public Administration, Faculty of Social Sciences, Vrije Universiteit Amsterdam, De Boelelaan 1085, 1081 HV, Amsterdam, The Netherlands.
Eur J Health Econ. 2021 Nov;22(8):1239-1251. doi: 10.1007/s10198-021-01333-w. Epub 2021 Jun 30.
Hospital quality indicators provide valuable insights for quality improvement, empower patients to choose providers, and have become a cornerstone of value-based payment. As outcome indicators are cumbersome and expensive to measure, many health systems have relied on proxy indicators, such as structure and process indicators. In this paper, we assess the extent to which publicly reported structure and process indicators are correlated with outcome indicators, to determine if these provide useful signals to inform the public about the outcomes. Quality indicators for three conditions (breast and colorectal cancer, and hip replacement surgery) for Dutch hospitals (2011-2018) were collected. Structure and process indicators were compared to condition-specific outcome indicators and in-hospital mortality ratios in a between-hospital comparison (cross-sectional and between-effects models) and in within-hospital comparison (fixed-effects models). Systematic association could not be observed for any of the models. Both positive and negative signs were observed where negative associations were to be expected. Despite sufficient statistical power, the share of significant correlations was small [mean share: 13.2% (cross-sectional); 26.3% (between-effects); 13.2% (fixed-effects)]. These findings persisted in stratified analyses by type of hospital and in models using a multivariate approach. We conclude that, in the context of compulsory public reporting, structure and process indicators are not correlated with outcome indicators, neither in between-hospital comparisons nor in within-hospital comparisons. While structure and process indicators remain valuable for internal quality improvement, they are unsuitable as signals for informing the public about hospital differences in health outcomes.
医院质量指标为质量改进提供了有价值的见解,使患者能够选择提供者,并已成为基于价值的支付的基石。由于结果指标的测量既繁琐又昂贵,许多卫生系统依赖于代理指标,如结构和过程指标。在本文中,我们评估了公开报告的结构和过程指标与结果指标的相关性程度,以确定这些指标是否为向公众提供有关结果的有用信号。收集了荷兰医院(2011-2018 年)三种情况(乳腺癌和结直肠癌以及髋关节置换手术)的质量指标。在医院间比较(横截面和组间效应模型)和医院内比较(固定效应模型)中,将结构和过程指标与特定于条件的结果指标和院内死亡率进行了比较。在任何模型中都没有观察到系统的关联。尽管存在足够的统计能力,但显著相关的比例很小[平均比例:横截面为 13.2%;组间效应为 26.3%;固定效应为 13.2%]。这些发现在按医院类型分层的分析和使用多变量方法的模型中仍然存在。我们的结论是,在强制性公开报告的背景下,结构和过程指标与结果指标之间没有相关性,无论是在医院间比较还是在医院内比较中均无相关性。虽然结构和过程指标仍然对内部质量改进很有价值,但它们不适合作为向公众通报医院在健康结果方面差异的信号。