Assessing the impact of propensity score estimation and implementation on covariate balance and confounding control within and across important subgroups in comparative effectiveness research.

PURPOSE

Researchers are often interested in estimating treatment effects in subgroups controlling for confounding based on a propensity score (PS) estimated in the overall study population.

OBJECTIVE

To evaluate covariate balance and confounding control in sulfonylurea versus metformin initiators within subgroups defined by cardiovascular disease (CVD) history comparing an overall PS with subgroup-specific PSs implemented by 1:1 matching and stratification.

METHODS

We analyzed younger patients from a US insurance claims database and older patients from 2 Medicare (Humana Medicare Advantage, fee-for-service Medicare Parts A, B, and D) datasets. Confounders and risk factors for acute myocardial infarction were included in an overall PS and subgroup PSs with and without CVD. Covariate balance was assessed using the average standardized absolute mean difference (ASAMD).

RESULTS

Compared with crude estimates, ASAMD across covariates was improved 70%-94% for stratification for Medicare cohorts and 44%-99% for the younger cohort, with minimal differences between overall and subgroup-specific PSs. With matching, 75%-99% balance improvement was achieved regardless of cohort and PS, but with smaller sample size. Hazard ratios within each CVD subgroup differed minimally among PS and cohorts.

CONCLUSIONS

Both overall PSs and CVD subgroup-specific PSs achieved good balance on measured covariates when assessing the relative association of diabetes monotherapy with nonfatal myocardial infarction. PS matching generally led to better balance than stratification, but with smaller sample size. Our study is limited insofar as crude differences were minimal, suggesting that the new user, active comparator design identified patients with some equipoise between treatments.