The quantitative story behind the quality improvement storyboards: a synthesis of quality improvement projects conducted by the multi-state learning collaborative.

CONTEXT

The Multi-State Learning Collaborative: Lead States in Public Health Quality Improvement (MLC) brought state and local health departments in 16 states together with public health system and national partners to prepare for national voluntary accreditation and to implement quality improvement (QI) practices.

OBJECTIVE

The MLC has collected the single largest repository of qualitative public health QI data to date. A preliminary study was conducted to explore the potential merits of further mining data sets of this size and scope and examining them quantitatively.

DESIGN

We addressed the following research question: What characteristics of QI projects/mini-collaboratives make them more or less likely to attain their stated objectives? Qualitative MLC data were modified and coded as quantifiable measures using categorical or Likert scale measures analyzable through quantitative methods. Descriptive and inferential statistics were calculated.

RESULTS

Of the 156 mini-collaboratives with complete data, chronic disease was the most commonly selected target area. Among the 4 dependent variables, results varied somewhat by outcome. There was support in 1 or more analytical models for a positive relationship between aim statements that included target objectives, time frames, measurable goals, and well-defined processes. The degree to which the intervention was logically aligned with the aim and the comprehensiveness of the QI project were also positively associated with 1 or more outcomes. The large number of statistical tests conducted may have led to type I errors for some comparisons.

CONCLUSIONS

Quantitative analysis and modeling of public health QI activities are feasible and desirable. It may provide critical information leading to incremental improvement in QI performance within public health practice. This work can inform the nascent national accreditation program and the developing QI in Public Health Practice Exchange.