Haute Autorité de Santé, Saint-Denis La Plaine Cedex, France.
BMJ Open. 2013 Aug 30;3(8):e003289. doi: 10.1136/bmjopen-2013-003289.
Accreditation in France relies on a mandatory 4-year cycle of self-assessment and a peer review of 82 standards, among which 14 focus priority standards (FPS). Hospitals are also required to measure yearly quality indicators (QIs-5 in 2010). On advice given by the accreditation committee of HAS (Haute Autorité en Santé), based on surveyors proposals and relying mostly on compliance to standards, accreditation decisions are taken by the board of HAS. Accreditation is still perceived by hospitals as a burdensome process and a simplification would be welcomed. The hypothesis was that a more limited number of criteria might give sufficient amount of information on hospitals overall quality level, appraised today by accreditation decisions.
The accuracy of predictions of accreditation decisions given by a model, Partial Least Square-2 Discriminant Analysis (PLS2-DA), using only the results of FPS and QIs was measured. Accreditation decisions (full accreditation (A), recommendations or reservation (B), remit decision or non-accreditation (C)), results of FPS and QIs were considered qualitative variables. Stability was assessed by leave one out cross validation (LOOCV).
All French 489 acute care organisations (ACO) accredited between June 2010 and January 2012 were considered, 304 of them having a rehabilitation care sector (RCS).
Accuracy of prediction of accreditation decisions was good (89% of ACOs and 91% of ACO-RCS well classified). Stability of results appeared satisfactory when using LOOCV (87% of ACOs and 89% of ACO-RCS well classified). Identification of worse hospitals was correct (90% of ACOs and 97% of ACO-RCS predicted C were actually C).
Using PLS2-DA with a limited number of criteria (QIs and FPS) provides an accurate prediction of accreditation decisions, especially for underperforming hospitals. This could support accreditation committees which give advices on accreditation decisions, and allow fast-track handling of 'safe' reports.
法国的认证依赖于强制性的 4 年自我评估周期和对 82 项标准的同行评审,其中 14 项是重点优先标准(FPS)。医院还需要每年测量质量指标(2010 年为 QI-5)。根据 HAS(法国卫生高级管理局)认证委员会的建议,根据评估员的建议,并主要依靠对标准的遵守情况,HAS 委员会做出认证决定。认证仍然被医院视为一个繁琐的过程,简化将受到欢迎。假设更少数量的标准可能会提供足够的信息,评估当前认证决策的医院整体质量水平。
使用偏最小二乘-2 判别分析(PLS2-DA)模型,仅使用 FPS 和 QI 的结果来测量认证决策的预测准确性。认证决策(完全认证(A)、建议或保留(B)、授权决定或不认证(C))、FPS 和 QI 的结果被视为定性变量。通过留一法交叉验证(LOOCV)评估稳定性。
考虑了 2010 年 6 月至 2012 年 1 月期间获得认证的所有法国 489 家急性护理组织(ACO),其中 304 家拥有康复护理部门(RCS)。
认证决策的预测准确性良好(89%的 ACO 和 91%的 ACO-RCS 分类良好)。使用 LOOCV 时,结果的稳定性似乎令人满意(87%的 ACO 和 89%的 ACO-RCS 分类良好)。识别较差的医院是正确的(90%的 ACO 和 97%的 ACO-RCS 预测 C 的实际上是 C)。
使用 PLS2-DA 和有限数量的标准(QI 和 FPS)可以准确预测认证决策,特别是对于表现不佳的医院。这可以为认证委员会提供支持,为认证决策提供建议,并允许快速处理“安全”报告。