Centre for Applied Health Economics (CAHE), Griffith University, Brisbane, Queensland, Australia.
Menzies Health Institute Queensland (MHIQ), Brisbane, Queensland, Australia.
Health Serv Res. 2019 Oct;54(5):1023-1035. doi: 10.1111/1475-6773.13187. Epub 2019 Jun 19.
To identify patient-reported experience measures (PREMs), assess their validity and reliability, and assess any bias in the study design of PREM validity and reliability testing.
DATA SOURCES/STUDY SETTING: Articles reporting on PREM development and testing sourced from MEDLINE, CINAHL and Scopus databases up to March 13, 2018.
Systematic review.
DATA COLLECTION/EXTRACTION METHODS: Critical appraisal of PREM study design was undertaken using the Appraisal tool for Cross-Sectional Studies (AXIS). Critical appraisal of PREM validity and reliability was undertaken using a revised version of the COSMIN checklist.
Eighty-eight PREMs were identified, spanning across four main health care contexts. PREM validity and reliability was supported by appropriate study designs. Internal consistency (n = 58, 65.2 percent), structural validity (n = 49, 55.1 percent), and content validity (n = 34, 38.2 percent) were the most frequently reported validity and reliability tests.
Careful consideration should be given when selecting PREMs, particularly as seven of the 10 validity and reliability criteria were not undertaken in ≥50 percent of the PREMs. Testing PREM responsiveness should be prioritized for the application of PREMs where the end user is measuring change over time. Assessing measurement error/agreement of PREMs is important to understand the clinical relevancy of PREM scores used in a health care evaluation capacity.
确定患者报告的体验测量指标(PREMs),评估其有效性和可靠性,并评估 PREM 有效性和可靠性测试研究设计中的任何偏差。
数据来源/研究设置:截至 2018 年 3 月 13 日,从 MEDLINE、CINAHL 和 Scopus 数据库中检索到报道 PREM 开发和测试的文章。
系统评价。
数据收集/提取方法:使用横断面研究评价工具(AXIS)对 PREM 研究设计进行批判性评价。使用 COSMIN 清单的修订版对 PREM 的有效性和可靠性进行批判性评价。
确定了 88 种 PREMs,涵盖了四个主要的医疗保健环境。PREM 的有效性和可靠性得到了适当研究设计的支持。内部一致性(n=58,65.2%)、结构有效性(n=49,55.1%)和内容有效性(n=34,38.2%)是最常报告的有效性和可靠性测试。
在选择 PREMs 时应慎重考虑,特别是因为有 10 个有效性和可靠性标准中,有 7 个没有在≥50%的 PREMs 中进行测试。对于最终用户在测量随时间变化的情况下测量 PREM 反应的应用,应优先测试 PREM 的响应能力。评估 PREM 的测量误差/一致性对于理解在医疗保健评估能力中使用 PREM 分数的临床相关性非常重要。