Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, 3D10, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada.
Strategic Clinical Networks™, Provincial Clinical Excellence, Alberta Health Services, Calgary, AB, Canada.
Health Res Policy Syst. 2023 Jan 5;21(1):3. doi: 10.1186/s12961-022-00937-9.
To identify and assess the globally available valid, reliable and acceptable tools for assessing health research partnership outcomes and impacts.
We searched Ovid MEDLINE, Embase, CINAHL Plus and PsycINFO from origin to 2 June 2021, without limits, using an a priori strategy and registered protocol. We screened citations independently and in duplicate, resolving discrepancies by consensus and retaining studies involving health research partnerships, the development, use and/or assessment of tools to evaluate partnership outcomes and impacts, and reporting empirical psychometric evidence. Study, tool, psychometric and pragmatic characteristics were abstracted using a hybrid approach, then synthesized using descriptive statistics and thematic analysis. Study quality was assessed using the quality of survey studies in psychology (Q-SSP) checklist.
From 56 123 total citations, we screened 36 027 citations, assessed 2784 full-text papers, abstracted data from 48 studies and one companion report, and identified 58 tools. Most tools comprised surveys, questionnaires and scales. Studies used cross-sectional or mixed-method/embedded survey designs and employed quantitative and mixed methods. Both studies and tools were conceptually well grounded, focusing mainly on outcomes, then process, and less frequently on impact measurement. Multiple forms of empirical validity and reliability evidence was present for most tools; however, psychometric characteristics were inconsistently assessed and reported. We identified a subset of studies (22) and accompanying tools distinguished by their empirical psychometric, pragmatic and study quality characteristics. While our review demonstrated psychometric and pragmatic improvements over previous reviews, challenges related to health research partnership assessment and the nascency of partnership science persist.
This systematic review identified multiple tools demonstrating empirical psychometric evidence, pragmatic strength and moderate study quality. Increased attention to psychometric and pragmatic requirements in tool development, testing and reporting is key to advancing health research partnership assessment and partnership science. PROSPERO CRD42021137932.
确定和评估全球可用的有效、可靠和可接受的工具,以评估卫生研究伙伴关系的结果和影响。
我们在 2021 年 6 月 2 日之前,使用预先制定的策略和注册的方案,在 Ovid MEDLINE、Embase、CINAHL Plus 和 PsycINFO 中进行了无限制的搜索。我们独立并重复筛选引文,通过共识解决差异,并保留涉及卫生研究伙伴关系、开发、使用和/或评估工具以评估伙伴关系结果和影响以及报告实证心理测量证据的研究。使用混合方法提取研究、工具、心理测量和实用特征,然后使用描述性统计和主题分析进行综合。使用心理学调查研究质量检查表(Q-SSP)评估研究质量。
从 56123 条总引文,我们筛选了 36027 条引文,评估了 2784 篇全文论文,从 48 项研究和一份配套报告中提取了数据,并确定了 58 种工具。大多数工具包括调查、问卷和量表。研究采用横断面或混合方法/嵌入式调查设计,采用定量和混合方法。研究和工具在概念上都有很好的基础,主要关注结果,然后是过程,较少关注影响测量。大多数工具都有多种形式的实证有效性和可靠性证据;然而,心理测量特征的评估和报告不一致。我们确定了一组研究(22 项)和配套工具,它们在实证心理测量、实用和研究质量特征方面具有特色。虽然我们的综述表明在心理测量和实用方面有了改进,但与卫生研究伙伴关系评估和伙伴关系科学的新生相关的挑战仍然存在。
本系统综述确定了多个具有实证心理测量证据、实用优势和中等研究质量的工具。在工具开发、测试和报告中更加关注心理测量和实用要求,是推进卫生研究伙伴关系评估和伙伴关系科学的关键。PROSPERO CRD42021137932。