Department of Criminal Justice, Temple University, Philadelphia, Pennsylvania, USA.
George Mason Univesity, Fairfax, Virginia, USA.
Res Synth Methods. 2023 Nov;14(6):847-852. doi: 10.1002/jrsm.1659. Epub 2023 Jul 31.
A diversity of approaches for critically appraising qualitative and quantitative evidence exist and emphasize different aspects. These approaches lack clear processes to facilitate rating the overall quality of the evidence for aggregated findings that combine qualitative and quantitative evidence. We draw on a meta-aggregation of implementation and process evaluations to illustrate a method for critically appraising empirical findings generated from qualitative and quantitative studies. This method includes a rubric for standardizing assessments of the overall quality of evidence in an evidence synthesis or mixed-method systematic review. The method first assesses the credibility of each finding extracted from a study. These individual assessments then feed into an overall score for any synthesized finding generated from the meta-aggregation. We argue that this approach provides a balanced and inclusive method of critical appraisal by first assessing individual findings, rather than studies, using flexible criteria applicable to a range of primary study methods to derive an overall assessment of synthesized findings.
现有的针对定性和定量证据的批判性评价方法多种多样，强调的方面也各不相同。这些方法缺乏明确的流程来对汇总定性和定量证据的综合发现的证据整体质量进行评分。我们借鉴实施和过程评估的元综合，举例说明了一种批判性评价来自定性和定量研究的实证发现的方法。该方法包括一个标准，用于对证据综合或混合方法系统评价中证据整体质量进行评估。该方法首先评估从研究中提取的每个发现的可信度。这些单独的评估结果再反馈到从元综合生成的任何综合发现的整体评分中。我们认为，这种方法通过首先使用适用于一系列主要研究方法的灵活标准来评估单个发现，而不是研究，为综合发现提供了一种平衡和包容的批判性评价方法。
