Clark Sigrún Eyrúnardóttir, Vera San Juan Norha, Vindrola-Padros Cecilia
Rapid Research, Evaluation and Appraisal Lab (RREAL), Department of Targeted Intervention, University College London, London, UK.
J Eval Clin Pract. 2025 Aug;31(5):e70207. doi: 10.1111/jep.70207.
Timeliness is key to influencing the utility of evaluation and research findings and has given rise to a range of rapid evaluation and appraisal approaches. However, issues in the design, implementation and transparency in their reporting has led to concerns around their rigour and validity. To address this, we have developed the Standards for Rapid Evaluation and Appraisal Methods (STREAM).
We followed a four-stage consensus process, starting with a (1) steering group consultation; (2) three-stage e-Delphi study; (3) stakeholder consensus workshop; and (4) piloting exercise. The stakeholders invited to participate in the consensus process had experience in conducting, being part of, or commissioning rapid evaluations or appraisals.
Thirty-eight standards were developed with the purpose of guiding the design and implementation of rapid evaluations and appraisals and supporting the reporting of methods used.
Rapid evaluations and appraisals can be useful in time and resource limited contexts and in the response to new or changing services, but close attention needs to be paid to their rigour and other factors that might influence the production of knowledge and validity of the findings.
及时性是影响评估和研究结果效用的关键因素,由此催生了一系列快速评估和评价方法。然而,这些方法在设计、实施及报告透明度方面存在的问题引发了人们对其严谨性和有效性的担忧。为解决这一问题,我们制定了快速评估和评价方法标准(STREAM)。
我们遵循了一个四阶段的共识达成过程,首先是(1)指导小组咨询;(2)三阶段电子德尔菲研究;(3)利益相关者共识研讨会;以及(4)试点工作。受邀参与共识达成过程的利益相关者在开展、参与或委托快速评估或评价方面具有经验。
制定了38项标准,旨在指导快速评估和评价的设计与实施,并支持对所用方法的报告。
快速评估和评价在时间和资源有限的情况下以及应对新的或不断变化的服务时可能会很有用,但需要密切关注其严谨性以及可能影响知识产出和研究结果有效性的其他因素。