University of Birmingham, Edgbaston, Birmingham B15 2TT, UK.
Int J Technol Assess Health Care. 2010 Jul;26(3):348-53. doi: 10.1017/S026646231000036X.
The English National Horizon Scanning Centre routinely scans thirty-five sources to identify new and emerging health technologies. The aim of the study was to develop and apply evaluation criteria and scores to assess the value of sources, and to identify a cutoff score below which sources would be recommended for removal from routine horizon scanning. Criteria to evaluate each source scanned could result in a more efficient approach in the selection process.
Evaluation criteria were developed following a review of the literature and discussions with horizon analysts. Proposed criteria were piloted on a random selection of six sources, and then applied to all thirty-five sources. The criteria were assessed using the Analytic Hierarchy Process.
Eight criteria were identified as being most relevant for assessing the value of scanning sources. The three most important (primary) criteria were coverage (approximate percentage of relevant information), quality (reliable, accurate, objective), and efficiency (estimated time to identify one potentially significant health technology or other relevant information). Seven sources fell beneath the cutoff score and were recommended for removal from routine scanning.
The criteria were considered useful in the assessment of current sources, and have the potential to be used to assess new ones. These criteria may be useful for other horizon scanning centers to pilot and validate.
英国国家视野扫描中心定期扫描三十五份资源,以识别新出现的卫生技术。本研究的目的是开发和应用评估标准和分数来评估资源的价值,并确定一个低于该分数的截止分数,建议从常规视野扫描中删除这些资源。评估每个扫描资源的标准可以在选择过程中提高效率。
在文献回顾和与视野分析师讨论的基础上制定了评估标准。在随机选择的六个资源中进行了试点,然后将标准应用于所有三十五份资源。使用层次分析法评估标准。
确定了八项最相关的标准来评估扫描资源的价值。三个最重要的(主要)标准是覆盖面(相关信息的大致百分比)、质量(可靠、准确、客观)和效率(估计识别一个潜在重要卫生技术或其他相关信息所需的时间)。有七个资源低于截止分数,建议从常规扫描中删除。
这些标准被认为在评估现有资源方面是有用的,并且有可能用于评估新资源。这些标准可能对其他视野扫描中心进行试点和验证有用。