School of Health and Related Research (ScHARR) Technology Assessment Group, University of Sheffield, Sheffield, UK.
Health Technol Assess. 2011 May;15(22):1-82, iii-iv. doi: 10.3310/hta15220.
BACKGROUND: The National Institute for Health and Clinical Excellence (NICE) single technology appraisal (STA) process was set up as a rapid way to appraise new technologies for use within the NHS in England and Wales and has been in place since 2005. OBJECTIVES: This study had five primary objectives: (1) to provide a map of the STA process to date; (2) to identify current approaches to the critical appraisal of manufacturers' submissions (MSs) by Evidence Review Groups (ERGs); (3) to identify recurring themes in clarification letters sent to manufacturers; (4) to provide recommendations for possible alternative approaches to be used in the critical appraisal process; and (5) to revise the current ERG report template. DATA SOURCES: Data for the mapping of the STA process were obtained from the NICE website (www.nice.org.uk). Data for the analyses of the ERG reports and clarification letters were taken from the reports and letters themselves. REVIEW METHODS: For the mapping, a spreadsheet was developed to collect data on 22 predefined variables related to timings and outcomes. Simple descriptive statistics were used to analyse the data. For the thematic analysis, a documentary analysis of 30 ERG reports was undertaken. Data on key elements of the MSs, the processes undertaken by ERGs and the strengths and weaknesses of MSs were extracted. A framework of a priori themes was developed. Data were extracted, coded and analysed according to a framework approach. Twenty-one clarification letters were examined and data were extracted using a set of codes to cover report quality, systematic review methods and clinical/economic issues. The current ERG report template was modified and sent to the current ERG teams for comment. All comments were considered and formed the basis for further revisions to the template. RESULTS: Ninety-five STAs were included in the mapping exercise. Many STAs were subject to delay or cancellation for a variety of reasons. The ERG reports highlighted the strengths and weaknesses of MSs to the STA process. Thematic analysis of these data offered a means of clarifying and describing these aspects of the submissions. This analysis generated five themes: process, reporting, satisfaction of objectives, reliability and validity of findings, and content. Points from clarification letters were analysed and presented in four main categories: report quality, systematic review methods, clinical data analysis and economic data analysis. LIMITATIONS: Nearly all data were obtained from the NICE website; therefore, any errors in the data on the website will be reflected in the mapping analysis presented in this report. Missing data for the mapping exercise limit the generalisability of the findings. Analyses were limited to what was reported in the ERG reports and the clarification letters. CONCLUSIONS: Guidance suggested for manufacturers will help to ensure that more appropriate submissions are received in the future while recommendations provided for ERG teams will help to guide teams to ensure that reporting methods are transparent. FUNDING: The National Institute for Health Research Health Technology Assessment programme.
背景:国家卫生与临床优化研究所(NICE)的单一技术评估(STA)程序是作为一种快速评估新英格兰和威尔士国民保健制度(NHS)中使用的新技术的方法而设立的,自 2005 年以来一直在使用。
目的:本研究有五个主要目标:(1)提供 STA 流程的概述;(2)确定当前证据审查小组(ERG)对制造商提交材料(MS)进行关键评估的方法;(3)确定向制造商发送澄清函中反复出现的主题;(4)提供对可能用于关键评估过程的替代方法的建议;(5)修改当前 ERG 报告模板。
数据来源:STA 流程的映射数据来自 NICE 网站(www.nice.org.uk)。ERG 报告和澄清函的分析数据取自报告和函件本身。
审查方法:为了进行概述,开发了一个电子表格来收集 22 个与时间安排和结果相关的预定义变量的数据。使用简单的描述性统计来分析数据。对于主题分析,对 30 份 ERG 报告进行了文献分析。提取了 MS 中的关键要素、ERG 所进行的流程以及 MS 的优缺点。制定了一个预先设定主题的框架。根据框架方法提取、编码和分析数据。对 21 封澄清函进行了审查,并使用一组代码提取报告质量、系统评价方法和临床/经济问题的数据。修改了当前的 ERG 报告模板,并将其发送给当前的 ERG 团队征求意见。考虑了所有意见,并以此为基础进一步修改了模板。
结果:95 项 STA 纳入了概述工作。由于各种原因,许多 STA 都被推迟或取消。ERG 报告向 STA 流程强调了 MS 的优缺点。对这些数据的主题分析提供了一种澄清和描述提交内容的方法。这一分析产生了五个主题:流程、报告、目标满意度、发现的可靠性和有效性以及内容。澄清函中的要点根据四个主要类别进行了分析和呈现:报告质量、系统评价方法、临床数据分析和经济数据分析。
局限性:几乎所有数据均来自 NICE 网站;因此,网站上数据的任何错误都将反映在本报告中呈现的概述分析中。概述工作中缺失的数据限制了研究结果的普遍性。分析仅限于 ERG 报告和澄清函中报告的内容。
结论:为制造商提供的指导建议将有助于确保未来收到更合适的提交材料,同时为 ERG 团队提供的建议将有助于指导团队确保报告方法透明。
资助:英国国家卫生研究院卫生技术评估计划。
Eur J Health Econ. 2008-11
Dtsch Med Wochenschr. 2008-12
Int J Technol Assess Health Care. 2013-6-17
Health Technol Assess. 2009-6
Health Technol Assess. 2009-6