Kuruvilla Shyama, Mays Nicholas, Pleasant Andrew, Walt Gill
Health Services Research Unit, Department of Public Health and Policy, London School of Hygiene and Tropical Medicine, London, UK.
BMC Health Serv Res. 2006 Oct 18;6:134. doi: 10.1186/1472-6963-6-134.
Researchers are increasingly required to describe the impact of their work, e.g. in grant proposals, project reports, press releases and research assessment exercises. Specialised impact assessment studies can be difficult to replicate and may require resources and skills not available to individual researchers. Researchers are often hard-pressed to identify and describe research impacts and ad hoc accounts do not facilitate comparison across time or projects.
The Research Impact Framework was developed by identifying potential areas of health research impact from the research impact assessment literature and based on research assessment criteria, for example, as set out by the UK Research Assessment Exercise panels. A prototype of the framework was used to guide an analysis of the impact of selected research projects at the London School of Hygiene and Tropical Medicine. Additional areas of impact were identified in the process and researchers also provided feedback on which descriptive categories they thought were useful and valid vis-à-vis the nature and impact of their work.
We identified four broad areas of impact: I. Research-related impacts; II. Policy impacts; III. Service impacts: health and intersectoral and IV. Societal impacts. Within each of these areas, further descriptive categories were identified. For example, the nature of research impact on policy can be described using the following categorisation, put forward by Weiss: Instrumental use where research findings drive policy-making; Mobilisation of support where research provides support for policy proposals; Conceptual use where research influences the concepts and language of policy deliberations and Redefining/wider influence where research leads to rethinking and changing established practices and beliefs.
Researchers, while initially sceptical, found that the Research Impact Framework provided prompts and descriptive categories that helped them systematically identify a range of specific and verifiable impacts related to their work (compared to ad hoc approaches they had previously used). The framework could also help researchers think through implementation strategies and identify unintended or harmful effects. The standardised structure of the framework facilitates comparison of research impacts across projects and time, which is useful from analytical, management and assessment perspectives.
研究人员越来越需要描述其工作的影响,例如在资助申请、项目报告、新闻稿和研究评估活动中。专门的影响评估研究可能难以复制,并且可能需要个别研究人员所没有的资源和技能。研究人员往往难以确定和描述研究影响,临时的描述不利于跨时间或项目进行比较。
通过从研究影响评估文献中确定健康研究影响的潜在领域,并基于研究评估标准(例如英国研究评估活动小组制定的标准),开发了研究影响框架。该框架的一个原型被用于指导对伦敦卫生与热带医学院选定研究项目的影响分析。在此过程中确定了其他影响领域,研究人员还就他们认为哪些描述类别对于其工作的性质和影响是有用和有效的提供了反馈。
我们确定了四个广泛的影响领域:一、与研究相关的影响;二、政策影响;三、服务影响:健康及跨部门影响;四、社会影响。在每个领域内,又确定了进一步的描述类别。例如,对政策的研究影响的性质可以用韦斯提出的以下分类来描述:工具性用途,即研究结果推动政策制定;支持的动员,即研究为政策提案提供支持;概念性用途,即研究影响政策审议的概念和语言;重新定义/更广泛的影响,即研究导致对既定做法和信念的重新思考和改变。
研究人员虽然最初持怀疑态度,但发现研究影响框架提供了提示和描述类别,可以帮助他们系统地确定与其工作相关的一系列具体且可核实的影响(与他们之前使用的临时方法相比)。该框架还可以帮助研究人员思考实施策略,并识别意外或有害影响。框架的标准化结构便于跨项目和时间比较研究影响,这从分析、管理和评估的角度来看是有用的。