Contandriopoulos A P, Champagne F, Denis J L, Avargues M C
Département d'Administration de la santé et G.R.I.S., Faculté de médecine, Université de Montréal, C.P. 6128, Succursale Centre-ville, Montréal, Québec H3C 3J7, Canada.
Rev Epidemiol Sante Publique. 2000 Dec;48(6):517-39.
The practice of evaluation has existed in one form or another for as long as one can remember and is central to all processes of learning. Today, evaluation is a popular concept grouping together multiple and diverse realities. This article aims to propose a conceptual framework for evaluation that is broad and universal enough to allow all those concerned with evaluation of health services (regardless of their disciplines and interests) to better understand each other, to perform better evaluations, and to use them in a more pertinent manner. We will begin by defining evaluation as the process which consists of making a judgement on the value of an intervention by implementing a system which can provide scientifically valid and socially legitimate information on regarding this particular intervention (or any of its components) to the different stakeholders concerned, such that they can form an opinion from their perspective on the intervention and reach a judgement which can translate into action. We define "intervention" as any organized system of action (a structure, actors and their practices, processes of action, one or many finalities and an environment) aiming to, in a given environment, during a given time period, modify the foreseeable course of a phenomenon to correct a problematic situation. An intervention can be a technique, a medication, a treatment, an organisation, a program, a policy or even a complex system like the health care system. Various interventions, regardless of their nature, can be the object of two types of evaluation. Normative evaluation is based on appreciation of each component of the intervention according to criteria and standards. This type of evaluation is defined as an activity which consists of making a judgement regarding an intervention by comparing the resources utilized and their organisation (structure); services and goods produced (process) and results obtained to criteria and standards (in other words, summaries of what is good and right). Did the intervention correspond to what should have been done according to the standards utilized? Evaluative research aims to employ valid scientific methods to analyze relationships between different components of an intervention. More specifically, evaluation research can be classified into six types of analysis, which employ different research strategies. Strategic analysis allows appreciation of the pertinence of an intervention; logical analysis, the soundness of the theoretical and operational bases of the intervention; productivity analysis, the technical efficiency with which resources are mobilized to produce goods or services; analysis of effects, effectiveness of goods and services in producing results; efficiency analysis, relations between the costs of the resources (or the services) used and the results; implementation analysis, appreciation of interactions between the process of the intervention and the context of implementation in the production of effects. The official finalities of all evaluation processes are of four types: (1)strategic, to aid the planning and development of an intervention, (2) formative, to supply information to improve an intervention in progress, (3) summative, to determine the effects of an intervention (to decide if it should be maintained, transformed or suspended), (4) fundamental, to contribute to the advancement of empirical and theoretical knowledge regarding the intervention. In addition, experience acquired in the field of evaluation suggests that evaluation is also productive in that it allows actors, in an organized setting, to reconsider the links between the objectives given, practices developed and their context of action. This task of achieving coherence is continuous and is one of the intrinsic conditions of action in an organized setting. In this perspective, evaluation can have a key role, given that it is not employed to legitimize new forms of control but rather to favor debate and th
只要人们能够记得,评估实践就一直以某种形式存在着,并且是所有学习过程的核心。如今,评估是一个流行的概念,它将多种不同的实际情况归为一类。本文旨在提出一个评估的概念框架,该框架足够宽泛和通用,以使所有关注卫生服务评估的人(无论其学科和兴趣如何)能够更好地相互理解,进行更好的评估,并更恰当地运用评估结果。我们首先将评估定义为这样一个过程:通过实施一个系统,对一项干预措施的价值进行判断,该系统能够为不同的相关利益者提供关于这一特定干预措施(或其任何组成部分)的科学有效且社会认可的信息,以便他们能够从自己的角度对干预措施形成看法,并做出能够转化为行动的判断。我们将“干预措施”定义为任何有组织的行动系统(一种结构、参与者及其实践、行动过程、一个或多个目标以及一个环境),其目的是在给定的环境中,在给定的时间段内,改变一种现象的可预见进程,以纠正一个问题状况。一项干预措施可以是一种技术、一种药物、一种治疗方法、一个组织、一个项目、一项政策,甚至是像医疗保健系统这样的复杂系统。各种干预措施,无论其性质如何,都可以成为两种类型评估的对象。规范性评估是根据标准对干预措施的每个组成部分进行评估。这种类型的评估被定义为一种活动,即通过将所使用的资源及其组织(结构)、所生产的服务和产品(过程)以及所获得的结果与标准进行比较,对一项干预措施做出判断(换句话说,就是对什么是好的和正确的进行总结)。该干预措施是否符合根据所使用的标准应该做的事情?评估研究旨在运用有效的科学方法来分析一项干预措施不同组成部分之间的关系。更具体地说,评估研究可以分为六种分析类型,它们采用不同的研究策略。战略分析能够评估一项干预措施的相关性;逻辑分析,评估干预措施理论和操作基础的合理性;生产力分析,评估调动资源生产产品或服务的技术效率;效果分析,评估产品和服务在产生结果方面的有效性;效率分析,评估所使用资源(或服务)的成本与结果之间的关系;实施分析,评估干预措施过程与实施背景在产生效果方面的相互作用。所有评估过程的官方目标有四种类型:(1)战略性目标,以协助干预措施的规划和发展;(2)形成性目标,提供信息以改进正在进行的干预措施;(3)总结性目标,确定一项干预措施的效果(决定它是否应该维持、改变或中止);(4)基础性目标,为增进关于该干预措施的实证和理论知识做出贡献。此外,在评估领域获得的经验表明,评估也是有成效的,因为它使参与者能够在有组织的环境中重新考虑给定目标、所开展的实践及其行动背景之间的联系。实现一致性的这项任务是持续不断的,并且是在有组织的环境中行动的内在条件之一。从这个角度来看,评估可以发挥关键作用,因为它不是被用来使新的控制形式合法化,而是有利于进行辩论以及……