Cousins J Bradley, Goh Swee C, Elliott Catherine, Aubry Tim, Gilbert Nathalie
Faculty of Education, Centre for Research on Educational and Community Services (CRECS), University of Ottawa, Canada.
Telfer School of Management, University of Ottawa, Canada.
Eval Program Plann. 2014 Jun;44:1-13. doi: 10.1016/j.evalprogplan.2013.12.001. Epub 2013 Dec 17.
Research on evaluation capacity is limited although a recent survey article on integrating evaluation into the organizational culture (Cousins, Goh, Clark, & Lee, 2004) revealed that interest in the topic is increasing. While knowledge about building the capacity to do evaluation has developed considerably, less is understood about building the organizational capacity to use evaluation. This article reports on the results of a pan-Canadian survey of evaluators working in organizations (internal evaluators or organization members with evaluation responsibility) conducted in 2007. Reliability across all constructs was high. Responses from government evaluators (N=160) were compared to responses from evaluators who work in the voluntary sector (N=89). The former were found to self-identify more highly as 'evaluators' (specialists) whereas the latter tended to identify as 'managers' (non-specialists). As a result, government evaluators had significantly higher self-reported levels of evaluation knowledge (both theory and practice); and they spent more time performing evaluation functions. However, irrespective of role, voluntary sector respondents rated their organizations more favorably than did their government sector counterparts with respect to the antecedents or conditions supporting evaluation capacity, and the capacity to use evaluation. Results are discussed in terms of their implications for evaluation practice and ongoing research.
尽管最近一篇关于将评估融入组织文化的综述文章(考辛斯、吴、克拉克和李,2004年)表明对该主题的兴趣在增加,但关于评估能力的研究仍然有限。虽然关于培养评估能力的知识已经有了很大发展,但对于培养组织使用评估的能力却了解得较少。本文报告了2007年对在组织中工作的评估人员(内部评估人员或承担评估职责的组织成员)进行的全加拿大范围调查的结果。所有结构的信度都很高。将政府评估人员(N = 160)的回答与在志愿部门工作的评估人员(N = 89)的回答进行了比较。结果发现,前者更倾向于将自己视为“评估人员”(专家),而后者则倾向于将自己视为“管理者”(非专家)。因此,政府评估人员自我报告的评估知识(理论和实践)水平明显更高;并且他们花费更多时间履行评估职能。然而,无论角色如何,在支持评估能力的前提条件或环境以及使用评估的能力方面,志愿部门的受访者对其组织的评价都比政府部门的受访者更积极。文章从这些结果对评估实践和后续研究的影响方面进行了讨论。