Martens Krystin S R
Centre for Program Evaluation, Univerrsity of Melbourne, Australia; Verstehen Evaluation and Development, LLC, United States.
Eval Program Plann. 2018 Aug;69:25-32. doi: 10.1016/j.evalprogplan.2018.03.006. Epub 2018 Mar 6.
A rubric is a tool that can support evaluators in a core function of their practice-the process of combining evidence with values to determine merit, worth, or significance-however, little guidance specific to evaluation exists. This study examined, through semi-structured interviews, how a rare group of nine rubric-using seasoned evaluators from across the globe use and learned to use rubrics in their program evaluation practice. Key findings revealed rubrics were a critical component to the practice of these evaluators to make determinations, but also as frameworks to sharpen an evaluation's focus. Additionally, findings support the notion that there is a paucity of formal channels for learning about rubrics and indicate these early adopters are instead, honing their skills through informal channels such as trial and error and by tapping into a community of practice. Future directions for training and research should include expanding understanding, application, and acceptance of use.
评分标准是一种工具，可在评估人员的核心业务中为其提供支持，即把证据与价值观相结合以确定优点、价值或重要性的过程。然而，针对评估的具体指导却很少。本研究通过半结构化访谈，考察了来自全球的九位经验丰富的评分标准使用者这一罕见群体，他们如何在项目评估实践中使用并学会使用评分标准。主要研究结果表明，评分标准是这些评估人员进行评估判定的关键组成部分，也是强化评估重点的框架。此外，研究结果支持了这样一种观点，即缺乏学习评分标准的正式渠道，并表明这些早期采用者反而通过试错等非正式渠道以及借助实践社区来磨练他们的技能。培训和研究的未来方向应包括扩大对评分标准使用的理解、应用和接受程度。
