Boyce Ayesha S
University of North Carolina at Greensboro, United States.
Eval Program Plann. 2017 Oct;64:33-43. doi: 10.1016/j.evalprogplan.2017.05.018. Epub 2017 May 13.
Evaluation must attend meaningfully and respectfully to issues of culture, race, diversity, power, and equity. This attention is especially critical within the evaluation of science, technology, engineering, and mathematics (STEM) educational programming, which has an explicit agenda of broadening participation. The purpose of this article is to report lessons learned from the implementation of a values-engaged, educative (Greene et al., 2006) evaluation within a multi-year STEM education program setting. This meta-evaluation employed a case study design using data from evaluator weekly systematic reflections, review of evaluation and program artifacts, stakeholder interviews, and peer review and assessment. The main findings from this study are (a) explicit attention to culture, diversity, and equity was initially challenged by organizational culture and under-developed evaluator-stakeholder professional relationship and (b) evidence of successful engagement of culture, diversity, and equity emerged in formal evaluation criteria and documents, and informal dialogue and discussion with stakeholders. The paper concludes with lessons learned and implications for practice.
评估必须切实且尊重地关注文化、种族、多样性、权力和公平等问题。这种关注在科学、技术、工程和数学(STEM)教育项目评估中尤为关键,因为该评估有着扩大参与度的明确议程。本文旨在报告在一个多年期STEM教育项目背景下实施基于价值观的、具有教育意义的评估(格林等人,2006年)所吸取的经验教训。这项元评估采用了案例研究设计,使用了来自评估人员每周系统反思的数据、评估和项目工件的审查、利益相关者访谈以及同行评审和评估。本研究的主要发现是:(a)对文化、多样性和公平的明确关注最初受到组织文化以及评估人员与利益相关者之间发展不完善的专业关系的挑战;(b)在正式评估标准和文件以及与利益相关者的非正式对话和讨论中出现了成功融入文化、多样性和公平的证据。本文最后总结了经验教训及对实践的启示。