Africa Health Research Institute, KwaZulu-Natal, South Africa.
HIV Pathogenesis Programme, The Doris Duke Medical Research Institute, University of KwaZulu-Natal, Durban, South Africa.
Health Res Policy Syst. 2023 Oct 25;21(1):109. doi: 10.1186/s12961-023-01056-9.
Recent efforts to shift the control and leadership of health research on African issues to Africa have led to increased investments for scientific research capacity strengthening (RCS) on the continent and a greater demand for accountability, value for money and demonstration of return on investment. There is limited literature on monitoring and evaluation (M&E) of RCS systems and there is a clear need to further explore whether the M&E frameworks and approaches that are currently used are fit for purpose. The M&E approaches taken by four African RCS consortia funded under the Developing Excellence in Leadership, Training and Science in Africa (DELTAS) I initiative were assessed using several methods, including a framework comparison of the M&E approaches, semi-structured interviews and facilitated discussion sessions. The findings revealed a wide range in the number of indicators used in the M&E plans of individual consortium, which were uniformly quantitative and at the output and outcome levels. Consortia revealed that additional information could have been captured to better evaluate the success of activities and measure the ripple effects of their efforts. While it is beneficial for RCS consortia to develop and implement their own M&E plans, this could be strengthened by routine engagement with funders/programme managers to further align efforts. It is also important for M&E plans to consider qualitative data capture for assessment of RCS efforts. Efforts could be further enhanced by supporting platforms for cross-consortia sharing, particularly when trying to assess more complex effects. Consortia should make sure that processes for developmental evaluation, and capturing and using the associated learning, are in place. Sharing the learning associated with M&E of RCS efforts is vital to improve future efforts. Investing and improving this aspect of RCS will help ensure tracking of progress and impact of future efforts, and ensure accountability and the return on investment. The findings are also likely applicable well beyond health research.
最近,为了将非洲问题的医学学术研究的控制权和领导权转移到非洲,非洲大陆的科研能力建设(RCS)得到了更多的投资,同时也对问责制、资金使用效率和投资回报提出了更高的要求。目前,关于 RCS 系统监测和评价(M&E)的文献有限,显然需要进一步探讨当前使用的 M&E 框架和方法是否符合目的。通过多种方法评估了在非洲卓越领导、培训和科学发展(DELTAS)I 倡议下资助的四个非洲 RCS 联盟所采取的 M&E 方法,包括对 M&E 方法的框架比较、半结构化访谈和促进讨论会议。调查结果显示,各联盟 M&E 计划中使用的指标数量差异很大,这些指标都是统一的定量指标,且处于产出和结果层面。联盟表示,本来可以收集更多的信息来更好地评估活动的成功程度,并衡量其努力的连锁反应。虽然 RCS 联盟制定和实施自己的 M&E 计划是有益的,但通过与资助者/项目管理者定期接触,进一步协调工作,可以加强这一点。考虑到 RCS 工作的定性数据采集来进行评估,这对 M&E 计划也很重要。通过支持跨联盟的共享平台,可以进一步增强工作,特别是在评估更复杂的效果时。联盟应确保制定发展评估的流程,并收集和利用相关学习。分享 RCS 工作的 M&E 相关学习对于改进未来的工作至关重要。投资和改进 RCS 的这一方面将有助于确保跟踪未来工作的进展和影响,并确保问责制和投资回报。这些发现可能也广泛适用于健康研究以外的领域。