Center for Vectors and Vector-Borne Diseases and Department of Biology, Mahidol University, Bangkok, Thailand.
Malar J. 2012 Sep 17;11:329. doi: 10.1186/1475-2875-11-329.
Appropriate supervision, along with availability of an effective system for monitoring and evaluation, is a crucial requirement to guarantee sufficient coverage and quality of malaria vector control procedures. This study evaluated the efficacy of self-assessment practice as a possible innovative method towards achieving high coverage and excellent quality of larviciding operation in Iran.
The research was conducted on the randomly selected rural health centre of Kanmbel Soliman with 10 staff and 30 villages, in three main steps: (i) assessment of effectiveness of larviciding operations in the study areas before intervention through external assessment by a research team; (ii) self-assessment of larviciding operations (intervention) by staff every quarter for three rounds; and, (iii) determining the effectiveness of applying self-assessment of larviciding operations in the study areas. Two toolkits were used for self-assessment and external evaluation. The impact of self-assessment of larviciding operations was measured by two indicators: percentage of missed breeding habitats and cleaned breeding habitats among randomly selected breeding sites. Moreover, the correlation coefficients were measured between self-assessment measures and scores from external evaluation. The correlation coefficient and Mann Whitney test were used to analyse data.
Following the utilization of self-assessment, the percentage of missed breeding habitats decreased significantly from 14.23% to 1.91% (P <0.001). Additionally, the percentage of cleaned breeding habitats among randomly selected breeding sites increased from 66.89% to 95.28% (P <0.001). The external evaluation also showed significant effects of self-assessment in performance of vector control; the maximum effect of intervention were seen in an action plan for monitoring and evaluation of larviciding operations at field level, geographical reconnaissance for the registration of breeding habitats and worker skills related to larviciding.Before intervention, the results of self-assessment practice were compatible with external evaluation in 76.3% of 139 reviewed reports of self-assessment. After intervention, the findings of self-assessment and external evaluation were similar in the vast majority of reviewed reports (95%).
The self-assessment tool seems to be valid and reliable in improving effectiveness of larviciding operations. Furthermore, the result of self-assessment is more compatible with external evaluation results if it would be applied frequently. Therefore, it can be used as an alternative assessment technique in the evaluation of larviciding operations in addition to traditional assessment methods.
适当的监督以及建立有效的监测和评估体系是保障疟疾媒介控制措施充分覆盖和质量的关键要求。本研究评估了自我评估实践作为一种创新方法的效果，以实现伊朗地区杀幼虫作业的高覆盖率和高质量。
该研究在伊朗坎贝尔·索利曼的随机选择的农村卫生中心进行，该中心有 10 名工作人员和 30 个村庄，分三个主要步骤进行：（i）在干预前通过研究小组进行外部评估，评估研究区域内杀幼虫作业的效果；（ii）工作人员每季度进行三次自我评估（干预）；以及，（iii）确定在研究区域应用杀幼虫作业自我评估的效果。自我评估和外部评估使用了两个工具包。通过两个指标来衡量杀幼虫作业自我评估的效果：随机选择的滋生地中错过的滋生地和清理的滋生地的比例。此外，还测量了自我评估措施与外部评估得分之间的相关系数。使用相关系数和曼-惠特尼检验来分析数据。
在进行自我评估后，错过的滋生地比例从 14.23%显著下降至 1.91%（P<0.001）。此外，随机选择的滋生地中清理的滋生地比例从 66.89%显著上升至 95.28%（P<0.001）。外部评估还显示了自我评估在病媒控制绩效方面的显著效果；干预的最大效果体现在现场层面的杀幼虫作业监测和评估行动计划、滋生地登记的地理勘察以及与杀幼虫相关的工人技能方面。在干预前，在 139 份自我评估报告中，有 76.3%的报告与外部评估结果一致。干预后，在大多数情况下，自我评估和外部评估的结果相似（95%）。
自我评估工具似乎在提高杀幼虫作业的效果方面是有效和可靠的。此外，如果频繁应用，自我评估的结果与外部评估结果更加一致。因此，它可以作为除传统评估方法之外，对杀幼虫作业进行评估的替代评估技术。
