BACKGROUND: Accurate identification and quantification of malaria parasites are critical for measuring clinical trial outcomes. Positive and negative diagnosis is usually sufficient for the assessment of therapeutic outcome, but vaccine or prophylactic drug trials require measuring density of infection as a primary endpoint. Microscopy is the most established and widely-used technique for quantifying parasite densities in the blood. METHODS: Results obtained by 24-27 expert malaria microscopists, who had independently read 895 slides from 35 donors, were analysed to understand how reader technique contributes to discrepancy in measurements of parasite density over a wide range of densities. RESULTS: Among these 35 donations, standard deviations ranged from 30% to 250% of the mean parasite density and the percent discrepancy was inversely correlated with the mean parasite density. The number of white blood cells indexed and whether parasites were counted in the thick film or thin film were shown to significantly contribute to discrepancy amongst microscopists. CONCLUSION: Errors in microscopy measurements are not widely appreciated or addressed but have serious consequences for efficacy trials, including possibly abandoning promising vaccine candidates.