Dairy intake screener as web-based application is reliable and valid.

The "Dairy Diary" is a user-friendly web-based dairy intake screener. The reliability and validity are unknown. We aimed to evaluate the screener in terms of test-retest reliability and comparative validity. In a diagnostic accuracy study, a purposefully recruited sample of 79 (age: 21.6 ± 3.8 years) undergraduate dietetics/nutrition students from three South African universities completed 3 non-consecutive days of weighed food records (reference standard) within a seven-day period (comparative validity), followed by two administrations, 2 weeks apart, of the screener (index test) (reliability). For the four dairy product serving scores (PSSs) and the summative dairy serving scores (DSSs) of the screener and the food records, t-tests, correlations, Bland-Altman, Kappa, McNemar's, and diagnostic accuracy were determined. For reliability, mean PSSs and DSSs did not differ significantly ( > .05) between the screener administrations. The mean PSSs were strongly correlated: milk ( = .69;  < .001), maas (fermented milk) ( = .72;  < .001), yoghurt ( = .71;  < .001), cheese ( = .74;  < .001). For DSSs, Kappa was moderate ( = 0.45;  < .001). Non-agreeing responses suggest symmetry ( = .334). For validity, the PSSs of the screener and food records were moderately correlated [milk ( = .30;  = .0129), yoghurt ( = .38;  < .001), cheese ( = .38;  < .001)], with  = 0.31 ( = .006) for DSS. Bland-Altman analyses showed acceptable agreement for DSSs (bias: -0.49; 95% CI: -0.7 to -0.3). Categorized DSSs had high sensitivity (81.4%) and positive predictive value (93.4%), yet low specificity (55.6%) and negative predictive value (27.8%). The area under the receiver operating characteristic curve (0.7) was acceptable. The "Dairy Diary" is test-retest reliable with moderate comparative validity to screen for dairy intake of nutrition-literate consumers.