The identification of reliable biomarkers in biological fluids is paramount to optimizing the diagnosis of Alzheimer’s disease (AD). Measurement of Aβ42, t-tau, and p-tau in cerebrospinal fluid (CSF) is the most accepted method to support the diagnosis of AD. However, lumbar puncture represents an invasive investigation, whereas saliva is one of the most accessible body fluids. The aim of our study was to investigate salivary concentrations in AD and evaluate the correlation between salivary and CSF Aβ42 concentrations in AD patients, patients with non-AD dementias, and controls. We recruited 100 subjects: 18 AD patients, 64 patients with non-AD dementias, and 18 controls. The mean saliva Aβ42 concentrations in AD patients were higher than in controls (p < 0.001), and to patients with non-AD dementias (p = 0.001). A significant negative correlation between salivary and CSF Aβ42 concentrations was found in the overall group (r = −0.562, p < 0.001) and in non-AD patients (r = −0.443, p < 0.001). Salivary Aβ42 concentrations positively correlated with CSF t-tau (r = 0.321, p = 0.001) and p-tau (r = 0.297, p = 0.001). Our study showed that in AD patients’ saliva, Aβ42 concentrations are specifically increased, and we found an interesting negative correlation between CSF and salivary Aβ42 concentrations that warrants further investigation.