The olive tree is a hallmark crop in the Mediterranean region. Its cultivation is characterized by an enormous variability in existing genotypes and geographical areas. As regards the associated microbial communities of the olive tree, despite progress, we still lack comprehensive knowledge in the description of these key determinants of plant health and productivity. Here, we determined the prokaryotic, fungal and arbuscular mycorrhizal fungal (AMF) microbiome in below- (rhizospheric soil, roots) and above-ground (phyllosphere and carposphere) plant compartments of two olive varieties 'Koroneiki' and 'Chondrolia Chalkidikis' grown in Southern and Northern Greece respectively, in five developmental stages along a full fruit-bearing season. Distinct microbial communities were supported in above- and below-ground plant parts; while the former tended to be similar between the two varieties/locations, the latter were location specific. In both varieties/locations, a seasonally stable root microbiome was observed over time; in contrast the plant microbiome in the other compartments were prone to changes over time, which may be related to seasonal environmental change and/or to plant developmental stage. We noted that olive roots exhibited an AMF-specific filtering effect (not observed for bacteria and general fungi) onto the rhizosphere AMF communities of the two olive varieties/locations/, leading to the assemblage of homogenous intraradical AMF communities. Finally, shared microbiome members between the two olive varieties/locations include bacterial and fungal taxa with putative functional attributes that may contribute to olive tree tolerance to abiotic and biotic stress.