Evidence for phenotypic plasticity in brain size and the size of different brain parts is widespread, but experimental investigations into this effect remain scarce and are usually conducted using individuals from a single population. As the costs and benefits of plasticity may differ among populations, the extent of brain plasticity may also differ from one population to another. In a common garden experiment conducted with three-spined sticklebacks () originating from four different populations, we investigated whether environmental enrichment (aquaria provided with structural complexity) caused an increase in the brain size or size of different brain parts compared to controls (bare aquaria). We found no evidence for a positive effect of environmental enrichment on brain size or size of different brain parts in either of the sexes in any of the populations. However, in all populations, males had larger brains than females, and the degree of sexual size dimorphism (SSD) in relative brain size ranged from 5.1 to 11.6% across the populations. Evidence was also found for genetically based differences in relative brain size among populations, as well as for plasticity in the size of different brain parts, as evidenced by consistent size differences among replicate blocks that differed in their temperature.