The genotype-phenotype (GP) map consists of developmental and physiological mechanisms mapping genetic onto phenotypic variation. It determines the distribution of heritable phenotypic variance on which selection can act. Comparative studies of morphology as well as of gene regulatory networks show that the GP map itself evolves, yet little is known about the actual evolutionary mechanisms involved. The study of such mechanisms requires exploring the variation in GP maps at the population level, which presently is easier to quantify by statistical genetic methods rather than by regulatory network structures. We focus on the evolution of pleiotropy, a major structural aspect of the GP map. Pleiotropic genes affect multiple traits and underlie genetic covariance between traits, often causing evolutionary constraints. Previous quantitative genetic studies have demonstrated population-level variation in pleiotropy in the form of loci, at which genotypes differ in the genetic covariation between traits. This variation can potentially fuel evolution of the GP map under selection and/or drift. Here, we propose a developmental mechanism underlying population genetic variation in covariance and test its predictions. Specifically, the mechanism predicts that the loci identified as responsible for genetic variation in pleiotropy are involved in trait-specific epistatic interactions. We test this prediction for loci affecting allometric relationships between traits in an advanced intercross between inbred mouse strains. The results consistently support the prediction. We further find a high degree of sign epistasis in these interactions, which we interpret as an indication of adaptive gene complexes within the diverged parental lines.