The structural diversity of the human genome is much higher than previously assumed although its full extent remains unknown. To investigate the association between segmental duplications that display constitutive copy number differences (CNDs) between humans and the great apes and those which exhibit polymorphic copy number variations (CNVs) between humans, we analysed a BAC array enriched with segmental duplications displaying such CNDs. This study documents for the first time that in addition to human-specific gains common to all humans, these duplication clusters (DCs) also exhibit polymorphic CNVs > 40 kb. Segmental duplication is known to have been a frequent event during human genome evolution. Importantly, among the CNV-associated genes identified here, those involved in transcriptional regulation were found to be significantly overrepresented. Complex patterns of variation were evident at sites of DCs, manifesting as inter-individual differentially sized copy number alterations at the same genomic loci. Thus, CNVs associated with segmental duplications do not simply represent insertion/deletion polymorphisms, but rather constitute a wide variety of rearrangements involving differential amplification and partial gains and losses with high inter-individual variability. Although the number of CNVs was not found to differ between Africans and Caucasians/Asians, the average number of variant patterns per locus was significantly lower in Africans. Thus, complex variation patterns characterizing segmental duplications result from relatively recent genomic rearrangements. The high number of these rearrangements, some of which are potentially recurrent, together with differences in population size and expansion dynamics, may account for the greater diversity of CNV in Caucasians/Asians as compared with Africans.