Centrosomes form when centrioles assemble pericentriolar material (PCM) around themselves. Spd-2/CEP192 proteins, defined by a conserved "Spd-2 domain" (SP2D) comprising two closely spaced AspM-Spd-2-Hydin (ASH) domains, play a critical role in centrosome assembly. Here, we show that the SP2D does not target Spd-2 to centrosomes but rather promotes PCM scaffold assembly. Crystal structures of the human and honeybee SP2D reveal an unusual "extended cradle" structure mediated by a conserved interaction interface between the two ASH domains. Mutations predicted to perturb this interface, including a human mutation associated with male infertility and Mosaic Variegated Aneuploidy, disrupt PCM scaffold assembly in flies. The SP2D is monomeric in solution, but the SP2D can form higher-order oligomers upon phosphorylation by PLK1 (Polo-like kinase 1). Crystal-packing interactions and AlphaFold predictions suggest how SP2Ds might self-assemble, and mutations associated with one such potential dimerization interface markedly perturb SP2D oligomerization in vitro and PCM scaffold assembly in vivo.