The rapid emergence of SARS-CoV-2 variants challenges vaccination strategies. Here, we collected 201 serum samples from persons with a single infection or multiple vaccine exposures, or both. We measured their neutralization titers against 15 natural variants and 7 variants with engineered spike mutations and analyzed antigenic diversity. Antigenic maps of primary infection sera showed that Omicron sublineages BA.2, BA.4/BA.5, and BA.2.12.1 are distinct from BA.1 and more similar to Beta/Gamma/Mu variants. Three mRNA COVID-19 vaccinations increased neutralization of BA.1 more than BA.4/BA.5 or BA.2.12.1. BA.1 post-vaccination infection elicited higher neutralization titers to all variants than three vaccinations alone, although with less neutralization to BA.2.12.1 and BA.4/BA.5. Those with BA.1 infection after two or three vaccinations had similar neutralization titer magnitude and antigenic recognition. Accounting for antigenic differences among variants when interpreting neutralization titers can aid the understanding of complex patterns in humoral immunity that informs the selection of future COVID-19 vaccine strains.