Novel influenza A virus (IAV) strains elicit recall immune responses to conserved epitopes, making them favorable antigenic choices for universal influenza virus vaccines. Evaluating these immunogens requires a thorough understanding of the antigenic sites targeted by the polyclonal antibody (pAb) response, which single-particle electron microscopy (EM) can sensitively detect. In this study, we employ EM polyclonal epitope mapping (EMPEM) to extensively characterize the pAb response to hemagglutinin (HA) after H5N1 immunization in humans. Cross-reactive pAbs originating from memory B cells immediately bound the stem of HA and persisted for more than a year after vaccination. In contrast, de novo pAb responses to multiple sites on the head of HA, targeting previously determined key neutralizing sites on H5 HA, expanded after the second immunization and waned quickly. Thus, EMPEM provides a robust tool for comprehensively tracking the specificity and durability of immune responses elicited by novel universal influenza vaccine candidates.