Ca/calmodulin-dependent protein kinase II (CaMKII) is an oligomeric enzyme with crucial roles in neuronal signaling and cardiac function. Previously, we showed that activation of CaMKII triggers the exchange of subunits between holoenzymes, potentially increasing the spread of the active state (Stratton et al., 2014; Bhattacharyya et al., 2016). Using mass spectrometry, we show now that unphosphorylated and phosphorylated peptides derived from the CaMKII-α regulatory segment bind to the CaMKII-α hub and break it into smaller oligomers. Molecular dynamics simulations show that the regulatory segments dock spontaneously at the interface between hub subunits, trapping large fluctuations in hub structure. Single-molecule fluorescence intensity analysis of CaMKII-α expressed in mammalian cells shows that activation of CaMKII-α results in the destabilization of the holoenzyme. Our results suggest that release of the regulatory segment by activation and phosphorylation allows it to destabilize the hub, producing smaller assemblies that might reassemble to form new holoenzymes.