In young adults, recollection-sensitive brain regions exhibit enhanced connectivity with a widely distributed set of other regions during successful versus unsuccessful recollection, and the magnitude of connectivity change correlates with individual differences in recollection accuracy. Here, we examined whether recollection-related changes in connectivity and their relationship with performance varied across samples of young, middle-aged, and older adults. Psychophysiological interaction analyses identified recollection-related increases in connectivity both with recollection-sensitive seed regions and among regions distributed throughout the whole brain. The seed-based approach failed to identify age-related differences in recollection-related connectivity change. However, the whole-brain analysis revealed a number of age-related effects. Numerous pairs of regions exhibited a main effect of age on connectivity change, mostly due to decreased change with increasing age. After controlling for recollection accuracy, however, these effects of age were for the most part no longer significant, and those effects that were detected now reflected age-related increases in connectivity change. A subset of pairs of regions also exhibited an age by performance interaction, driven mostly by a weaker relationship between connectivity change and recollection accuracy with increasing age. We conjecture that these effects reflect age-related differences in neuromodulation.