Cognitive impairment is one of the most common problem saffecting older adults. In this study, we investigated whether Tai Chi Chuan and Baduanjin practice can modulate mental control functionand the resting state functional connectivity (rsFC) of the cognitive control network in older adults. Participants in the two exercise groups practiced either Tai Chi Chuan or Baduanjin for 12 weeks, and those in the control group received basic health education. Memory tests and fMRI scans were conducted at baseline and at the end of the study. Seed-based (bilateral dorsolateral prefrontal cortex, DLPFC) rsFC analysis was performed. We found that compared to the controls, 1) both Tai Chi Chuan and Baduanjin groups demonstrated significant improvements in mental control function; 2) the Tai Chi Chuan group showed a significant decrease in rsFC between the DLPFC and the left superior frontal gyrus (SFG) and anterior cingulate cortex; and 3) the Baduanjin group showed a significant decrease in rsFC between the DLPFC and the left putamen and insula. Mental control improvement was negatively associated with rsFC DLPFC-putamen changes across all subjects. These findings demonstrate the potential of Tai Chi Chuan and Baduanjin exercises in preventing cognitive decline.