Bisphenol A (BPA) is a component of polycarbonate plastics that has been implicated in memory impairment. The present study investigated the effect of carnosic acid (CA) on memory deficit induced by BPA and the role of Akt in this mechanism. First, SH-SY5Y cells were treated with 20 nM BPA and 1 μM CA for 12 h. The results showed that treatment of CA with BPA improved the alternation of IRS-1/Akt/GSK-3β as well as the induction of ApoE and p-tau. Moreover, treatment of CA with BPA restored the signaling involved in long-term potentiation (LTP) effect, leading to induction of synaptic-related proteins, such as PSD-95, synapsin1a, and pro-BDNF. Wortmannin treatment alleviated the reversal by CA. Then, C57BL/6 J male mice were orally administered with CA to test the memory function in BPA treatment. The results showed that CA and RE can improve BPA-induced impairment of motor, recognition, and spatial memory by using open-field test (OFT), novel objective recognition test (NOR), and Y-maze test, respectively. Moreover, CA and RE improved the phosphorylation of tau and the reduction of PSD-95, synapsin1a, and pro-BDNF proteins induced by BPA. Therefore, the results indicated that CA decreased the phosphorylated tau and memory impairment induced by BPA through Akt pathway.