The heavy metal pollution is a worldwide problem and has received a serious concern for the ecosystem and human health. In the last decade, remediation of the agricultural polluted soil has attracted great attention. Phytoremediation is one of the technologies that effectively alleviate heavy metal toxicity, however, this technique is limited to many factors contributing to low plant growth rate and nature of metal toxicities. Arbuscular mycorrhizal fungi (AMF) assisted alleviation of heavy metal phytotoxicity is a cost-effective and environment-friendly strategy. AMF have a symbiotic relationship with the host plant. The bidirectional exchange of resources is a hallmark and also a functional necessity in mycorrhizal symbiosis. During the last few years, a significant progress in both physiological and molecular mechanisms regarding roles of AMF in the alleviation of heavy metals (HMs) toxicities in plants, acquisition of nutrients, and improving plant performance under toxic conditions of HMs has been well studied. This review summarized the current knowledge regarding AMF assisted remediation of heavy metals and some of the strategies used by mycorrhizal fungi to cope with stressful environments. Moreover, this review provides the information of both molecular and physiological responses of mycorrhizal plants as well as AMF to heavy metal stress which could be helpful for exploring new insight into the mechanisms of HMs remediation by utilizing AMF.