Tumor-associated macrophages (TAMs) play a key role in all stages of tumorigenesis and tumor progression. TAMs secrete different kinds of cytokines, chemokines, and enzymes to affect the progression, metastasis, and resistance to therapy depending on their state of reprogramming. Therapeutic benefit in targeting TAMs suggests that macrophages are attractive targets for cancer treatment. Chinese materia medica (CMM) is an important approach for treating cancer in China and in the Asian region. According to the theory of Chinese medicine (CM) and its practice, some prescriptions of CM regulate the body's internal environment possibly including the remodeling the tumor microenvironment (TME). Here we briefly summarize the pivotal effects of TAMs in shaping the TME and promoting tumorigenesis, invasion, metastasis and immunosuppression. Furthermore, we illustrate the effects and mechanisms of CMM targeting TAMs in antitumor therapy. Finally, we reveal the CMM's dual-regulatory and multi-targeting functions on regulating TAMs, and hopefully, provide the theoretical basis for CMM clinical practice related to cancer therapy.