In recent years, breakthroughs have been made in tumor immunotherapy. However, tumor immunotherapy, particularly anti-PD-1/PD-L1 immune checkpoint inhibitors, is effective in only a small percentage of patients in solid cancer. How to improve the efficiency of cancer immunotherapy is an urgent problem to be solved. As we all know, the state of the tumor microenvironment (TME) is an essential factor affecting the effectiveness of tumor immunotherapy, and the cancer-associated fibroblasts (CAFs) in TME have attracted much attention in recent years. As one of the main components of TME, CAFs interact with cancer cells and immune cells by secreting cytokines and vesicles, participating in ECM remodeling, and finally affecting the immune response process. With the in-depth study of CAFs heterogeneity, new strategies are provided for finding targets of combination immunotherapy and predicting immune efficacy. In this review, we focus on the role of CAFs in the solid cancer immune microenvironment, and then further elaborate on the potential mechanisms and pathways of CAFs influencing anti-PD-1/PD-L1 immunotherapy. In addition, we summarize the potential clinical application value of CAFs-related targets and markers in solid cancers.