Chronic inflammatory bowel disease (IBD) is strongly associated with the development of colitis-associated tumorigenesis (CAT). Despite recent advances in the understanding of polymorphonuclear myeloid-derived suppressor cell (PMN-MDSC) responses in cancer, the mechanisms of these cells during this process remain largely uncharacterized. Here, we discovered a glycoprotein, olfactomedin-4 (OLFM4), was highly expressed in PMN-MDSCs from colitis to colorectal cancer (CRC), and its expression level and PMN-MDSC population positively correlated with the progression of IBD to CRC. Moreover, mice lacking OLFM4 in myeloid cells showed poor recruitment of PMN-MDSCs, impaired intestinal homeostasis, and delayed development from IBD to CRC, and increased response to anti-PD1 therapy. The main mechanism of OLFM4-mediated PMN-MDSC activity involved the NF-κB/PTGS2 pathway, through the binding of LGALS3, a galactoside-binding protein expressed on PMN-MDSCs. Our results showed that the OLFM4/NF-κB/PTGS2 pathway promoted PMN-MDSC recruitment, which played an essential role in the maintenance of intestinal homeostasis, but showed resistance to anti-PD1 therapy in CRC.