The occurrence and progression of tumors can be established through a complex interplay among tumor cells undergoing epithelial-mesenchymal transition (EMT), invasive factors and immune cells. In this study, we employed single-cell RNA sequencing (scRNA-seq) and spatially resolved transcriptomics (ST) to evaluate the pseudotime trajectory and spatial interactive relationship between EMT-invasive malignant tumors and immune cells in primary colorectal cancer (CRC) tissues at different stages (stage I/II and stage III with tumor deposit). Our research characterized the spatiotemporal relationship among different invasive tumor programs by constructing pseudotime endpoint-EMT-invasion tumor programs (EMTPs) located at the edge of ST, utilizing evolution trajectory analysis integrated with EMT-invasion genes. Strikingly, the invasive and expansive process of tumors undergoes remarkable spatial reprogramming of regulatory and immunosuppressive cells, such as myeloid-derived suppressor cells (MDSCs), tumor-associated macrophages (TAMs), regulatory T cells (Treg), and exhausted T cells (Tex). These EMTP-adjacent cell are linked to EMT-related invasion genes, especially the C-X-C motif ligand 1 (CXCL1) and CXCL8 genes that are important for CRC prognosis. Interestingly, the EMTPs in stage I mainly produce an inflammatory margin invasive niche, while the EMTPs in stage III tissues likely produce a hypoxic pre-invasive niche. Our data demonstrate the crucial role of regulatory and immunosuppressive cells in tumor formation and progression of CRC. This study provides a framework to delineate the spatiotemporal invasive niche in CRC samples.