Tissue-resident memory T (TRM) cells infiltrating solid tumors could influence tumor progression and the response to immune therapies. However, the proportion and prognostic value of TRM cells in the bone marrow (BM) of patients with acute myeloid leukemia (AML) are unclear. In this study, we used flow cytometry to assay the phenotype of 49 BM samples from patients newly diagnosed with AML (ND-AML). We found that the BM CD8 effector memory (TEM) cells highly expressed CD69 (CD8 TRM-like T cells), and their percentage was significantly increased in patients with ND-AML compared with that in healthy individuals (HI). The high percentage of CD8 TRM-like subset was associated with poor overall survival in our ND-AML cohort. The Kaplan-Meier Plotter database verified a significantly reduced survival rate among patients with high expression of CD8 TRM-like T cell characteristic genes (, , and ), especially the M4 and M5 subtypes. Phenotypic analysis revealed that the BM CD8 TRM-like subpopulation exhibited exhausted T cell characteristics, but its high expression of CD27 and CD28 and low expression of CD57 suggested its high proliferative potential. The single-cell proteogenomic dataset confirmed the existence of TRM-like CD8 T cells in the BM of patients with AML and verified the high expression of immune checkpoints and costimulatory molecules. In conclusion, we found that the accumulation of BM CD8 TRM-like cells could be an immune-related survival prediction marker for patients with AML.