At present the efficacy of immune checkpoint inhibitors (ICIs) remains limited. The lack of responsiveness in certain patients may be attributed to CD8 T cell exhaustion within the tumor microenvironment (TME). Hematopoietic progenitor kinase 1 (HPK1) has been identified as a mediator of T cell dysfunction, leading to our hypothesis that HPK1 positive exhausted CD8 T cells could serve as a predictor for ICIs' efficacy in NSCLC patients, and potentially indicate key cellular subset causing ICIs resistance. Here, we retrospectively collected tumor tissue samples from 36 NSCLC patients who underwent first-line immunotherapy. Using multiplex immunohistochemistry, we visualized various PD-1CD8 T cell subsets and explore biomarkers for response. The analysis endpoints included overall response rate (ORR), progression free survival (PFS), and overall survival (OS), correlating them with levels of cell infiltration or effective density. We found that the proportion of PD-1CD8 T cell subsets did not align with predictions for ORR, PFS, and OS. Conversely, a high infiltration of HPK1PD-1TIM-3CD8 T cells was identified as an independent risk factor for both PFS (P = 0.019) and OS (P = 0.03). These cells were found to express the highest levels of Granzyme B, and the secretion of Granzyme B in CD8 T cell subsets was related to TCF-1. In conclusion, these data suggest that a high infiltration of HPK1PD-1TIM-3CD8 T cells correlates with poor clinical outcomes in NSCLC patients receiving immunotherapy. These cells may represent terminally exhausted T cells that fail to respond to ICIs, thereby laying the groundwork for the potential integration of HPK1 inhibitors with immunotherapy to enhance treatment strategy.