Despite the decades-old knowledge that males and people with diabetes mellitus (DM) are at increased risk for coronary artery disease (CAD), the reasons for this association are only partially understood. Among the immune cells involved, recent evidence supports a critical role of T cells as drivers and modifiers of CAD. CD4+ T cells are commonly found in atherosclerotic plaques. We aimed to understand the relationship of CAD with sex and DM by single-cell RNA (scRNA-Seq) and antibody sequencing (CITE-Seq) of CD4+ T cells. Peripheral blood mononuclear cells (PBMCs) of 61 men and women who underwent cardiac catheterization were interrogated by scRNA-Seq combined with 49 surface markers (CITE-Seq). CAD severity was quantified using Gensini scores, with scores above 30 considered CAD+ and below 6 considered CAD-. Four pairs of groups were matched for clinical and demographic parameters. To test how sex and DM changed cell proportions and gene expression, we compared matched groups of men and women, as well as diabetic and non-diabetic subjects. We analyzed 41,782 single CD4+ T cell transcriptomes for sex differences in 16 women and 45 men with and without coronary artery disease and with and without DM. We identified 16 clusters in CD4+ T cells. The proportion of cells in CD4+ effector memory cluster 8 (CD4T8, CCR2+ Em) was significantly decreased in CAD+, especially among DM+ participants. This same cluster, CD4T8, was significantly decreased in female participants, along with two other CD4+ T cell clusters. In CD4+ T cells, 31 genes showed significant and coordinated upregulation in both CAD and DM. The DM gene signature was partially additive to the CAD gene signature. We conclude that (1) CAD and DM are clearly reflected in PBMC transcriptomes, and (2) significant differences exist between women and men and (3) between subjects with DM and non-DM.