Accumulating evidence indicates that the immune system does not develop in a linear fashion, but rather as distinct developmental layers formed from sequential waves of hematopoietic stem cells, each giving rise to unique populations of immune cells at different stages of development. Although recent studies have indicated that conventional CD8 T cells produced in early life persist into adulthood and exhibit distinct roles during infection, the developmental architecture of the peripheral T cell compartment remains undefined. In this study, we used a mouse model to permanently label CD8 T cells produced during distinct windows of development and traced their history to generate fate maps of CD8 T cells produced during different stages of life. We then used mathematical modeling to understand the age structure of the CD8 T cell compartment across the lifespan. Interestingly, we found that survival rate of CD8 T cells depends on both the age and developmental origin of the cells. Recently produced cells show an initial rapid decay rate, which slows with age of the animal at which the cells were produced. For cells produced at any age, the rate of decay also slows with the age of the cell. We derive a function to describe this and predict the "age distribution" of the CD8 T cell pool for animals of any given age. These data provide a quantitative framework for understanding the ontogeny of the CD8 T cell compartment and help to contextualize age-related changes in the CD8 T cell response to infection.