Conventionally, it was thought that innate immunity operated through a simple system of nonspecific responses to an insult. However, this perspective now seems overly simplistic. It has become evident that intricate cooperation and networking among various cells, receptors, signaling pathways, and protein complexes are essential for regulating and defining the overall activation status of the immune response, where the distinction between innate and adaptive immunity becomes ambiguous. Given the evolutionary timeline of vertebrates and the success of plants and invertebrates which depend solely on innate immunity, immune memory cannot be considered an innovation of only the lymphoid lineage. Indeed, the evolutionary innate immune memory program is a conserved mechanism whereby innate immune cells can induce a heightened response to a secondary stimulus due to metabolic and epigenetic reprogramming. Importantly, the longevity of this memory phenotype can be attributed to the reprogramming of self-renewing hematopoietic stem cells (HSCs) in the bone marrow, which is subsequently transmitted to lineage-committed innate immune cells. HSCs reside within a complex regulated network of immune and stromal cells that govern their two primary functions: self-renewal and differentiation. In this review, we delve into the emerging cellular and molecular mechanisms as well as metabolic pathways of innate memory in HSCs, which harbor substantial therapeutic promise.