The early microbial colonization of the gastrointestinal tract can have long-term impacts on development and health. Keystone species, including Bacteroides spp., are prominent in early life and play crucial roles in maintaining the structure of the intestinal ecosystem. However, the process by which a resilient community is curated during early life remains inadequately understood. Here, we show that a single sialidase, NanH, in Bacteroides fragilis mediates stable occupancy of the intestinal mucosa in early life and regulates a commensal colonization program. This program is triggered by sialylated glycans, including those found in human milk oligosaccharides and intestinal mucus. NanH is required for vertical transmission from dams to pups and promotes B. fragilis dominance during early life. Furthermore, NanH facilitates commensal resilience and recovery after antibiotic treatment in a defined microbial community. Collectively, our study reveals a co-evolutionary mechanism between the host and microbiota mediated through host-derived glycans to promote stable colonization.