Endosomal trafficking is essential for cellular homeostasis. At the crossroads of distinct intracellular pathways, the endolysosomal system is crucial to maintain critical functions and adapt to the environment. Alterations of endosomal compartments were observed in cells from adult individuals with Down syndrome (DS), suggesting that the dysfunction of the endosomal pathway may contribute to the pathogenesis of DS. However, the nature and the degree of impairment, as well as the timing of onset, remain elusive. Here, by applying imaging and biochemical approaches, we demonstrate that the structure and dynamics of early endosomes are altered in DS cells. Furthermore, we found that recycling trafficking is markedly compromised in these cells. Remarkably, our results in 18-20 week-old human fetal fibroblasts indicate that alterations in the endolysosomal pathway are already present early in development. In addition, we show that overexpression of the polyphosphoinositide phosphatase synaptojanin 1 (Synj1) recapitulates the alterations observed in DS cells, suggesting a role for this lipid phosphatase in the pathogenesis of DS, likely already early in disease development. Overall, these data strengthen the link between the endolysosomal pathway and DS, highlighting a dangerous liaison among Synj1, endosomal trafficking and DS.