Processive transport by the microtubule motor cytoplasmic dynein requires the regulated assembly of a dynein-dynactin-adapter complex. Interactions between dynein and dynactin were initially ascribed to the dynein intermediate chain N-terminus and the dynactin subunit p150. However, recent cryo-EM structures have not resolved this interaction, questioning its importance. The intermediate chain also interacts with Nde1/Ndel1, which compete with p150 for binding. We reveal that the intermediate chain N-terminus is a critical evolutionarily conserved hub that interacts with dynactin and Ndel1, the latter of which recruits LIS1 to drive complex assembly. In additon to revealing that the intermediate chain N-terminus is likely bound to p150 in active transport complexes, our data support a model whereby Ndel1-LIS1 must dissociate prior to LIS1 being handed off to dynein in temporally discrete steps. Our work reveals previously unknown steps in the dynein activation pathway, and provide insight into the integrated activities of LIS1/Ndel1 and dynactin/cargo-adapters.