Nerve axons are shaped similar to long electric wires to quickly transmit information from one end of the body to the other. To remain healthy and functional, axons depend on a wide range of cellular cargos to be transported from the neuronal cell body to its distal processes. Because of the extended distance, a sophisticated and well-organized trafficking network is required to move cargos up and down the axon. Besides motor proteins driving cargo transport, recent data revealed that subcellular membrane specializations, including the axon initial segment at the beginning of the axon and the membrane-associated periodic skeleton, which extends throughout the axonal length, are important spatial regulators of cargo traffic. In addition, tubulin modifications and microtubule-associated proteins present along the axonal cytoskeleton have been proposed to bias cargo movements. Here, we discuss the recent advances in understanding these multiple layers of regulatory mechanisms controlling axonal transport.