Lotus japonicus has been used for decades as a model legume to study the establishment of binary symbiotic relationships with nitrogen-fixing rhizobia that trigger root nodule organogenesis for bacterial accommodation. Using community profiling of 16S rRNA gene amplicons, we reveal that in Lotus, distinctive nodule- and root-inhabiting communities are established by parallel, rather than consecutive, selection of bacteria from the rhizosphere and root compartments. Comparative analyses of wild-type (WT) and symbiotic mutants in Nod factor receptor5 (nfr5), Nodule inception (nin) and Lotus histidine kinase1 (lhk1) genes identified a previously unsuspected role of the nodulation pathway in the establishment of different bacterial assemblages in the root and rhizosphere. We found that the loss of nitrogen-fixing symbiosis dramatically alters community structure in the latter two compartments, affecting at least 14 bacterial orders. The differential plant growth phenotypes seen between WT and the symbiotic mutants in nonsupplemented soil were retained under nitrogen-supplemented conditions that blocked the formation of functional nodules in WT, whereas the symbiosis-impaired mutants maintain an altered community structure in the nitrogen-supplemented soil. This finding provides strong evidence that the root-associated community shift in the symbiotic mutants is a direct consequence of the disabled symbiosis pathway rather than an indirect effect resulting from abolished symbiotic nitrogen fixation. Our findings imply a role of the legume host in selecting a broad taxonomic range of root-associated bacteria that, in addition to rhizobia, likely contribute to plant growth and ecological performance.