The leaching of ionic rare earth elements has caused serious environmental pollution and ecological damage. Microorganisms play a crucial role in soil ecosystems and are one of the most important components of these systems. However, there are fewer studies related to the changes that occur in microbial community structure and diversity before and after leaching in ionic rare earth mines. In this study, Illumina high-throughput sequencing was used to examine the diversity and composition of soil microorganisms on the summit, hillside, and foot valley surfaces of unleached and leached mines after in situ leaching. The results showed that microbial diversity and abundance in the surface soil of the unleached mine were higher than those in the leached mine, and leaching had a significant impact on the microbial community of mining soil. pH was the main factor affecting the microbial community. Proteobacteria, Actinobacteriota, and Chloroflexi were phyla that showed high abundance in the soil. Network analysis showed that microbial interactions can improve microbial adaptation and stability in harsh environments. PICRUSt2 predictions indicate functional changes and linkages in soil microbial communities.