The rumen and intestinal microbiota play a pivotal role in the digestion and absorption processes of ruminants. Elucidating the mechanisms by which gastrointestinal microbiota influence the feed conversion ratio (FCR) in ruminants is significantly important for enhancing feed utilization efficiency in these animals. In this study, RT-qPCR, 16S rRNA sequencing, and metabolomic techniques were systematically employed to compare the microbial community structures in the rumen, cecum, and rectum, as well as the differences in rumen metabolites between high- and low-FCR Tan sheep. The results showed that, compared to the HFCR group of Tan sheep, the LFCR group exhibited a significant reduction in unclassified_f__Selenomonadaceae, Blvii28_wastewater-sludge_group, and Papillibacter in the rumen; a significant increase in Lachnospiraceae_AC2044_group and Sanguibacteroides; a significant reduction in unclassified_f__Peptostreptococcaceae, Clostridium_sensu_stricto_1, and Parasutterella in the cecum; a significant increase in norank_f__Bacteroidales_UCG-001; and a significant reduction in norank_f__Muribaculaceae, Blautia, and Turicibacter in the rectum. There is a significant positive correlation between Parasutterella in the cecum and three microorganisms, including unclassified_f__Selenomonadaceae, in the rumen. Additionally, Blvii28_wastewater-sludge_group was positively correlated with Lactobacillus. Furthermore, unclassified_f__Selenomonadaceae in the rumen was positively correlated with Turicibacter, unclassified_f__Peptostreptococcaceae, and Breznakia in the rectum. Blvii28_wastewater-sludge_group also showed positive correlations with Blautia, norank_f__Muribaculaceae, and Clostridium_sensu_stricto_1, while Papillibacter was positively correlated with Faecalitalea. The metabolomic results indicated that, compared to the HFCR group, 261 differential metabolites, including Phenylacetylglutamine and Populin, in the rumen of Tan sheep in the LFCR group were significantly downregulated, whereas 36 differential metabolites, including Glycyl-L-tyrosine, were significantly upregulated. Furthermore, the rumen microbe unclassified_f__Selenomonadaceae exhibited positive correlations with significantly differential metabolites such as L-tryptophan, Etiocholanolone glucuronide, N-acetyl-O-demethylpuromycin, and 6-deoxyerythronolide B. Blvii28_wastewater-sludge_group and Papillibacter also exhibited positive correlations with Icilin. High and low FCRs in the rumen of Tan sheep were investigated, especially in relation to unclassified_f__Selenomonadaceae, Blvii28_wastewater-sludge_group, and Papillibacter. Correlations can be seen with microorganisms such as Parasutatella and Lactobacillus in the cecum; Turicibacter, norank_f__Bacteroideales_UCG-001, and Blautia in the rectum; and metabolites such as L-tryptophan, Etiocholanolone glucuronide, and N-acetyl-O-demethylpuromycin. This reveals the role of microorganisms in the digestion and absorption of Tan sheep feed, thus providing a preliminary basis for further research on the microbial regulation of ruminant animal feed utilization and a theoretical basis for improving Tan sheep feed utilization efficiency.