Mud volcanoes are the most dynamic and unstable sedimentary structures in the areas of tectonic compression like the subduction zones. In this study, we comprehensively analyzed the distribution of minerals as well as diversity, abundance and metabolic potential of the microbial communities of major mud volcanic groups across Taiwan namely Chu-kou Fault (CKF), Gu-ting-keng Anticline (GTKA), Chi-shan Fault (CSF), and Longitudinal Valley Fault (LVF). The mud volcano fluids recorded relatively higher Na and Cl contents than the other elements, particularly in the CKF and GTKA groups. The highest microbial diversity and richness were observed in the CSF group, followed by the GTKA group, whereas the lowest microbial diversity was observed in the CKF and LVF groups. Proteobacteria were common in all the sampling sites, except WST-7 and WST-H (Wu-Shan-Ting) of the CSF group, which were abundant in Chloroflexi. The halophilic genus Alterococcus was abundant in the Na-and Cl-rich CL-A sites of the CKF group. Sulfurovum was dominant in the CLHS (Chung-Lun hot spring) site of the CKF group and was positively correlated with sulfur/thiosulfate respiration, which might have resulted in a higher expression of these pathways in the respective group. Aerobic methane-oxidizing microbial communities, such as Methylobacter, Methylomicrobium, Methylomonas, and Methylosoma, constituted a dominant part of the LVF and CSF groups, except for the YNH-A and YNH-B (Yang-Nyu-Hu) sites. The WST-7 and JS sites were abundant in both methane-producing and methane-oxidizing microbial communities. The LGH-F1 (Lei-Gong-Huo) site was dominated by both methanotrophic and methylotrophic genera, such as Methylomicrobium and Methylophaga, respectively. Methylotrophy, methanotrophs, and hydrocarbon-degrading pathways were more abundant in the LVF and CSF groups but not in the remaining groups. The results of this study extend our knowledge of the diversity, abundance, and metabolic functions of prokaryotes in major terrestrial mud volcanoes in Taiwan.