The abundance, diversity, activity, and composition of microbial communities in sulfide structures both of active and inactive vents were investigated by culture-independent methods. These sulfide structures were collected at four hydrothermal fields, both on- and off-axis of the back-arc spreading center of the Southern Mariana Trough. The microbial abundance and activity in the samples were determined by analyzing total organic content, enzymatic activity, and copy number of the 16S rRNA gene. To assess the diversity and composition of the microbial communities, 16S rRNA gene clone libraries including bacterial and archaeal phylotypes were constructed from the sulfide structures. Despite the differences in the geological settings among the sampling points, phylotypes related to the Epsilonproteobacteria and cultured hyperthermophilic archaea were abundant in the libraries from the samples of active vents. In contrast, the relative abundance of these phylotypes was extremely low in the libraries from the samples of inactive vents. These results suggest that the composition of microbial communities within sulfide structures dramatically changes depending on the degree of hydrothermal activity, which was supported by statistical analyses. Comparative analyses suggest that the abundance, activity and diversity of microbial communities within sulfide structures of inactive vents are likely to be comparable to or higher than those in active vent structures, even though the microbial community composition is different between these two types of vents. The microbial community compositions in the sulfide structures of inactive vents were similar to those in seafloor basaltic rocks rather than those in marine sediments or the sulfide structures of active vents, suggesting that the microbial community compositions on the seafloor may be constrained by the available energy sources. Our findings provide helpful information for understanding the biogeography, biodiversity and microbial ecosystems in marine environments.