Round-Bohai Bay (RBB)-Region is an important crop production area in China, where vegetables are mainly produced in solar greenhouses. However, excessive fertilization and monoculture have caused serious deterioration of soil quality in this region. Soil microbial communities play pivotal roles in many ecosystem processes and are recognized as integrative components of soil quality. Therefore, in this study, we investigated bacterial and fungal diversity in solar greenhouse soils covering a wide range of cultivation year (CY) and sampling site (SS), by using pyrosequencing technology. Surprisingly, CY and SS had little influence on bacterial and fungal relative abundance and diversity. However, environmental factors (EF) and soil available potassium (K) in particular made a significant contribution to the variation of soil bacterial and fungal communities. Specifically, K showed significant (P < 0.05) correlations with dominant bacterial phyla Bacteroidetes, Acidobacteria, Chloroflexi, and Planctomycetes and fungal phyla Ascomycota and Basidiomycota. These results suggested that soil EF appeared more important than CY and SS in shaping the compositions of bacterial and fungal communities. In addition, since fertilizer K has been in the long-term abused in RBB-Region, future vegetable production should pay more attention to K input to reduce the negative effect on soil microbial communities.