To explore the characteristics of species diversity and phylogenetic diversity, as well as the dominant processes of community construction, in different forest types (deciduous broad-leaved forest, mixed coniferous and broad-leaved forest, and Chinese fir plantation) in subtropical regions, analyze the specific driving patterns of soil nutrients and other environmental factors on the formation of forest diversity in different forest types, and clarify the differences in response to environmental heterogeneity between natural forests and plantation forests. Based on 48 fixed monitoring plots of 50 m × 50 m in Shouchang Forest Farm, Jiande City, Zhejiang Province, woody plants with a diameter at breast height ≥5 cm were investigated. Species diversity indices (Margalef index, Shannon-Wiener index, Simpson index, and Pielou index), phylogenetic structure index (PD), and environmental factors were used to analyze the relationship between diversity characteristics and environmental factors through variance analysis, correlation analysis, and generalized linear models. Phylogenetic structural indices (NRI and NTI) were used, combined with a random zero model, to explore the mechanisms of community construction in different forest types. Research has found that (1) the deciduous broad-leaved forest had the highest species diversity (Margalef index of 4.121 ± 1.425) and phylogenetic diversity (PD index of 21.265 ± 7.796), significantly higher than the mixed coniferous and broad-leaved forest and the Chinese fir plantation ( < 0.05); (2) there is a significant positive correlation between species richness and phylogenetic diversity, with the best fit being AIC = 70.5636 and R = 0.9419 in broad-leaved forests; however, the contribution of evenness is limited; (3) the specific effects of soil factors on different forest types: available phosphorus (AP) is negatively correlated with the diversity of deciduous broad-leaved forests ( < 0.05), total phosphorus (TP) promotes the diversity of coniferous and broad-leaved mixed forests, while the diversity of Chinese fir plantations is significantly negatively correlated with total nitrogen (TN); (4) the phylogenetic structure of three different forest types shows a divergent pattern in deciduous broad-leaved forests, indicating that competition and exclusion dominate the construction of deciduous broad-leaved forests; the aggregation mode of Chinese fir plantation indicates that environmental filtering dominates the construction of Chinese fir plantation; the mixed coniferous and broad-leaved forest is a transitional model, indicating that the mixed coniferous and broad-leaved forest is influenced by both stochastic processes and ecological niche processes. In different forest types in subtropical regions, the species and phylogenetic diversity of broad-leaved forests is significantly higher than in other forest types. The impact of soil nutrients on the diversity of different forest types varies, and the characteristics of community construction in different forest types are also different. This indicates the importance of protecting the original vegetation and provides a scientific basis for improving the ecological function of artificial forest ecosystems through structural adjustment. The research results have important practical guidance value for sustainable forest management and biodiversity conservation in the region.