Aggression is a common and complex social behavior that is associated with violence and mental diseases. Although sex differences were observed in aggression, the neural mechanism for the effect of sex on aggression behaviors remains unclear, especially in specific subscales of aggression. In this study, we investigated the effects of sex on aggression subscales, gray matter volume (GMV), and functional connectivity (FC) of each insula subregion as well as the correlation of aggression subscales with GMV and FC. This study found that sex significantly influenced (a) physical aggression, anger, and hostility; (b) the GMV of all insula subregions; and (c) the FC of the dorsal agranular insula (dIa), dorsal dysgranular insula (dId), and ventral dysgranular and granular insula (vId_vIg). Additionally, mediation analysis revealed that the GMV of bilateral dIa mediates the association between sex and physical aggression, and left dId-left medial orbital superior frontal gyrus FC mediates the relationship between sex and anger. These findings revealed the neural mechanism underlying the sex differences in aggression subscales and the important role of the insula in aggression differences between males and females. This finding could potentially explain sexual dimorphism in neuropsychiatric disorders and improve dysregulated aggressive behavior.