Septin filaments form ordered hourglass and ring-shaped structures in close apposition to the yeast bud-neck membrane. The septin hourglass scaffolds the asymmetric localization of many essential cell division proteins. However, it is unknown whether the septin structures have an overall polarity along the mother-daughter axis that determines the asymmetric protein localization. Here we engineered rigid septin- green fluorescent protein (GFP) fusions with various fluorescence dipole directions by changing the position of the GFP beta-barrel relative to the septin filament axis. We then used polarized fluorescence microscopy to detect potential asymmetries in the filament organization. We found that both the hourglass and ring filament assemblies have sub-resolution C(2) symmetry and lack net polarity along the mother-daughter axis. The hourglass filaments have an additional degree of symmetry relative to the ring filaments, most likely due to a twist in their higher-order structure. We previously reported that during the hourglass to rings transition septin filaments change their direction. Here we show that the filaments also undergo a change in their lateral organization, consistent with filament untwisting. The lack of net septin polarity along the mother-daughter axis suggests that there are no septin-based structural reasons for the observed asymmetry of other proteins. We discuss possible anisotropic processes that could break the septin symmetry and establish the essential bud-neck asymmetry.