Radiative cooling textiles hold promise for achieving personal thermal comfort under increasing global temperature. However, urban areas have heat island effects that largely diminish the effectiveness of cooling textiles as wearable fabrics because they absorb emitted radiation from the ground and nearby buildings. We developed a mid-infrared spectrally selective hierarchical fabric (SSHF) with emissivity greatly dominant in the atmospheric transmission window through molecular design, minimizing the net heat gain from the surroundings. The SSHF features a high solar spectrum reflectivity of 0.97 owing to strong Mie scattering from the nano-micro hybrid fibrous structure. The SSHF is 2.3°C cooler than a solar-reflecting broadband emitter when placed vertically in simulated outdoor urban scenarios during the day and also has excellent wearable properties.