Obstructive sleep apnea (OSA) may lead to white mater (WM) disruptions and cognitive deficits. However, no studies have investigated the full extent of the brain WM, and its associations with cognitive deficits in OSA remain unclear. We thus applied diffusion tensor imaging (DTI) tractography with multi-fiber models and used atlas-based bundle-specific approach to investigate the WM abnormalities for various tracts of the cerebral cortex, thalamus, brainstem, and cerebellum in patients with untreated OSA. We enrolled 100 OSA patients and 63 healthy controls. Fractional anisotropy (FA) and mean diffusivity (MD) values mapped on 33 regions of interest including WM tracts of cortex, thalamus, brainstem, and cerebellum were obtained from tractography-based reconstructions. We compared FA/MD values between groups and correlated FA/MD with clinical data in the OSA group after controlling for age and body mass index. OSA patients showed significantly lower FA values in multiple WM fibers including corpus callosum, inferior fronto-occipital fasciculus, middle/superior longitudinal fasciculi, thalamic radiations, and uncinate (FDR <0.05). Higher FA values were found in medial lemniscus of patients compared to controls (FDR <0.05). Lower FA values of rostrum of corpus callosum correlated with lower visual memory performance in OSA group (p < .005). Our quantitative DTI analysis demonstrated that untreated OSA could negatively impact the integrity of pathways more broadly, including brainstem structures such as medial lemniscus, in comparison to previous findings. Fiber tract abnormalities of the rostral corpus callosum were associated with impaired visual memory in untreated OSA may provide insights into the related pathomechanism.