White matter (WM) fiber alterations in patients with obstructive sleep apnea (OSA) is associated with cognitive impairment, which can be alleviated by continuous positive airway pressure (CPAP). In this study, we aimed to investigate the changes in WM in patients with OSA at baseline (pre-CPAP) and 3 months after CPAP adherence treatment (post-CPAP), and to provide a basis for understanding the reversible changes after WM alteration in this disease. Magnetic resonance imaging (MRI) was performed on 20 severely untreated patients with OSA and 20 good sleepers. Tract-based spatial statistics was used to evaluate the fractional anisotropy (FA), mean diffusion coefficient, axial diffusion coefficient, and radial diffusion coefficient (RD) of WM. To assess the efficacy of treatment, 20 patients with pre-CPAP OSA underwent MRI again 3 months later. A correlation analysis was conducted to evaluate the relationship between WM injury and clinical evaluation. Compared with good sleepers, patients with OSA had decreased FA and increased RD in the anterior thalamic radiation, forceps major, inferior fronto-occipital tract, inferior longitudinal tract, and superior longitudinal tract, and decreased FA in the uncinate fasciculus, corticospinal tract, and cingulate gyrus ( < 0.05). No significant change in WM in patients with post-CPAP OSA compared with those with pre-CPAP OSA. Abnormal changes in WM in untreated patients with OSA were associated with oxygen saturation, Montreal cognitive score, and the apnea hypoventilation index. WM fiber was extensively alteration in patients with severe OSA, which is associated with cognitive impairment. Meanwhile, cognitive recovery was not accompanied by reversible changes in WM microstructure after short-term CPAP therapy.