Brain's micro-structure plays a critical role in its macro-structure material properties. Since the structural anisotropy in the brain white matter has been introduced due to axonal fibers, considering the direction of axons in the continuum models has been mediated to improve the results of computational simulations. The aim of the current study was to investigate the role of fiber direction in the material properties of brain white matter and compare the mechanical behavior of the anisotropic white matter and the isotropic gray matter. Diffusion tensor imaging (DTI) was employed to detect the direction of axons in white matter samples, and tensile stress-relaxation loads up to 20% strains were applied on bovine gray and white matter samples. In order to calculate the nonlinear and time-dependent properties of white matter and gray matter, a visco-hyperelastic model was used. The results indicated that the mechanical behavior of white matter in two orthogonal directions, parallel and perpendicular to axonal fibers, are significantly different. This difference indicates that brain white matter could be assumed as an anisotropic material and axons have contribution in the mechanical properties. Also, up to 15% strain, white matter samples with axons parallel to the force direction are significantly stiffer than both the gray matter samples and white matter samples with axons perpendicular to the force direction. Moreover, the elastic moduli of white matter samples with axons both parallel and perpendicular to the loading direction and gray matter samples at 15-20% strain are not significantly different. According to these observations, it is suggested that axons have negligible roles in the material properties of white matter when it is loaded in the direction perpendicular to the axon direction. Finally, this observation showed that the anisotropy of brain tissue not only has effects on the elastic behavior, but also has effects on the viscoelastic behavior.