Interhemispheric anatomical differences have long been thought to be related to language lateralization. Previous studies have explored whether asymmetries in the diffusion characteristics of white matter language tracts are consistent with language lateralization. These studies, typically with smaller cohorts, yielded mixed results. This study investigated whether connectomic analysis of quantitative anisotropy (QA) and shape features of white matter tracts across the whole brain are associated with language lateralization. We analyzed 1,040 healthy individuals (562 females) from the Human Connectome Project database. Hemispheric language dominance for each participant was quantified using a laterality quotient (LQ) derived from fMRI activation in regions of interest (ROIs) associated with a language comprehension task compared against a math task. A linear regression model was used to examine the relationship between structural asymmetry and functional lateralization. Connectometry revealed a significant negative correlation between LQs and QA of corpus callosum tracts, indicating that higher QA in these regions is associated with bilateral and right hemisphere language representation in frontal and temporal regions. Left language laterality in the temporal lobe was significantly associated with longer right inferior fronto-occipital fasciculus (IFOF) and forceps minor tracts. These results suggest that diffusion measures of microstructural architecture as well as geometrical features of reconstructed white matter tracts play a role in language lateralization. People with increased dependence on the right or both frontal hemispheres for language processing may have more developed commissural fibers, which may support more efficient interhemispheric communication.