The purpose of this study is to define the topographical distribution of gray matter (GM) and white matter (WM) damage in patients with primary progressive multiple sclerosis (PPMS), using a multiparametric MR-based approach. Using a 3 Tesla scanner, dual-echo, 3D fast-field echo (FFE), and diffusion tensor (DT) MRI scans were acquired from 18 PPMS patients and 17 matched healthy volunteers. An optimized voxel-based (VB) analysis was used to investigate the patterns of regional GM density changes and to quantify GM and WM diffusivity alterations of the entire brain. In PPMS patients, GM atrophy was found in the thalami and the right insula, while mean diffusivity (MD) changes involved several cortical-subcortical structures in all cerebral lobes and the cerebellum. An overlap between decreased WM fractional anisotropy (FA) and increased WM MD was found in the corpus callosum, the cingulate gyrus, the left short temporal fibers, the right short frontal fibers, the optic radiations, and the middle cerebellar peduncles. Selective MD increase, not associated with FA decrease, was found in the internal capsules, the corticospinal tracts, the superior longitudinal fasciculi, the fronto-occipital fasciculi, and the right cerebral peduncle. A discrepancy was found between regional WM diffusivity changes and focal lesions because several areas had DT MRI abnormalities but did not harbor T2-visible lesions. Our study allowed to detect tissue damage in brain areas associated with motor and cognitive functions, which are known to be impaired in PPMS patients. Combining regional measures derived from different MR modalities may be a valuable tool to improve our understanding of PPMS pathophysiology.