Frontotemporal lobe abnormalities are linked to neuropsychiatric disorders and cognition, but the role of cellular heterogeneity between temporal lobe (TL) and frontal lobe (FL) in the vulnerability to genetic risk factors remains to be elucidated. We integrated single-nucleus transcriptome analysis in 'fresh' human FL and TL with genetic susceptibility, gene dysregulation in neuropsychiatric disease and psychoactive drug response data. We show how intrinsic differences between TL and FL contribute to the vulnerability of specific cell types to both genetic risk factors and psychoactive drugs. Neuronal populations, specifically PVALB neurons, were most highly vulnerable to genetic risk factors for psychiatric disease. These psychiatric disease-associated genes were mostly upregulated in the TL, and dysregulated in the brain of patients with obsessive-compulsive disorder, bipolar disorder and schizophrenia. Among these genes, GRIN2A and SLC12A5, implicated in schizophrenia and bipolar disorder, were significantly upregulated in TL PVALB neurons and in psychiatric disease patients' brain. PVALB neurons from the TL were twofold more vulnerable to psychoactive drugs than to genetic risk factors, showing the influence and specificity of frontotemporal lobe differences on cell vulnerabilities. These studies provide a cell type resolved map of the impact of brain regional differences on cell type vulnerabilities in neuropsychiatric disorders.