Low-level somatic mutations in the human brain are implicated in various neurological disorders. The contribution of low-level brain somatic mutations to autism spectrum disorder (ASD), however, remains poorly understood. Here, we performed high-depth exome sequencing with an average read depth of 559.3x in 181 cortical, cerebellar, and peripheral tissue samples to identify brain somatic single nucleotide variants (SNVs) in 24 ASD subjects and 31 controls. We detected ~2.4 brain somatic SNVs per exome per single brain region, with a variant allele frequency (VAF) as low as 0.3%. The mutational profiles, including the number, signature, and type, were not significantly different between the ASD patients and controls. Intriguingly, when considering genes with low-level brain somatic SNVs and ASD risk genes with damaging germline SNVs together, the merged set of genes carrying either somatic or germline SNVs in ASD patients was significantly involved in ASD-associated pathophysiology, including dendrite spine morphogenesis (p = 0.025), mental retardation (p = 0.012), and intrauterine growth retardation (p = 0.012). Additionally, the merged gene set showed ASD-associated spatiotemporal expression in the early and mid-fetal cortex, striatum, and thalamus (all p < 0.05). Patients with damaging mutations in the merged gene set had a greater ASD risk than did controls (odds ratio = 3.92, p = 0.025, 95% confidence interval = 1.12-14.79). The findings of this study suggest that brain somatic SNVs and germline SNVs may collectively contribute to ASD-associated pathophysiology.