Here, we aim to determine the distribution, ecological risk and sources of heavy metals and metalloids in the surface sediments of the Xiangjiang River, Hunan Province, China. Sixty-four surface sediment samples were collected in 16 sites of the Xiangjiang River, and the concentrations of ten heavy metals and metalloids (Mn, Zn, Cr, V, Pb, Cu, As, Ni, Co, and Cd) in the sediment samples were investigated using an inductively coupled plasma mass spectrometer (ICP-MS) and an atomic fluorescence spectrophotometer (AFS), respectively. The results showed that the mean concentrations of the ten heavy metals and metalloids in the sediment samples followed the order Mn > Zn > Cr > V > Pb > Cu > As ≈ Ni >Co > Cd. The geoaccumulation index (I ), enrichment factor (EF), modified degree of contamination (mC), and potential ecological risk index (RI) revealed that Cd, followed by Pb, Zn, and Cu, caused severely contaminated and posed very highly potential ecological risk in the Xiangjiang River, especially in Shuikoushan of Hengyang, Xiawan of Zhuzhou, and Yijiawan of Xiangtan. The Pearson's correlation coefficient (PCC) analysis, principal component analysis (PCA), and hierarchical cluster analysis (HCA) indicated that the ten heavy metals and metalloids in the sampling sediments of the Xiangjiang River were classified into three groups: (1) Cd, Pb, Zn, and Cu which possibly originated from Shuikoushan, Xiawan, and Yijiawan clustering Pb-Zn mining and smelting industries; (2) Co, V, Ni, Cr, and Al from natural resources; and (3) Mn and As. Therefore, our results suggest that anthropogenic activities, especially mining and smelting, have caused severe contamination of Cd, Pb, Zn, and Cu and posed very high potential ecological risk in the Xiangjiang River.