Zinc (Zn) deficiency is a common limiting factor in agricultural soils, which leads to significant reduction in both the yield and nutritional quality of agricultural produce. Exploring the quantitative trait loci (QTL) for shoot and grain Zn accumulation would help to develop new barley cultivars with greater Zn accumulation efficiency. In this study, two glasshouse experiments were conducted by growing plants under adequate and low Zn supply. From the preliminary screening of ten barley cultivars, Sahara (0.05 mg/pot) and Yerong (0.06 mg/pot) showed the lowest change in shoot Zn accumulation, while Franklin (0.16 mg/pot) had the highest change due to changes in Zn supply for plant growth. Therefore, the double haploid (DH) population derived from Yerong × Franklin was selected to identify QTL for shoot mineral accumulation and biomass production. A major QTL hotspot was detected on chromosome 2H between 31.91 and 73.12 cM encoding genes for regulating shoot mineral accumulations of Zn, Fe, Ca, K and P, and the biomass. Further investigation demonstrated 16 potential candidate genes for mineral accumulation, in addition to a single candidate gene for shoot biomass in the identified QTL region. This study provides a useful resource for enhancing nutritional quality and yield potential in future barley breeding programs.