GluA2-lacking Ca-permeable AMPARs (CP-AMPARs) play integral roles in synaptic plasticity and can mediate excitotoxic cellular signaling at glutamatergic synapses. However, the developmental profile of functional CP-AMPARs at the auditory brainstem remains poorly understood. Through a combination of electrophysiological and live-cell Ca imaging from mice of either sex, we show that the synaptic release of glutamate from the calyx of Held nerve terminal activates CP-AMPARs in the principal cells of the medial nucleus of the trapezoid body in the brainstem. This leads to significant Ca influx through these receptors before the onset of hearing at postnatal day 12 (P12). Using a selective open channel blocker of CP-AMPARs, IEM-1460, we estimate that ∼80% of the AMPAR population are permeable to Ca at immature P4-P5 synapses. However, after the onset of hearing, Ca influx through these receptors was greatly reduced. We estimate that CP-AMPARs comprise approximately 40% and 33% of the AMPAR population at P18-P22 and P30-P34, respectively. By quantifying the rate of EPSC block by IEM-1460, we found an increased heterogeneity in glutamate release probability for adult-like calyces (P30-P34). Using tetraethylammonium (TEA), a presynaptic potassium channel blocker, we show that the apparent reduction of CP-AMPARs in more mature synapses is not a consequence of presynaptic action potential (AP) speeding. Finally, through postsynaptic AP recordings, we show that inhibition of CP-AMPARs reduces spike fidelity in juvenile synapses, but not in more mature synapses. We conclude that the expression of functional CP-AMPARs declines over early postnatal development in the calyx of Held synapse. The calyx of Held synapse is pivotal to the circuitry that computes sound localization. Postsynaptic Ca influx via AMPARs may be critical for signaling the maturation of this brainstem synapse. The GluA4 subunit may dominate the AMPAR complex at mature synapses because of its fast gating kinetics and large unitary conductance. The expectation is that AMPARs dominated by GluA4 subunits should be highly Ca permeable. However, we find that Ca-permeable AMPAR expression declines during postnatal development. Using the rate of EPSC block by IEM-1460, an open channel blocker of Ca-permeable AMPARs, we propose a novel method to determine glutamate release probability and uncover an increased heterogeneity in release probability for more mature calyces of Held nerve terminals.