A low-absorption adhesion layer plays a crucial role for both localized and propagating surface plasmons when ultrathin gold is used. To date, the most popular adhesion layers are metallic, namely, Cr and Ti. However, to the best of our knowledge, the influence of these adhesion layers on the behavior of propagating plasmon modes has not been thoroughly investigated nor reported in the literature. It is therefore important to study the effect of these few- to several-nanometers-thick adhesion layers on the propagating plasmons because it may affect the performance of plasmonic devices, in particular, when the Au layer is not much thicker than the adhesion layers. We experimentally compared the performances of the ultrathin gold films to show the pivotal influence of adhesion layers on highly confined propagating plasmonic modes, using Cr and 3-aminopropyl trimethoxysilane (APTMS) adhesion layers and without any adhesion layer. We show that the gold films with the APTMS adhesion layer have the lowest surface roughness and the short-range surface plasmon polaritons supported on the Au surface exhibit properties close to the theoretical calculations, considering an ideal gold film.