In conventional ultrasound detection in structures, a fiber Bragg grating (FBG) is glued on or embedded in the structure. However, application of strain to the structure can influence the sensitivity of the FBG toward ultrasound and can prevent its effective detection. An FBG can work as a strain-insensitive ultrasound sensor when it is not directly glued to the monitored structure, but is instead applied to a small thin plate to form a mobile sensor. Another possible configuration is to affix an FBG-inscribed optical fiber without the grating section attached to the monitored structure. In the present study, sensitivity to ultrasound propagated through an aluminum plate was compared for a strain-insensitive FBG sensor and an FBG sensor installed in a conventional manner. Strains induced by ultrasound from a piezoelectric transducer and by quasi-acoustic emission of a pencil lead break were also quantitatively evaluated from the response amplitude of the FBG sensor. Experimental results showed that the reduction in the signal-to-noise ratio for ultrasound detection with strain-insensitive FBG sensors, relative to traditionally-installed FBG sensors, was only 6 dB, and the ultrasound-induced strain varied within a range of sub-micron strains.