Although many approaches have been developed for the quick assessment of SARS-CoV-2 infection, few of them are devoted to the detection of the neutralizing antibody, which is essential for assessing the effectiveness of vaccines. Herein, we developed a tri-mode lateral flow immunoassay (LFIA) platform based on gold-silver alloy hollow nanoshells (Au-Ag HNSs) for the sensitive and accurate quantification of neutralizing antibodies. By tuning the shell-to-core ratio, the surface plasmon resonance (SPR) absorption band of the Au-Ag HNSs is located within the near infrared (NIR) region, endowing them with an excellent photothermal effect under the irradiation of optical maser at 808 nm. Further, the Raman reporter molecule 4-mercaptobenzoic acid (MBA) was immobilized on the gold-silver alloy nanoshell to obtain an enhanced SERS signal. Thus, these Au-Ag HNSs could provide colorimetric, photothermal and SERS signals, with which, tri-mode strips for SARS-CoV-2 neutralizing antibody detection were constructed by competitive immunoassay. Since these three kinds of signals could complement one another, a more accurate detection was achieved. The tri-mode LFIA achieved a quantitative detection with detection limit of 20 ng/mL. Moreover, it also successfully detected the serum samples from 98 vaccinated volunteers with 79 positive results, exhibiting great application value in neutralizing antibody detection.