An accurate and sensitive competitive enzyme-linked immunosorbent assay (ELISA) based on persistent luminescence nanoparticles ZnGeO:Mn, Eu (ZGME) was developed for detecting ochratoxin A (OTA), a powerfully toxic mycotoxin usually found in grains. As a signal output element of autofluorescence-free biosensors, ZGME can be integrated into ELISA with glucose oxidase (GOx)-binding OTA molecules due to its excellent pH-responsive persistent luminescence. In the absence of OTA, the OTA-GOx conjugate was captured by the anti-OTA monoclonal antibody (anti-OTA mAb) pre-coated on the 96-well plate. The results indicate a decrease in the pH value of the solution, which triggered the quenching of ZGME luminescence due to GOx-dependent gluconic acid production. The presence of OTA inhibited the binding of OTA-GOx on the plate, thus decreasing the production of gluconic acid and increasing the persistent luminous intensity of ZGME. Under the optimized concentrations of anti-OTA mAb and OTA-GOx, quantitative determination of OTA was achieved by plotting the increase or decrease in persistent luminescence intensity of ZGME at 535 nm. In this study, the linear range was from 0.1 μg L to 63 μg L, and the limit of detection (LOD) was as low as 0.045 μg L. In five food samples (corn grit, brown rice, soybean, rice, and wheat), the results exhibited good stability and repeatability, with a recovery range from 81.3% to 94.4% and a relative standard deviation (RSD) of less than 4.2%. Hence, the established method provides a sensitive, accurate, and autofluorescence-free approach for the determination of OTA in different grain samples.