To break through the bottleneck in preparation of nanobody (Nb) for chemical contaminants induced by the difficulties in the synthesis of immunogen, complexity and unexpectable efficiency of immunization, a novel strategy to generate Nbs based on the designed synthetic Nb libraries with final size up to 10 cfu/mL was adopted and succeeded in selection of anti-coumaphos Nb A4. Furthermore, an affinity-matured mutant Nb 3G was obtained from the secondary library. Finally, an ic-ELISA was established with the limit of detection for coumaphos low to 1.90 ng/mL, 6.4-fold improved than the parent Nb A4, and the detection range from 3.06 to 15.77 ng/mL. Meanwhile, the recovery rate of vegetable samples was from 89.9% to 98.5%. Finally, the accuracy was testified by the standard UPLC-MS/MS method with R up to 0.99. Overall, fully synthetic Nb libraries constructed in this work provided an alternative possibility to generate the specific Nbs for chemical contaminants.