The sensitivity and accuracy of nanopore sensors are severely hindered by the high noise associated with solid-state nanopores. To mitigate this issue, the deposition of organic polymer materials onto silicon nitride (SiNx) membranes has been effective in obtaining low-noise measurements. Nonetheless, the fabrication of nanopores sub-10 nm on thin polymer membranes remains a significant challenge. This work proposes a method for fabricating nanopores on polymethyl methacrylate (PMMA) membrane by the local high electrical field controlled breakdown, exploring the impact of voltage and current on the breakdown of PMMA membranes and discussing the mechanism underlying the breakdown voltage and current during the formation of nanopores. By improving the electric field application method, transient high electric fields that are one-seven times higher than the breakdown electric field can be utilized to fabricate nanopores. A comparative analysis was performed on the current noise levels of nanopores in PMMA-SiNx composite membranes and SiNx nanopores with a 5 nm diameter. The results demonstrated that the fast fabrication of nanopores on PMMA-SiNx membranes exhibited reduced current noise compared to SiNx nanopores. This finding provides evidence supporting the feasibility of utilizing this technology for efficiently fabricating low-noise nanopores on polymer composite membranes.