The COVID-19 pandemic is our generation's greatest global challenge to our public health system. Vaccines are considered one of the most effective tools available for preventing COVID-19 infection and its complications and sequelae. Understanding and addressing the psychological stress related to COVID-19 vaccination may promote acceptance of these vaccines. We conducted an online survey from January 29 to April 26, 2021 to explore stress levels related to COVID-19 vaccination among the general public in China. Participants were asked to evaluate their psychological stress of considering whether or not to get vaccinated at the beginning period of the COVID-19 mass vaccination, after getting access to the information about the vaccine, as well as after getting vaccinated, using visual analog stress scale. Multiple linear regression analysis was performed to explore factors potentially associated with COVID-19-related psychological stress levels before and after getting vaccinated. A total of 34,041 participants were included in the final analysis. The mean stress score concerning COVID-19 vaccination was 3.90 ± 2.60 among all participants, and significantly decreased over time. In addition, the vaccine-related stress level significantly decreased after accessing information about the COVID-19 vaccine ( = 29,396), as well as after getting vaccinated ( = 5,103). Multivariable regression analysis showed higher stress levels related to COVID-19 vaccination in participants who were younger, having lower education level, having history of chronic diseases, mistrusting vaccine's efficacy, experience of vaccine allergy events, being affected by the COVID-19 epidemic, and having mental illness symptoms. Moreover, mistrust in vaccine efficacy and experience of vaccine allergy events had a long-term impact on psychological stress levels about COVID-19 vaccination even after getting vaccinated. The current findings profiled the COVID-19 vaccine-related psychological stress among the general public in China. Population-specific management and interventions targeting the stress related to COVID-19 vaccination are needed to help governments and policy makers promote individual's willingness to get vaccinations for public well-being during the COVID-19 pandemic.