To investigate the impact of environmental noise on the cognitive abilities of drivers, this study, using in-vehicle voice interaction as an example, conducted laboratory experiments to assess the effects of road traffic noise, entertainment noise, and white noise stimuli on drivers' attention and short-term memory. The noise levels simulated to mimic acoustic conditions during car driving ranged from 35 dB(A) to 65 dB(A). The conclusions drawn were as follows: (1) Noise levels directly influenced subjective annoyance levels, with annoyance linearly increasing as noise levels escalated; (2) Both attention and short-term memory task reaction times of drivers were significantly influenced by noise types. Compared to traffic noise and white noise, drivers' cognitive efficiency was lower under entertainment noise. (3) Performance in complex cognitive tasks was more susceptible to noise levels compared to simple cognitive tasks; (4) Experimentally, it was found that drivers exhibited the highest cognitive efficiency in cognitive tasks when the environmental noise level was 55 dB(A), as opposed to noise levels of 35 dB(A), 45 dB(A), and 65 dB(A).