Depression is a neuropsychiatric disorder associated with persistent stress and disruption of neuronal function. Persistent stress causes neuronal atrophy, including loss of synapses and reduced size of the hippocampus and prefrontal cortex. These alterations are associated with neural dysfunction, including mood disturbances, cognitive impairment, and behavioral changes. Synaptic plasticity is the fundamental function of neural networks in response to various stimuli and acts by reorganizing neuronal structure, function, and connections from the molecular to the behavioral level. In this review, we describe the alterations in synaptic plasticity as underlying pathological mechanisms for depression in animal models and humans. We further elaborate on the significance of phytochemicals as bioactive agents that can positively modulate stress-induced, aberrant synaptic activity. Bioactive agents, including flavonoids, terpenes, saponins, and lignans, have been reported to upregulate brain-derived neurotrophic factor expression and release, suppress neuronal loss, and activate the relevant signaling pathways, including TrkB, ERK, Akt, and mTOR pathways, resulting in increased spine maturation and synaptic numbers in the neuronal cells and in the brains of stressed animals. In clinical trials, phytochemical usage is regarded as safe and well-tolerated for suppressing stress-related parameters in patients with depression. Thus, intake of phytochemicals with safe and active effects on synaptic plasticity may be a strategy for preventing neuronal damage and alleviating depression in a stressful life.