Phytochemicals, such as flavonoids, stilbenoids, alkaloids, terpenoids, and related compounds, have a wide range of useful pharmacological properties which cannot be ascribed to binding to a single peptide or protein target alone. Due to the relatively high lipophilicity of phytochemicals, the lipid membrane is thought to mediate their effects via changes in the properties of the lipid matrix, in particular, by modulating the transmembrane distribution of the electrical potential and, consequently, the formation and functioning of the ion channels reconstituted in the lipid bilayers. Therefore, biophysical studies on the interactions between plant metabolites and model lipid membranes are still of interest. This review represents an attempt to provide a critical analysis of a variety of studies on altering membranes and ion channels with phytochemicals via disturbing the potential drop at the membrane-aqueous solution interface. Critical structural motifs and functioning groups in the molecules of plant polyphenols (alkaloids and saponins are identified) and the possible mechanisms of dipole potential modulation with phytochemicals are discussed.