The role of estradiol (E2; an estrogen) in men needs to be more appreciated. In this review, we address the clinical situations that allow the study of the clinical consequences of E2 deficiency in men and discuss the effects of restoration of levels of this reproductive steroid hormone. In men with advanced prostate cancer (PCa) undergoing androgen deprivation therapy (ADT), E2 is suppressed along with testosterone, leading to side effects affecting the quality of life. These include hot flashes, arthralgia, fatigue, mood changes, cognition problems, weight gain, bone loss, and increased risk of cardiovascular disease. Transdermal E2 alone for ADT has shown equivalent testosterone suppression compared to gonadotropin-releasing hormone (GnRH) agonists while also preventing estrogen-deficiency side effects, including hot flashes and bone loss. Co-treatment of ADT with fetal estrogen estetrol (E4) has shown significant improvements of estrogen-deficiency symptoms. These observations emphasize the need to raise awareness of the importance of estrogens in men among clinicians and the lay public.