Pancreatic cancer comprises different subtypes, where most cases include ductal adenocarcinoma (PDAC). It is one of the deadliest tumor types, with a poor prognosis. In the majority of patients, the disease has already spread by the time of diagnosis, making full recovery unlikely and increasing mortality risk. Despite developments in its detection and management, including chemotherapy, radiotherapy, and targeted therapies as well as advances in immunotherapy, only in about 13% of PDAC patients does the overall survival exceed 5 years. This may be attributed, at least in part, to the highly desmoplastic tumor microenvironment (TME) that acts as a barrier limiting perfusion, drug delivery, and immune cell infiltration and contributes to the establishment of immunologically 'cold' conditions. Therefore, there is an urgent need to unravel the complexity of the TME that promotes PDAC progression and decipher the mechanisms of pancreatic tumors' resistance to immunotherapy. In this review, we provide an overview of the major cellular and non-cellular components of PDAC TME, as well as their biological interplays. We also discuss the current state of PDAC therapeutic treatments and focus on ongoing and future immunotherapy efforts and multimodal treatments aiming at remodeling the TME to improve therapeutic efficacy.