Pancreatic cancer is one of the deadliest malignancies in humans and it is expected to play a bigger part in cancer burden in the years to come. Pancreatic ductal adenocarcinoma (PDAC) represents 85% of all primary pancreatic malignancies. Recently, much attention has been given to PDAC, with significant advances in the understanding of the mechanisms underpinning disease initiation and progression, along with noticeable improvements in overall survival in both localized and metastatic settings. However, given their rarity, rare histological subtypes of pancreatic cancer have been underappreciated and are frequently treated as PDAC, even though they might present non-overlapping molecular alterations and clinical behavior. While some of these rare histological subtypes are true variants of PDAC that should be treated likewise, others represent separate clinicopathological entities, warranting a different therapeutic approach. In this review, we highlight clinical, pathological, and molecular aspects of rare histological types of pancreatic cancer, along with the currently available data to guide treatment decisions.