Various types of tumors and tumor-like lesions may affect the pancreas. Among them, pancreatic ductal adenocarcinoma is the most common and is generally referred to as "pancreatic cancer." Recently, the detection rates of rare pancreatic tumors and tumor-like lesions have increased owing to technological advancements and increased frequency of imaging tests. Considering that rare pancreatic tumors and tumor-like lesions differ from pancreatic ductal adenocarcinoma in terms of the treatment plan and prognosis, the differential diagnosis of these diseases is clinically relevant. Various imaging tests play an important role in the differential diagnoses of rare tumors, such as acinar cell carcinoma and schwannoma, tumor-like lesions, such as autoimmune pancreatitis and inflammatory pseudotumor, and pancreatic ductal adenocarcinoma, but accurately distinguishing these diseases solely based on imaging findings is difficult. The aim of this pictorial review was to present the imaging findings of rare pancreatic tumors and tumor-like lesions and discuss important points for the differential diagnosis.