Hepatocellular carcinoma (HCC) is the second leading cause of cancer-related mortality worldwide. The five-year survival rate of patients with unresectable HCC is about 12%. The liver tumor microenvironment (TME) is immune tolerant and heavily infiltrated with immunosuppressive cells. Immune checkpoint inhibitors (ICIs), in some cases, can reverse tumor cell immune evasion and enhance antitumor immunity. Rapidly evolving ICIs have expanded systemic treatment options in advanced HCC; however, single-agent ICIs achieve a limited 15-20% objective response rate in advanced HCC. Therefore, other combinatorial approaches that amplify the efficacy of ICIs or suppress other tumor-promoting pathways may enhance clinical outcomes. Epigenetic alterations (e.g., changes in chromatin states and non-genetic DNA modifications) have been shown to drive HCC tumor growth and progression as well as their response to ICIs. Recent studies have combined ICIs and epigenetic inhibitors in preclinical and clinical settings to contain several cancers, including HCC. In this review, we outline current ICI treatments for HCC, the mechanism behind their successes and failures, and how ICIs can be combined with distinct epigenetic inhibitors to increase the durability of ICIs and potentially treat "immune-cold" HCC.