Human colorectal cancer (CRC) is the third most commonly diagnosed malignancies and the prognosis for patients with recurrent or metastatic disease is extremely poor. Although new chemotherapeutic regimen improves survival rates, therapy with better efficacy and less adverse effects is drastically needed. Immunotherapy has been investigated in human CRC for decades with limited success. However, recent developments of immunotherapy, particularly immune checkpoint inhibitor therapy, have achieved promising clinical benefits in many types of cancer and revived the hope for utilizing such therapy in human CRC. In this review, we will discuss important immunological landscape within the CRC microenvironment and introduce immunoscore system to better describe immunophenotyping in CRC. We will also discuss different immunotherapeutic approaches currently utilized in different phases of clinical trials. Some of those completed or ongoing trials are summarized. Finally, we provide a brief prospective on the future human CRC immunotherapy.