Pioneering success of antibodies targeting immune checkpoints such as programmed cell death protein 1 (PD-1) and cytotoxic T-lymphocyte-associated protein 4 (CTLA-4) has changed the outlook of cancer therapy. Although these antibodies show impressive durable clinical activity, low response rates and immune-related adverse events are becoming increasingly evident in antibody-based approaches. For further strides in cancer immunotherapy, novel treatment strategies including combination therapies and alternate therapeutic modalities are highly warranted. Towards this discovery and development of small molecule, checkpoint inhibitors are actively being pursued, and the efforts have culminated in the ongoing clinical testing of orally bioavailable checkpoint inhibitors. This review focuses on the small molecule agents targeting PD-1 checkpoint pathway for cancer immunotherapy and highlights various chemotypes/scaffolds and their characterization including binding and functionality along with reported mechanism of action. The learnings from the ongoing small molecule clinical trials and crucial points to be considered for their clinical development are also discussed.