Over the past decade, immune checkpoint inhibitors (ICIs) have transformed the management of multiple malignancies including lung cancer. However, the optimal use of these agents in terms of duration, dose and administration frequency remains unknown. Focusing on anti-PD1 agents nivolumab and pembrolizumab in the context of non-small cell lung cancer, we argue that several lines of evidence suggest current administration regimens of these drugs may result in overtreatment with potentially important implications for cost, quality of life and toxicity. This review summarizes evidence for the scope to optimize anti-PD1 regimens, the limitations of existing data and potential approaches to solve these problems including with a novel multi-arm clinical trial design implemented in the recently opened REFINE-Lung study.