Tuberculosis (TB) kills more individuals each year than any other single pathogen and a more effective vaccine is critical for the global control of the disease. Although there has been recent progress in the clinical testing of candidates, no new vaccine has been licensed for use and correlates of protective immunity in humans have not been defined. Prior Mycobacterium tuberculosis infection does not appear to confer long-term protective immunity in humans; thus mimicking the natural immune response to infection may not be a suitable approach to develop improved TB vaccines. Data from animal testing are used to progress vaccines through the "vaccine pipeline", but studies in animals have not been able to predict efficacy in humans. Furthermore, although the generation of conventional CD4 T-cell responses are considered necessary to control infection with M. tuberculosis, these do not necessarily correlate with protection induced by candidate vaccines and other immune components may play a role, including donor unrestricted T cells, tissue-resident memory T cells and anti-M. tuberculosis antibodies. This review will summarize the current understanding of the protective immune responses following M. tuberculosis infection or vaccination, with a particular focus on vaccines that have recently entered clinical trials.