The mitogen-activated protein kinases (MAPK) pathway, often known as the RAS-RAF-MEK-ERK signal cascade, functions to transmit upstream signals to its downstream effectors to regulate physiological process such as cell proliferation, differentiation, survival and death. As the most frequently mutated signaling pathway in human cancer, targeting the MAPK pathway has long been considered a promising strategy for cancer therapy. Substantial efforts in the past decades have led to the clinical success of BRAF and MEK inhibitors. However, the clinical benefits of these inhibitors are compromised by the frequently occurring acquired resistance due to cancer heterogeneity and genomic instability. This review briefly introduces the key protein kinases involved in this pathway as well as their activation mechanisms. We also generalize the correlations between mutations of MAPK members and human cancers, followed by a summarization of progress made on the development of small molecule MAPK kinases inhibitors. In particular, this review highlights the potential advantages of ERK inhibitors in overcoming resistance to upstream targets and proposes that targeting ERK kinase may hold a promising prospect for cancer therapy.