Side effects, including nausea, vomiting, mucositis, peripheral neuropathy, and diarrhea, have been frequently reported in colorectal cancer (CRC) patients undergoing chemotherapy. Chinese Herbal Medicines (CHMs) display distinct clinical outcomes, as a result, they have been increasingly used as an adjuvant therapy to manage chemotherapy-induced side effects. In this review, we aim to intensively explore the molecular mechanisms of CHMs, underline the significance of CHMs in mitigating the side effects induced by chemotherapy, and examine the necessary studies required to understand the role of CHMs in alleviating chemotherapy-induced side effects. Specifically, ginger, , and Liujunzi Decoction have been verified to ameliorate nausea and vomiting. Banxia Xiexin Decoction and Huangqin Decoction have been confirmed to be beneficial to mucositis and delayed-onset of diarrhea. Moreover, Niuche Shenqi Wan, Guilong Tongluo Decoction, Huangqi Guizhi Wuwu Decoction, and tumeric have been found to display potential therapeutic effects for preventing the genesis and development of peripheral neurotoxicity. These findings have further emphasized the pivotal role of CHMs in improving the outcomes of chemotherapy-induced side effects in CRC. Nonetheless, more molecular evidence is required to comprehensively understand and more appropriately apply CHMs in routine clinical practice for CRC.