Tumor associated carbohydrate antigens (TACAs) are a class of attractive antigens for the development of anti-cancer immunotherapy. Besides monoclonal antibodies and vaccines, chimeric antigen receptor (CAR) T cells and bispecific antibodies (BsAbs) targeting TACA are exciting directions to harness the power of the immune system to fight cancer. In this review, we focus on two TACAs, i.e., the GD2 ganglioside and the mucin-1 (MUC1) protein. The latest advances in CAR T cells and bispecific antibodies targeting these two antigens are presented. The roles of co-stimulatory molecules, structures of the sequences for antigen binding, methods for CAR and antibody construction, as well as strategies to enhance solid tumor penetration and reduce T cell exhaustion and death are discussed. Furthermore, approaches to reduce "on target, off tumor" side effects are introduced. With further development, CAR T cells and BsAbs targeting GD2 and MUC1 can become powerful agents to effectively treat solid tumor.