With the booming development of glycobiology and glycochemistry, more and more structures of tumor-associated carbohydrate antigens (TACAs) are identified. Their broad expression and high specificity in cancer make them important targets to develop cancer vaccines or immunotherapies. However, most of the TACAs are T cell-independent antigens, they cannot elicit a powerful enough immune response to prevent or treat cancer. Immunotolerance and immunosuppression are more easily induced due to their endogenous properties and the declining immunity of the patients. This review summarizes the recent efforts to overcome these obstacles: coupling the carbohydrate antigens to proper carriers such as proteins or some small molecule carriers, and chemically modifying the structures of the TACAs to enhance the immunogenicity of TACAs and break the immunotolerance.