Bidirectional signalling between the tumour and stroma shapes tumour aggressiveness and metastasis. ATF4 is a major effector of the Integrated Stress Response, a homeostatic mechanism that couples cell growth and survival to bioenergetic demands. Using conditional knockout ATF4 mice, we show that global, or fibroblast-specific loss of host ATF4, results in deficient vascularization and a pronounced growth delay of syngeneic melanoma and pancreatic tumours. Single-cell transcriptomics of tumours grown in Atf4 mice uncovered a reduction in activation markers in perivascular cancer-associated fibroblasts (CAFs). Atf4 fibroblasts displayed significant defects in collagen biosynthesis and deposition and a reduced ability to support angiogenesis. Mechanistically, ATF4 regulates the expression of the Col1a1 gene and levels of glycine and proline, the major amino acids of collagen. Analyses of human melanoma and pancreatic tumours revealed a strong correlation between ATF4 and collagen levels. Our findings establish stromal ATF4 as a key driver of CAF functionality, malignant progression and metastasis.