Intestinal inflammatory fibrosis is a severe consequence of inflammatory bowel diseases (IBDs). There is currently no cure for the treatment of intestinal fibrosis in IBD. Although inflammation is necessary for triggering fibrosis, the anti-inflammatory agents used to treat IBD are ineffective in preventing the progression of intestinal fibrosis and stricture formation once initiated, suggesting that inflammatory signals are not the sole drivers of fibrosis progression once it is established. Among multiple mechanisms involved in the initiation and progression of intestinal fibrosis in IBD, stromal cells play critical roles in mediating the process. In this review, we summarize recent progress on how stromal cells regulate intestinal fibrosis in IBD and how they are regulated by focusing on immune regulation and gut microbiota. We also outline the challenges moving forward in the field.