Many solid tumors are characterized by a dense extracellular matrix (ECM) composed of various ECM fibril proteins. These proteins provide structural support and a biological context for the residing cells. The reciprocal interactions between growing and migrating tumor cells and the surrounding stroma result in dynamic changes in the ECM architecture and its properties. With the use of advanced imaging techniques, several specific patterns in the collagen surrounding the breast tumor have been identified in both tumor murine models and clinical histology images. These tumor-associated collagen signatures (TACS) include loosely organized fibrils far from the tumor and fibrils aligned either parallel or perpendicular to tumor colonies. They are correlated with tumor behavior, such as benign growth or invasive migration. However, it is not fully understood how one specific fibril pattern can be dynamically remodeled to form another alignment. Here, we present a novel multi-cellular lattice-free () agent-based model of ECM that, in contrast to static histology images, can simulate dynamic changes between TACSs. This model allowed us to identify the rules of cell-ECM physical interplay and feedback that guided the emergence and transition among various TACSs.