The association between structural changes and pain sensation in osteoarthritis (OA) remains unclear. Joint deterioration in OA leads to the release of protein fragments that can either systemically (serum) or locally (synovial fluid; SF) be targeted as biomarkers and describe structural changes and potentially pain. Biomarkers of collagen type I (C1M), type II (C2M), type III (C3M), type X (C10C), and aggrecan (ARGS) degradation were measured in the serum and SF of knee OA patients. Spearman's rank correlation was used to assess the correlation of the biomarkers' levels between serum and SF. Linear regression adjusted for confounders was used to evaluate the associations between the biomarkers' levels and clinical outcomes. The serum C1M levels were negatively associated with subchondral bone density. The serum C2M levels were negatively associated with KL grade and positively associated with minimum joint space width (minJSW). The C10C levels in SF were negatively associated with minJSW and positively associated with KL grade and osteophyte area. Lastly, the serum C2M and C3M levels were negatively associated with pain outcomes. Most of the biomarkers seemed to mainly be associated with structural outcomes. The overall biomarkers of extracellular matrix (ECM) remodeling in serum and SF may provide different information and reflect different pathogenic processes.