Collagens serve essential mechanical functions throughout the body, particularly in the connective tissues. In articular cartilage, collagens provide most of the biomechanical properties of the extracellular matrix essential for its function. Collagen plays a very important role in maintaining the mechanical properties of articular cartilage and the stability of the ECM. Noteworthily, many pathogenic factors in the course of osteoarthritis and rheumatoid arthritis, such as mechanical injury, inflammation, and senescence, are involved in the irreversible degradation of collagen, leading to the progressive destruction of cartilage. The degradation of collagen can generate new biochemical markers with the ability to monitor disease progression and facilitate drug development. In addition, collagen can also be used as a biomaterial with excellent properties such as low immunogenicity, biodegradability, biocompatibility, and hydrophilicity. This review not only provides a systematic description of collagen and analyzes the structural characteristics of articular cartilage and the mechanisms of cartilage damage in disease states but also provides a detailed characterization of the biomarkers of collagen production and the role of collagen in cartilage repair, providing ideas and techniques for clinical diagnosis and treatment.