Advances in vibrational spectroscopy have propelled new insights into the molecular composition and structure of biological tissues. In this review, we discuss common modalities and techniques of vibrational spectroscopy, and present key examples to illustrate how they have been applied to enrich the assessment of connective tissues. In particular, we focus on applications of Fourier transform infrared (FTIR), near infrared (NIR) and Raman spectroscopy to assess cartilage and bone properties. We present strengths and limitations of each approach and discuss how the combination of spectrometers with microscopes (hyperspectral imaging) and fiber optic probes have greatly advanced their biomedical applications. We show how these modalities may be used to evaluate virtually any type of sample (ex vivo, in situ or in vivo) and how "spectral fingerprints" can be interpreted to quantify outcomes related to tissue composition and quality. We highlight the unparalleled advantage of vibrational spectroscopy as a label-free and often nondestructive approach to assess properties of the extracellular matrix (ECM) associated with normal, developing, aging, pathological and treated tissues. We believe this review will assist readers not only in better understanding applications of FTIR, NIR and Raman spectroscopy, but also in implementing these approaches for their own research projects.