Background Diabetes mellitus (DM) is one of the most common diseases worldwide and affects many patients all over the globe. Diabetic complications vary between microvascular and macrovascular, affecting a wide range of organs and systems in the body. Understanding, determining, and in return, preventing such factors is essential to alleviate the quality of life of diabetic patients. Therefore, we aim to determine the poor glycemic control and the factors associated with it in our diabetes population. Methods This is a retrospective study where data was reviewed for all patients with Type II DM (T2DM) who attended the chronic illness clinic at King Khaled Hospital in Tabuk. We included patients aged ≥ 18 years, of Saudi nationality, and residents of the Tabuk region. Any patient not satisfying all the inclusion criteria was excluded from the current study. Diagnosis with diabetes was made according to the American Diabetes Association guidelines, 2020. Patients' demographic data, medical history, and social and lifestyle history were extracted from records. In addition, age, body mass index (BMI), drugs (insulin vs. oral hypoglycemic agents), duration of the disease, lipid profile, and other comorbidities were also extracted from the files. A p-value of <0.05 was selected as the statistically significant level in all tests. Results A total of 697 patients were included in the current study, with a mean age of 58.2±11.6 years. The mean glycosylated hemoglobin (HbA1c) of the study participants was 8.4±1.7%, and their fasting blood sugar (FBS) level was 9.9±3.9 mmol/l. With HbA1c cut-off at 7%, the overall prevalence of poor glycemic control was 81.5% (565/693). A higher prevalence of poor glycemic control was reported among study participants with higher DM duration (p=0.002). Diabetes complications were found in 208 (29.8%) of the study participants, where microvascular complications were present in 140 patients, and microvascular ones were found in 102. In the logistic regression model, older patients were less prone to poor glycemic control (OR=0.98; 95% CI=0.96-0.99; p=0.010). In addition, longer disease duration was a predictive factor of poor glycemic control (OR=1.05; 95% CI=1.02-1.08; p=0.003). Furthermore, the usage of combined insulin and tablet treatments were associated with a higher risk of poor glycemic control when compared to insulin only treatments (OR=4.65; 95% CI=1.55-13.94; p=0.006). Conclusion The results of this study indicate a high prevalence rate of poor glycemic control among Saudi patients, which is higher than previous reports have shown. More interest should be given to awareness programs with regard to promoting self-control protocols for the disease.