ObjectiveThe aim of this study was to determine the status of glycemic control and identify factors associated with poor glycemic control among diabetic out-patients.ResultsA hospital based cross-sectional study was conducted among randomly selected 384 (126 type 1 and 258 type 2) diabetic adults attending a hospital in Northeast Ethiopia from January 1 to April 30, 2017. Of the total participants, 70.8% had poor status of glycemic control (defined as mean fasting blood glucose level above 130 mg/dl). In the multivariate analysis, rural residence (AOR = 2.61, 95% CI 1.37–4.96), low educational level (AOR = 7.10, 95% CI 2.94–17.17) and longer duration of diabetes (AOR = 2.20, 95% CI 1.18–4.08) were significantly associated with increased odds of poor glycemic control. Moreover, merchants (AOR = 3.39, 95% CI 1.16–9.96) were significantly more likely to have poor glycemic control compared to government employee. Diabetic patients receiving oral anti-diabetics (AOR = 5.12, 95% CI 2.10–12.52) or insulin (AOR = 3.26, 95% CI 1.26–8.48) were more likely to be poorly controlled. These results highlight the needed for appropriate management of patients focusing on associated factors identified for poor glycemic control to maintain good glycemic control and improve adverse outcomes of the disease in this study setting.