Evidence indicates that glucose variation (GV) plays an important role in mortality of critically ill patients. We aimed to investigate the relationship between the coefficient of variation of 24-h venous blood glucose (24-hVBGCV) and mortality among patients with acute respiratory failure. The records of 1625 patients in the Multiparameter Intelligent Monitoring in Intensive Care II (MIMIC II) database were extracted. The 24-hVBGCV was calculated as the ratio of the standard deviation (SD) to the mean venous blood glucose level, expressed as a percentage. The outcomes included ICU mortality and in-hospital mortality. Participants were divided into three subgroups based on tertiles of 24-hVBGCV. Multivariable logistic regression models were used to evaluate the relationship between 24-hVBGCV and mortality. Sensitivity analyses were also performed in groups of patients with and without diabetes mellitus. Taking the lowest tertile as a reference, after adjustment for all the covariates, the highest tertile was significantly associated with ICU mortality [odds ratio (OR), 1.353; 95% confidence interval (CI), 1.018–1.797] and in-hospital mortality (OR, 1.319; 95% CI, 1.003–1.735), especially in the population without diabetes. The 24-hVBGCV may be associated with ICU and in-hospital mortality in patients with acute respiratory failure in the ICU, especially in those without diabetes.