Although inflammatory breast cancer (IBC) has poor overall survival (OS), there is little information about using imaging features for predicting the prognosis. Computed tomography (CT)-based texture analysis, a non-invasive technique to quantify tumor heterogeneity, could be a potentially useful imaging biomarker. The aim of the article was to investigate the usefulness of chest CT-based texture analysis to predict OS in IBC patients. Of the 3,130 patients with primary breast cancers between 2006 and 2016, 104 patients (3.3%) with IBC were identified. Among them, 98 patients who underwent pre-treatment contrast-enhanced chest CT scans, got treatment in our institution, and had a follow-up period of more than 2 years were finally included for CT-based texture analysis. Texture analysis was performed on CT images of 98 patients, using commercially available software by two breast radiologists. Histogram-based textural features, such as quantification of variation in CT attenuation (mean, standard deviation, mean of positive pixels [MPP], entropy, skewness, and kurtosis), were recorded. To dichotomize textural features for survival analysis, receiver operating characteristic curve analysis was used to determine cutoff points. Clinicopathologic variables, such as age, node stage, metastasis stage at the time of diagnosis, hormonal receptor positivity, human epidermal growth factor receptor 2 positivity, and molecular subtype, were assessed. A Cox proportional hazards model was used to determine the association of textural features and clinicopathologic variables with OS. During a mean follow-up period of 47.9 months, 41 of 98 patients (41.8%) died, with a median OS of 20.0 months. The textural features of lower mean attenuation, standard deviation, MPP, and entropy on CT images were significantly associated with worse OS, as was the M1 stage among clinicopathologic variables (all values < 0.05). In multivariate analysis, lower mean attenuation (hazard ratio [HR], 3.26; = 0.003), lower MPP (HR, 3.03; = 0.002), and lower entropy (HR, 2.70; = 0.009) on chest CT images were significant factors independent from the M1 stage for predicting worse OS. Lower mean attenuation, MPP, and entropy on chest CT images predicted worse OS in patients with IBC, suggesting that CT-based texture analysis provides additional predictors for OS.