BACKGROUND: Patients with rectal cancer who have enlarged lateral lymph nodes (LLNs) have an increased risk of lateral local recurrence (LLR). However, little is known about prognostic implications of malignant features (internal heterogeneity, irregular margins, loss of fatty hilum, and round shape) on MRI and number of enlarged LLNs, in addition to LLN size. METHODS: Of the 3,057 patients with rectal cancer included in this national, retrospective, cross-sectional cohort study, 284 with a cT3-4 tumor located ≤8 cm from the anorectal junction who received neoadjuvant treatment and who had visible LLNs on MRI were selected. Imaging was reassessed by trained radiologists. LLNs were categorized based on size. Influence of malignant features and the number of LLNs on LLR was investigated. RESULTS: Of 284 patients with at least 1 visible LLN, 122 (43%) had an enlarged node (≥7.0 mm) and 157 (55%) had malignant features. Of the 122 patients with enlarged nodes, 25 had multiple (≥2). In patients with a single enlarged node (n=97), a single malignant feature was associated with a 4-year LLR rate of 0% and multiple malignant features was associated with a rate of 17% (P=.060). In the group with multiple malignant features, their disappearance on restaging was associated with an LLR rate of 13% compared with an LLR rate of 20% for persistent malignant features (P=.532). The presence of intermediate-size LLNs (5.0-6.9 mm) with at least 1 malignant feature was associated with a 4-year LLR rate of 8%; the 4-year LLR rate was 13% when the malignant features persisted on restaging MRI (P=.409). Patients with multiple enlarged LLNs had a 4-year LLR rate of 28% compared with 11% for those with a single enlarged LLN (P=.059). CONCLUSIONS: The presence of multiple enlarged LLNs (≥7.0 mm), as well as multiple malignant features in an enlarged node contribute to the risk of developing an LLR. These radiologic features can be used for clinical decision-making regarding the potential benefit of LLN dissection.