PURPOSE: Treatment effect or radiation necrosis after stereotactic radiosurgery (SRS) for brain metastases is a common phenomenon often indistinguishable from true progression. Radiomics is an emerging field that promises to improve on conventional imaging. In this study, we sought to apply a radiomics-based prediction model to the problem of diagnosing treatment effect after SRS. METHODS AND MATERIALS: We included patients in the Johns Hopkins Health System who were treated with SRS for brain metastases who subsequently underwent resection for symptomatic growth. We also included cases of likely treatment effect in which lesions grew but subsequently regressed spontaneously. Lesions were segmented semiautomatically on preoperative T1 postcontrast and T2 fluid-attenuated inversion recovery magnetic resonance imaging, and radiomic features were extracted with software developed in-house. Top-performing features on univariate logistic regression were entered into a hybrid feature selection/classification model, IsoSVM, with parameter optimization and further feature selection performed using leave-one-out cross-validation. Final model performance was assessed by 10-fold cross-validation with 100 repeats. All cases were independently reviewed by a board-certified neuroradiologist for comparison. RESULTS: We identified 82 treated lesions across 66 patients, with 77 lesions having pathologic confirmation. There were 51 radiomic features extracted per segmented lesion on each magnetic resonance imaging sequence. An optimized IsoSVM classifier based on top-ranked radiomic features had sensitivity and specificity of 65.38% and 86.67%, respectively, with an area under the curve of 0.81 on leave-one-out cross-validation. Only 73% of cases were classifiable by the neuroradiologist, with a sensitivity of 97% and specificity of 19%. CONCLUSIONS: Radiomics holds promise for differentiating between treatment effect and true progression in brain metastases treated with SRS. A predictive model built on radiomic features from an institutional cohort performed well on cross-validation testing. These results warrant further validation in independent datasets. Such work could prove invaluable for guiding management of individual patients and assessing outcomes of novel interventions.