BACKGROUND AND AIMS: Preterm birth imposes a high risk for developing neuromotor delay. Earlier prediction of adverse outcome in preterm infants is crucial for referral to earlier intervention. This study aimed to predict abnormal motor outcome at 2 years from early brain diffusion magnetic resonance imaging (MRI) acquired between 29 and 35 weeks postmenstrual age (PMA) using a deep learning convolutional neural network (CNN) model. METHODS: Seventy-seven very preterm infants (born <31 weeks gestational age (GA)) in a prospective longitudinal cohort underwent diffusion MR imaging (3T Siemens Trio; 64 directions, b ​= ​2000 ​s/mm). Motor outcome at 2 years corrected age (CA) was measured by Neuro-Sensory Motor Developmental Assessment (NSMDA). Scores were dichotomised into normal (functional score: 0, normal; n ​= ​48) and abnormal scores (functional score: 1-5, mild-profound; n ​= ​29). MRIs were pre-processed to reduce artefacts, upsampled to 1.25 ​mm isotropic resolution and maps of fractional anisotropy (FA) were estimated. Patches extracted from each image were used as inputs to train a CNN, wherein each image patch predicted either normal or abnormal outcome. In a postprocessing step, an image was classified as predicting abnormal outcome if at least 27% (determined by a grid search to maximise the model performance) of its patches predicted abnormal outcome. Otherwise, it was considered as normal. Ten-fold cross-validation was used to estimate performance. Finally, heatmaps of model predictions for patches in abnormal scans were generated to explore the locations associated with abnormal outcome. RESULTS: For the identification of infants with abnormal motor outcome based on the FA data from early MRI, we achieved mean sensitivity 70% (standard deviation SD 19%), mean specificity 74% (SD 39%), mean AUC (area under the receiver operating characteristic curve) 72% (SD 14%), mean F1 score of 68% (SD 13%) and mean accuracy 73% (SD 19%) on an unseen test data set. Patch-based prediction heatmaps showed that the patches around the motor cortex and somatosensory regions were most frequently identified by the model with high precision (74%) as a location associated with abnormal outcome. Part of the cerebellum, and occipital and frontal lobes were also highly associated with abnormal NSMDA/motor outcome. DISCUSSION/CONCLUSION: This study established the potential of an early brain MRI-based deep learning CNN model to identify preterm infants at risk of a later motor impairment and to identify brain regions predictive of adverse outcome. Results suggest that predictions can be made from FA maps of diffusion MRIs well before term equivalent age (TEA) without any prior knowledge of which MRI features to extract and associated feature extraction steps. This method, therefore, is suitable for any case of brain condition/abnormality. Future studies should be conducted on a larger cohort to re-validate the robustness and effectiveness of these models.