The induction and repair of DNA double-strand breaks (DSBs) are critical factors in the treatment of cancer by radiotherapy. To investigate the relationship between incident radiation and cell death through DSB induction many in silico models have been developed. These models produce and use custom formats of data, specific to the investigative aims of the researchers, and often focus on particular pairings of damage and repair models. In this work we use a standard format for reporting DNA damage to evaluate combinations of different, independently developed, models. We demonstrate the capacity of such inter-comparison to determine the sensitivity of models to both known and implicit assumptions. Specifically, we report on the impact of differences in assumptions regarding patterns of DNA damage induction on predicted initial DSB yield, and the subsequent effects this has on derived DNA repair models. The observed differences highlight the importance of considering initial DNA damage on the scale of nanometres rather than micrometres. We show that the differences in DNA damage models result in subsequent repair models assuming significantly different rates of random DSB end diffusion to compensate. This in turn leads to disagreement on the mechanisms responsible for different biological endpoints, particularly when different damage and repair models are combined, demonstrating the importance of inter-model comparisons to explore underlying model assumptions.