The use of artificial intelligence (AI) holds great promise for radiation oncology, with many applications being reported in the literature, including some of which are already in clinical use. These are mainly in areas where AI provides benefits in efficiency (such as automatic segmentation and treatment planning). Prediction models that directly impact patient decision-making are far less mature in terms of their application in clinical practice. Part of the limited clinical uptake of these models may be explained by the need for broader knowledge, among practising clinicians within the medical community, about the processes of AI development. This lack of understanding could lead to low commitment to AI research, widespread scepticism, and low levels of trust. This attitude towards AI may be further negatively impacted by the perception that deep learning is a "black box" with inherently low transparency. Thus, there is an unmet need to train current and future clinicians in the development and application of AI in medicine. Improving clinicians' AI-related knowledge and skills is necessary to enhance multidisciplinary collaboration between data scientists and physicians, that is, involving a clinician in the loop during AI development. Increased knowledge may also positively affect the acceptance and trust of AI. This paper describes the necessary steps involved in AI research and development, and thus identifies the possibilities, limitations, challenges, and opportunities, as seen from the perspective of a practising radiation oncologist. It offers the clinician with limited knowledge and experience in AI valuable tools to evaluate research papers related to an AI model application.