Recent advancements in artificial intelligence (AI) in the domain of radiation therapy (RT) and their integration into modern software-based systems raise new challenges to the profession of medical physics experts. These AI algorithms are typically data-driven, may be continuously evolving, and their behavior has a degree of (acceptable) uncertainty due to inherent noise in training data and the substantial number of parameters that are used in the algorithms. These characteristics request adaptive, and new comprehensive quality assurance (QA) approaches to guarantee the individual patient treatment quality during AI algorithm development and subsequent deployment in a clinical RT environment. However, the QA for AI-based systems is an emerging area, which has not been intensively explored and requires interactive collaborations between medical doctors, medical physics experts, and commercial/research AI institutions. This article summarizes the current QA methodologies for AI modules of every subdomain in RT with further focus on persistent shortcomings and upcoming key challenges and perspectives.