OBJECTIVES: This study aims to identify repeated previous shortcomings in medical imaging data collection, curation, and AI-based analysis during the early phase of respiratory pandemics. Based on the results, it seeks to highlight essential steps for improving future pandemic preparedness. MATERIALS AND METHODS: We searched PubMed/MEDLINE, Scopus, and Cochrane Reviews for articles published from January 1, 2000, to December 31, 2021, using the terms "imaging" or "radiology" or "radiography" or "CT" or "x-ray" combined with "SARS," "MERS," "H1N1," or "COVID-19." WHO and CDC Databases were searched for case definitions. RESULTS: Over the last 20 years, the world faced several international health emergencies caused by respiratory diseases such as SARS, MERS, H1N1, and COVID-19. During the same period, major technological advances enabled the analysis of vast amounts of imaging data and the continual development of artificial intelligence algorithms to support radiological diagnosis and prognosis. Timely availability of data proved critical, but so far, data collection attempts were initialized only as individual responses to each outbreak, leading to long delays and hampering unified guidelines and data-driven technology to support the management of pandemic outbreaks. Our findings highlight the multifaceted role of imaging in the early stages of SARS, MERS, H1N1, and COVID-19, and outline possible actions for advancing future pandemic preparedness. CONCLUSIONS: Advancing international cooperation and action on these topics is essential to create a functional, effective, and rapid counteraction system to future respiratory pandemics exploiting state of the art imaging and artificial intelligence. KEY POINTS: Question What has been the role of radiological data for diagnosis and prognosis in early respiratory pandemics and what challenges were present? Findings International cooperation is essential to developing an effective rapid response system for future respiratory pandemics using advanced imaging and artificial intelligence. Clinical relevance Strengthening global collaboration and leveraging cutting-edge imaging and artificial intelligence are crucial for developing rapid and effective response systems. This approach is essential for improving patient outcomes and managing future respiratory pandemics more effectively.