The ability to detect and monitor amyloid deposition in the brain using non-invasive imaging techniques provides valuable insights into the early diagnosis and progression of Alzheimer's disease and helps to evaluate the efficacy of potential treatments. Magnetic resonance imaging (MRI) is a widely available technique offering high-spatial-resolution imaging. It can be used to visualize amyloid deposits with the help of amyloid-binding diagnostic agents injected into the body. In recent years, a number of amyloid-targeted MRI probes have been developed, but none of them has entered clinical practice. We review the advances in the field and deduce the requirements for the molecular structure and properties of a diagnostic probe candidate. These requirements make up the base for the rational design of MRI-active small molecules targeting amyloid deposits. Particular attention is paid to the novel cryo-EM structures of the fibril aggregates and their complexes, with known binders offering the possibility to use computational structure-based design methods. With continued research and development, MRI probes may revolutionize the diagnosis and treatment of neurodegenerative diseases, ultimately improving the lives of millions of people worldwide.