Calculating the dynamic properties of magnetization of single-domain particles is of great importance for the tomographic imaging modality known as magnetic particle imaging (MPI). Although the assumption of instantaneous thermodynamic equilibrium (Langevin function) after application of time-dependent magnetic fields is sufficient for understanding the fundamental behavior, it is essential to consider the finite response times of magnetic particles for optimizing or analyzing various aspects, e.g. interpreting spectra, optimizing MPI sequences, developing new contrasts, and evaluating simplified models. The change in magnetization following the application of the fields is caused by two different movements: the geometric rotation of the particle and the rotation of magnetization with respect to the fixed particle axes. These individual rotations can be well described using the Langevin equations or the Fokker-Planck equation. However, because the two rotations generally exhibit interdependence, it is necessary to consider coupling between the two equations. This article shows how a coupled Fokker-Planck equation can be derived on the basis of coupled Langevin equations. Two physically equivalent Fokker-Planck equations are derived and transformed by means of an appropriate series expansion into a system of ordinary differential equations, which can be solved numerically. Finally, this system is also used to specify a system of differential equations for various limiting cases (Néel, Brown, uniaxial symmetry). Generally, the system exhibits a sparsely populated matrix and can therefore be handled well numerically.