Heart rate variability (HRV) corresponds to the adaptation of the heart to any stimulus. In fact, among the pathologies affecting HRV the most, there are the cardiovascular diseases and depressive disorders, which are associated with high medical cost in Western societies. Consequently, HRV is now widely used as an index of health. In order to better understand how this adaptation takes place, it is necessary to examine which factors directly influence HRV, whether they have a physiological or environmental origin. The primary objective of this research is therefore to conduct a literature review in order to get a comprehensive overview of the subject. The system of these factors affecting HRV can be divided into the following five categories: physiological and pathological factors, environmental factors, lifestyle factors, non-modifiable factors and effects. The direct interrelationships between these factors and HRV can be regrouped into an influence diagram. This diagram can therefore serve as a basis to improve daily clinical practice as well as help design even more precise research protocols.