Hepatitis E virus (HEV) is the leading cause of acute hepatitis worldwide. While the transmission in developing countries is dominated by fecal-oral route via drinking contaminated water, the zoonotic transmission is the major route of HEV infection in industrialized countries. The discovery of new HEV strains in a growing number of animal species poses a risk to zoonotic infection. However, the exact mechanism and the determinant factors of zoonotic infection are not completely understood. This review will discuss the current knowledge on the mechanism of cross-species transmission of HEV infection, including viral determinants, such as the open reading frames (ORFs), codon usage and adaptive evolution, as well as host determinants, such as host cellular factors and the host immune status, which possibly play pivotal roles during this event. The pathogenesis of hepatitis E infection will be briefly discussed, including the special forms of this disease, including extrahepatic manifestations, chronic infection, and fulminant hepatitis in pregnant women.