Aphantasia refers to reduced or absent visual imagery. While most of us can readily recall decade-old personal experiences (autobiographical memories, AM) with vivid mental images, there is a dearth of information about whether the loss of visual imagery in aphantasics affects their AM retrieval. The hippocampus is thought to be a crucial hub in a brain-wide network underlying AM. One important question is whether this network, especially the connectivity of the hippocampus, is altered in aphantasia. In the current study, we tested 14 congenital aphantasics and 16 demographically matched controls in an AM fMRI task to investigate how key brain regions (i.e. hippocampus and visual-perceptual cortices) interact with each other during AM re-experiencing. All participants were interviewed regarding their autobiographical memory to examine their episodic and semantic recall of specific events. Aphantasics reported more difficulties in recalling AM, were less confident about their memories, and described less internal and emotional details than controls. Neurally, aphantasics displayed decreased hippocampal and increased visual-perceptual cortex activation during AM retrieval compared to controls. In addition, controls showed strong negative functional connectivity between the hippocampus and the visual cortex during AM and resting-state functional connectivity between these two brain structures predicted better visualization skills. Our results indicate that visual mental imagery plays an important role in detail-rich vivid AM, and that this type of cognitive function is supported by the functional connection between the hippocampus and the visual-perceptual cortex.