Alzheimer's disease (AD) is the most common cause of dementia. Previous studies have found disrupted resting state functional connectivities (rsFCs) in various brain networks in the AD patients. However, few studies have focused on the rsFCs of the cerebellum and its sub-regions in the AD patients. In this study, we collected resting-state functional magnetic resonance imaging (rs-fMRI) data including 32 AD patients and 38 healthy controls (HCs). We selected two cognitive-related subregions of the cerebellum as seed region and mapped the whole-brain rsFCs for each subregion. We identified several distinct rsFC patterns of the two cognitive-related cerebellar subregions: default-mode network (DMN), frontoparietal network (FPN), visual network (VN) and sensorimotor network (SMN). Compared with the controls, the AD patients showed disrupted rsFCs in several different networks (DMN, VN and SMN), predicting the impairment of the functional integration in the cerebellum. Notably, these abnormal rsFCs of the two cerebellar subregions were closely associated with cognitive performance. Collectively, we demonstrated the distinct rsFCs patterns of cerebellar sub-regions with various functional networks, which were differentially impaired in the AD patients.