Over the past three decades, immunodeficient mouse models carrying human immune cells, with or without human lymphoid tissues, termed humanized immune system (HIS) rodent models, have been developed to recapitulate the human immune system and associated immune responses. HIS mouse models have successfully modeled many human-restricted viral infections, including those caused by human cytomegalovirus (HCMV) and human immunodeficiency virus (HIV). HIS mouse models have also been used to model human cancer immunobiology, which exhibits differences from murine cancers in traditional mouse models. Variants of HIS mouse models that carry human liver cells, lung tissue, skin tissue, or human patient-derived tumor xenografts and human hematopoietic stem cells-derived-human immune cells with or without lymphoid tissue xenografts have been developed to probe human immune responses to infections and human tumors. HCMV-based vaccines are human-restricted, which poses limitations for mechanistic and efficacy studies using traditional animal models. The HCMV-based vaccine approach is a promising vaccine strategy as it induces robust effector memory T cell responses that may be critical in preventing and rapidly controlling persistent viral infections and cancers. Here, we review novel HIS mouse models with robust human immune cell development and primary and secondary lymphoid tissues that could address many of the limitations of HIS mice in their use as animal models for HCMV-based vaccine research. We also reviewed novel HIS rat models, which could allow long-term (greater than one year) vaccinology studies and better recapitulate human pathophysiology. Translating laboratory research findings to clinical application is a significant bottleneck in vaccine development; HIS rodents and related variants that more accurately model human immunology and diseases could increase the translatability of research findings.