The paternal environment prior to conception has been demonstrated to influence offspring physiology and behavior, with the sperm epigenome (including noncoding RNAs) proposed as a potential facilitator of non-genetic inheritance. Whilst the maternal gut microbiome has been established as an important influence on offspring development, the impact of the paternal gut microbiome on offspring development, health and behavior is largely unknown. Gut microbiota have major influences on immunity, and thus we hypothesized that they may be relevant to paternal immune activation (PIA) modulating epigenetic inheritance in mice. Therefore, male C57BL/6J mice (F0) were orally administered non-absorbable antibiotics via drinking water in order to substantially deplete their gut microbiome. Four weeks after administration of the antibiotics (gut microbiome depletion), F0 male mice were then mated with naïve female mice. The F1 offspring of the microbiome-depleted males had reduced body weight as well as altered gut morphology (shortened colon length). F1 females showed significant alterations in affective behaviors, including measures of anxiety and depressive-like behaviors, indicating altered development. Analysis of small noncoding RNAs in the sperm of F0 mice revealed that gut microbiome depletion is associated with differential expression of 8 different PIWI-interacting RNAs (piRNAs), each of which has the potential to modulate the expression of multiple downstream gene targets, and thus influence epigenetic inheritance and offspring development. This study demonstrates that the gut-germline axis influences sperm small RNA profiles and offspring physiology, with specific impacts on offspring affective and/or coping behaviors. These findings may have broader implications for other animal species with comparable gut microbiota, intergenerational epigenetics and developmental biology, including humans.