Mathematical models play an important role in the design of synthetic gene circuits, by guiding the choice of biological components and their assembly into novel gene networks. Here, we present a guide for biologists to build and utilize models of gene networks (synthetic or natural) to analyze dynamical properties of these networks while considering the low numbers of molecules inside cells that results in stochastic gene expression. We start by describing how to write down a model and discussing the level of details to include. We then briefly demonstrate how to simulate a network's dynamics using deterministic differential equations that assume high numbers of molecules. To consider the role of stochastic gene expression in single cells, we provide a detailed tutorial on running stochastic Gillespie simulations of a network, including instructions on coding the Gillespie algorithm with example code. Finally, we illustrate how using a combination of quantitative experimental characterization of a synthetic circuit and mathematical modeling can guide the iterative redesign of a synthetic circuit to achieve the desired properties. This is shown using a classic synthetic oscillator, the repressilator, which we recently redesigned into the most precise and robust synthetic oscillator to date. We thus provide a toolkit for synthetic biologists to build more precise and robust synthetic circuits, which should lead to a deeper understanding of the dynamics of gene regulatory networks.