The ubiquity of bacteriophages (phages) and the major evolutionary and ecological impacts they can have on their microbial hosts has resulted in phages often cited as key drivers shaping microbial community composition (the relative abundances of species). However, the evidence for the importance of phages is mixed. Here, we critically review the theory and data exploring the role of phages in communities, identifying the conditions when phages are likely to be important drivers of community composition. At ecological scales, we conclude that phages are often followers rather than drivers of microbial population and community dynamics. While phages can affect strain diversity within species, there is yet to be strong evidence suggesting that fluctuations in species' strains affects community composition.