The NADase SARM1 (sterile alpha and TIR motif containing 1) is a key executioner of axon degeneration and a therapeutic target for several neurodegenerative conditions. We show that a potent SARM1 inhibitor undergoes base exchange with the nicotinamide moiety of nicotinamide adenine dinucleotide (NAD) to produce the bona fide inhibitor 1AD. We report structures of SARM1 in complex with 1AD, NAD mimetics and the allosteric activator nicotinamide mononucleotide (NMN). NMN binding triggers reorientation of the armadillo repeat (ARM) domains, which disrupts ARM:TIR interactions and leads to formation of a two-stranded TIR domain assembly. The active site spans two molecules in these assemblies, explaining the requirement of TIR domain self-association for NADase activity and axon degeneration. Our results reveal the mechanisms of SARM1 activation and substrate binding, providing rational avenues for the design of new therapeutics targeting SARM1.