Undetected pan-assay interference compounds (PAINS) with false-positive activities in assays often propagate through medicinal chemistry programs and compromise their outcomes. Although a large number of PAINS have been classified, often on the basis of individual studies or chemical experience, little has been done so far to systematically assess their activity profiles. Herein we report a large-scale analysis of the behavior of PAINS in biological screening assays. More than 23 000 extensively tested compounds containing PAINS substructures were detected, and their hit rates were determined. Many consistently inactive compounds were identified. The hit frequency was low overall, with median values of two to five hits for PAINS tested in hundreds of assays. Only confined subsets of PAINS produced abundant hits. The same PAINS substructure was often found in consistently inactive and frequently active compounds, indicating that the structural context in which PAINS occur modulates their effects.