Reliable measurements are central to understanding animal-directed empathy. This research study utilizes data from two online surveys to evaluate the validity and reliability of measures of animal-directed empathy. The survey data was of (1) Canadians who have participated in beef cattle processing events ( = 812), and (2) members of the public from across Canada ( = 668). As a part of these surveys, individuals were asked 22 animal empathy score (AES) questions, and an additional 5 questions about livestock-directed empathy (LES). The AES correlated well with an 8-question short form (AES-SF) previously developed in other studies. Confirmatory factor analysis showed that the AES-SF structure was a good fit within the public responses but did not fit well with the responses of those participating in the beef industry. The reliability of the AES and AES-SF was high in the public population, but low in the population participating in beef cattle production. The LES fit well with the public responses, with high reliability and moderate correlation with AES; however, it did not fit well within the industry participant responses. Overall, the results support the use of AES-SF as a measure of animal-directed empathy within public populations. Measurement of this construct needs further development for individuals working directly with livestock species. Researchers should proceed with caution in using animal-directed psychometric measures validated with public populations, as evidence from this study suggests these measures have poor reliability and validity in populations of individuals working directly with livestock species.