Laboratory of Applied Artificial Intelligence on Health, Department of Anesthesiology, Botucatu Medical School, São Paulo State University (Unesp), Botucatu, São Paulo, Brazil.
Extension Department, University of Missouri, Columbia, Missouri, United States of America.
PLoS One. 2024 Sep 4;19(9):e0309684. doi: 10.1371/journal.pone.0309684. eCollection 2024.
Behavioral pain scales have been helpful for standardized swine pain assessment. However, it is still unknown if observers' experience influences the scale score. We conducted a pilot study to investigate how three different levels of swine experience influenced how observers scored castration pain in piglets using Unesp-Botucatu Pig Composite Acute Pain Scale (UPAPS). We used a database from UPAPS scores from pigs undergoing surgical castration in a previous study. Scores were attributed by six observers with Little to no experience (n = 2), Some experience (n = 2) and Extensive experience (n = 2). Reliability was estimated using the intraclass correlation coefficient, agreement was investigated by Bland-Altman analysis, predictive capacity was estimated using the area under the curve (AUC), and statistical differences were tested using a regression model. We found that intra-experience levels reliability were satisfactory (Little to no: 0.72, Some: 0.81, Extensive: 0.84), but inter-experience reliability was lower (0.42). Little to no experience observers had poor agreement with other observers, with a bias toward underscoring UPAPS (bias of 0.94 vs. Some, 1.17 vs. Extensive). Predictive capacity was similar between all observers (AUC, Little to no: 71.94%, Some: 76.10%, Extensive: 79.09%, p > 0.05). Regression model confirmed underscoring of Little to no experience observers (mean ± standard error; Little to no: 1.09 ± 0.14; Some: 2.02 ± 0.23; Extensive: 2.25 ± 0.22; p < 0.05). We concluded that minimal experience, as Some experience observers have in the swine industry, is sufficient for them to score UPAPS in a similar way than more experienced observers. The present pilot study supports the enhancement and implementation of UPAPS on farm and laboratory settings by minimally qualified observers, improving swine welfare in the short and long term.
行为疼痛量表有助于对猪的疼痛进行标准化评估。然而，观察者的经验是否会影响评分仍不清楚。我们进行了一项初步研究，旨在使用 Unesp-Botucatu 猪综合急性疼痛量表（UPAPS）调查三种不同水平的猪经验如何影响观察者对仔猪去势疼痛的评分。我们使用了之前一项研究中接受手术去势的猪的 UPAPS 评分数据库。评分由六名观察者进行，分别为经验很少（n=2）、有一些经验（n=2）和经验丰富（n=2）。使用组内相关系数估计可靠性，通过 Bland-Altman 分析研究一致性，使用曲线下面积（AUC）估计预测能力，并使用回归模型测试统计学差异。我们发现，内部经验水平的可靠性令人满意（经验很少：0.72，有一些经验：0.81，经验丰富：0.84），但外部经验的可靠性较低（0.42）。经验很少的观察者与其他观察者的一致性较差，对 UPAPS 的评分偏低（偏差为 0.94 与有一些经验，1.17 与经验丰富）。所有观察者的预测能力相似（AUC，经验很少：71.94%，有一些经验：76.10%，经验丰富：79.09%，p>0.05）。回归模型证实了经验很少的观察者的评分偏低（平均值±标准误差；经验很少：1.09±0.14；有一些经验：2.02±0.23；经验丰富：2.25±0.22；p<0.05）。我们得出结论，最小经验（如猪产业中的一些经验）足以使观察者以与更有经验的观察者相似的方式对 UPAPS 进行评分。本初步研究支持在农场和实验室环境中由合格程度较低的观察者增强和实施 UPAPS，从而在短期和长期内提高猪的福利。
