Teaching and Research Area for Occupational Health Psychology, RWTH Aachen University, Aachen, Germany.
Biomed Res Int. 2019 Jun 12;2019:8382160. doi: 10.1155/2019/8382160. eCollection 2019.
The suitability of self-ratings and observer ratings within organisational management approaches is controversial. The aim of this study was to compare the degree of agreement between self-rated and observer-rated occupational psychosocial demands. The comparison took place within a work-activity and not worker-centred assessment, according to official policies for psychosocial risk assessment. Through simultaneous application of two versions of the same instrument, we aimed to reduce the rating bias to a minimum demonstrating the suitability of self-ratings and observer ratings in companies of all kinds.
A multimethod online assessment of 22 different work activities was conducted in Germany from October 2016 to October 2017. Workers (self-ratings) and occupational safety and health (OSH) committees (observer ratings) rated the occupational psychosocial risks of each activity with the same instrument ( = 669). The instrument measured psychosocial risk conditions at work. Reliability and agreement indices were computed.
The within-group agreement (WGA; = .42) of the workers' self-ratings was good for each psychosocial risk and the interrater reliability (IRR) was excellent on average ( = .77) with a medium effect size of = .15. The interrater agreement (IRA) between the two groups varied across the activities depending on rating group and activity composition (from = .39 to = .86) but was good to excellent on average ( = .71).
The reasonable agreement and excellent reliability in workers' self-ratings justify aggregation of item means at the group level. Furthermore, if the work activities are homogenous and the committee consists of members from different OSH specialties, observer ratings and self-ratings provide comparable results. According to this study's results, both methods are reliable assessment strategies in the context of psychosocial risk assessment. The observer rating approach is especially suitable for small-to-medium enterprises that do not have access to a large anonymous survey assessment.
在组织管理方法中,自评和他评的适用性存在争议。本研究旨在比较自评和他评职业心理社会需求的一致性程度。这种比较是在工作活动而不是工人为中心的评估中进行的,这符合心理社会风险评估的官方政策。通过同时应用同一工具的两个版本,我们旨在将评分偏差降至最低,证明自评和他评在各种类型的公司中都是适用的。
2016 年 10 月至 2017 年 10 月,在德国采用多方法在线评估了 22 种不同的工作活动。工人(自评)和职业安全与健康委员会(他评)使用相同的工具(=669)对每项活动的职业心理社会风险进行评分。该工具测量了工作中的心理社会风险条件。计算了可靠性和一致性指标。
工人自评的组内一致性(WGA;=0.42)对于每种心理社会风险都是良好的,平均而言,组间可靠性(IRR)非常好(=0.77),具有中等效应大小(=0.15)。两组之间的组间一致性(IRA)因评分组和活动组成而异(从=0.39 到=0.86),但平均而言,一致性良好到非常好(=0.71)。
工人自评的合理一致性和极好的可靠性证明了在群体水平上对项目均值进行聚合是合理的。此外,如果工作活动同质,且委员会由来自不同职业安全与健康专业的成员组成,那么他评和自评可提供可比的结果。根据本研究的结果,这两种方法都是心理社会风险评估背景下可靠的评估策略。他评方法特别适用于无法进行大规模匿名调查评估的中小微企业。