The Centre for Agroecology, Water and Resilience, Coventry University, Coventry, United Kingdom.
The Bumblebee Conservation Trust, Eastleigh, United Kingdom.
PLoS One. 2019 Jun 24;14(6):e0218614. doi: 10.1371/journal.pone.0218614. eCollection 2019.
Citizen science is an increasingly popular way of engaging volunteers in the collection of scientific data. Despite this, data quality remains a concern and there is little published evidence about the accuracy of records generated by citizen scientists. Here we compare data generated by two British citizen science projects, Blooms for Bees and BeeWatch, to determine the ability of volunteer recorders to identify bumblebee (Bombus) species. We assessed recorders' identification ability in two ways-as recorder accuracy (the proportion of expert-verified records correctly identified by recorders) and recorder success (the proportion of recorder-submitted identifications confirmed correct by verifiers). Recorder identification ability was low (<50% accuracy; <60% success), despite access to project specific bumblebee identification materials. Identification ability varied significantly depending on bumblebee species, with recorders most able to correctly identify species with distinct appearances. Blooms for Bees recorders (largely recruited from the gardening community) were markedly less able to identify bumblebees than BeeWatch recorders (largely individuals with a more specific interest in bumblebees). Within both projects, recorders demonstrated an improvement in identification ability over time. Here we demonstrate and quantify the essential role of expert verification within citizen science projects, and highlight where resources could be strengthened to improve recorder ability.
公民科学是一种越来越受欢迎的方式,可以让志愿者参与科学数据的收集。尽管如此,数据质量仍然是一个令人关注的问题,而且关于公民科学家生成的记录的准确性的证据很少。在这里,我们比较了两个英国公民科学项目——Blooms for Bees 和 BeeWatch 生成的数据,以确定志愿者记录员识别大黄蜂(Bombus)物种的能力。我们通过两种方式评估记录员的识别能力——记录员的准确性(经专家验证的记录中被记录员正确识别的比例)和记录员的成功率(记录员提交的识别结果中经核实者正确的比例)。尽管可以使用特定于项目的大黄蜂识别材料,但记录员的识别能力仍然很低(准确率<50%;成功率<60%)。识别能力因大黄蜂物种而异,记录员最能够正确识别外观明显不同的物种。Blooms for Bees 的记录员(主要从园艺社区招募)明显不如 BeeWatch 的记录员(主要是对大黄蜂有更具体兴趣的个人)能够识别大黄蜂。在这两个项目中,记录员的识别能力随着时间的推移有所提高。在这里,我们展示并量化了专家验证在公民科学项目中的重要作用,并强调了在哪些方面可以加强资源以提高记录员的能力。