Suppr超能文献

错误信息易感性测试(MIST):一种经过心理测量学验证的新闻真实性辨别衡量标准。

The Misinformation Susceptibility Test (MIST): A psychometrically validated measure of news veracity discernment.

机构信息

Department of Psychology, University of Cambridge, Downing Street, CB2 3EB, Cambridge, Cambridgeshire, UK.

Department of Psychology, University of British Columbia, 2136 West Mall, Vancouver, BC, V6T 1Z4, Canada.

出版信息

Behav Res Methods. 2024 Mar;56(3):1863-1899. doi: 10.3758/s13428-023-02124-2. Epub 2023 Jun 29.

Abstract

Interest in the psychology of misinformation has exploded in recent years. Despite ample research, to date there is no validated framework to measure misinformation susceptibility. Therefore, we introduce Verification done, a nuanced interpretation schema and assessment tool that simultaneously considers Veracity discernment, and its distinct, measurable abilities (real/fake news detection), and biases (distrust/naïvité-negative/positive judgment bias). We then conduct three studies with seven independent samples (N = 8504) to show how to develop, validate, and apply the Misinformation Susceptibility Test (MIST). In Study 1 (N = 409) we use a neural network language model to generate items, and use three psychometric methods-factor analysis, item response theory, and exploratory graph analysis-to create the MIST-20 (20 items; completion time < 2 minutes), the MIST-16 (16 items; < 2 minutes), and the MIST-8 (8 items; < 1 minute). In Study 2 (N = 7674) we confirm the internal and predictive validity of the MIST in five national quota samples (US, UK), across 2 years, from three different sampling platforms-Respondi, CloudResearch, and Prolific. We also explore the MIST's nomological net and generate age-, region-, and country-specific norm tables. In Study 3 (N = 421) we demonstrate how the MIST-in conjunction with Verification done-can provide novel insights on existing psychological interventions, thereby advancing theory development. Finally, we outline the versatile implementations of the MIST as a screening tool, covariate, and intervention evaluation framework. As all methods are transparently reported and detailed, this work will allow other researchers to create similar scales or adapt them for any population of interest.

摘要

近年来,人们对错误信息心理学的兴趣大增。尽管研究成果颇丰,但截至目前,仍缺乏有效的框架来衡量错误信息易感性。因此,我们引入了“Verification done”,这是一种细致入微的解释模式和评估工具,它同时考虑了准确性识别,以及其独特的、可衡量的能力(真假新闻检测)和偏差(不信任/天真——负面/正面判断偏差)。然后,我们进行了三项研究,涉及七个独立样本(N=8504),以展示如何开发、验证和应用错误信息易感性测试(MIST)。在研究 1(N=409)中,我们使用神经网络语言模型生成项目,并使用三种心理测量方法——因素分析、项目反应理论和探索性图分析——创建 MIST-20(20 个项目;完成时间<2 分钟)、MIST-16(16 个项目;<2 分钟)和 MIST-8(8 个项目;<1 分钟)。在研究 2(N=7674)中,我们在两年内,从三个不同的采样平台——Respondi、CloudResearch 和 Prolific,在五个国家配额样本(美国、英国)中,确认了 MIST 的内部和预测有效性。我们还探讨了 MIST 的关联网络,并生成了年龄、地区和国家特定的规范表。在研究 3(N=421)中,我们展示了 MIST——与 Verification done 结合使用——如何为现有的心理干预措施提供新的见解,从而推进理论发展。最后,我们概述了 MIST 作为一种筛选工具、协变量和干预评估框架的多种实现方式。由于所有方法都透明地报告并详细说明,因此这项工作将允许其他研究人员创建类似的量表或针对任何感兴趣的人群进行改编。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/e3c9/10991074/d662865e932a/13428_2023_2124_Fig1_HTML.jpg

相似文献

1
The Misinformation Susceptibility Test (MIST): A psychometrically validated measure of news veracity discernment.
Behav Res Methods. 2024 Mar;56(3):1863-1899. doi: 10.3758/s13428-023-02124-2. Epub 2023 Jun 29.
3
Effects of inductive learning and gamification on news veracity discernment.
J Exp Psychol Appl. 2023 Sep;29(3):599-619. doi: 10.1037/xap0000458. Epub 2023 Mar 2.
4
A Signal Detection Approach to Understanding the Identification of Fake News.
Perspect Psychol Sci. 2022 Jan;17(1):78-98. doi: 10.1177/1745691620986135. Epub 2021 Jul 15.
5
Cognitive Processes and Personality Traits Underlying Four Phenotypes of Susceptibility to (Mis)Information.
Front Psychiatry. 2022 Jun 15;13:912397. doi: 10.3389/fpsyt.2022.912397. eCollection 2022.
7
How Can Psychological Science Help Counter the Spread of Fake News?
Span J Psychol. 2021 Apr 12;24:e25. doi: 10.1017/SJP.2021.23.
8
Emotion may predict susceptibility to fake news but emotion regulation does not seem to help.
Cogn Emot. 2022 Sep;36(6):1166-1180. doi: 10.1080/02699931.2022.2090318. Epub 2022 Jun 24.

引用本文的文献

1
The Online Misinformation Susceptibility Scale: Development and Initial Validation.
Healthcare (Basel). 2025 Sep 8;13(17):2252. doi: 10.3390/healthcare13172252.
2
Investigating the long-term impact of misinformation interventions in upper secondary education.
PLoS One. 2025 Jul 9;20(7):e0326928. doi: 10.1371/journal.pone.0326928. eCollection 2025.
4
Psychological booster shots targeting memory increase long-term resistance against misinformation.
Nat Commun. 2025 Mar 11;16(1):2062. doi: 10.1038/s41467-025-57205-x.
5
Spotting false news and doubting true news: a systematic review and meta-analysis of news judgements.
Nat Hum Behav. 2025 Apr;9(4):688-699. doi: 10.1038/s41562-024-02086-1. Epub 2025 Feb 21.
7
Continued influence of false accusations in forming impressions of political candidates.
PNAS Nexus. 2024 Nov 1;3(11):pgae490. doi: 10.1093/pnasnexus/pgae490. eCollection 2024 Nov.
8
The impact of confirmation bias awareness on mitigating susceptibility to misinformation.
Front Public Health. 2024 Oct 15;12:1414864. doi: 10.3389/fpubh.2024.1414864. eCollection 2024.
9
Building public trust in preparation for future health shocks: a research agenda.
BMJ. 2024 Oct 7;387:e078464. doi: 10.1136/bmj-2023-078464.

本文引用的文献

1
Disentangling Item and Testing Effects in Inoculation Research on Online Misinformation: Solomon Revisited.
Educ Psychol Meas. 2021 Apr;81(2):340-362. doi: 10.1177/0013164420940378. Epub 2020 Jul 16.
2
Transformer-Based Deep Neural Language Modeling for Construct-Specific Automatic Item Generation.
Psychometrika. 2022 Jun;87(2):749-772. doi: 10.1007/s11336-021-09823-9. Epub 2021 Dec 14.
3
Illusory Essences: A Bias Holding Back Theorizing in Psychological Science.
Perspect Psychol Sci. 2022 Mar;17(2):491-506. doi: 10.1177/1745691621991838. Epub 2021 Jul 20.
4
A Signal Detection Approach to Understanding the Identification of Fake News.
Perspect Psychol Sci. 2022 Jan;17(1):78-98. doi: 10.1177/1745691620986135. Epub 2021 Jul 15.
5
Small Effects: The Indispensable Foundation for a Cumulative Psychological Science.
Perspect Psychol Sci. 2022 Jan;17(1):205-215. doi: 10.1177/1745691620984483. Epub 2021 Jul 2.
6
How Accurate Are Accuracy-Nudge Interventions? A Preregistered Direct Replication of Pennycook et al. (2020).
Psychol Sci. 2021 Jul;32(7):1169-1178. doi: 10.1177/09567976211024535. Epub 2021 Jun 11.
7
How Can Psychological Science Help Counter the Spread of Fake News?
Span J Psychol. 2021 Apr 12;24:e25. doi: 10.1017/SJP.2021.23.
8
The Psychology of Fake News.
Trends Cogn Sci. 2021 May;25(5):388-402. doi: 10.1016/j.tics.2021.02.007. Epub 2021 Mar 15.
9
Shifting attention to accuracy can reduce misinformation online.
Nature. 2021 Apr;592(7855):590-595. doi: 10.1038/s41586-021-03344-2. Epub 2021 Mar 17.
10
The echo chamber effect on social media.
Proc Natl Acad Sci U S A. 2021 Mar 2;118(9). doi: 10.1073/pnas.2023301118.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验