Institute for Defense Analyses.
J Soc Psychol. 2020 Nov 1;160(6):735-750. doi: 10.1080/00224545.2020.1749020. Epub 2020 Apr 16.
Trust is a key determinant of whether people rely on automated systems in the military and the public. However, there is currently no standard for measuring trust in automated systems. In the present studies, we propose a scale to measure trust in automated systems that is grounded in current research and theory on trust formation, which we refer to as the Trust in Automated Systems Test (TOAST). We evaluated both the reliability of the scale structure and criterion validity using independent, military-affiliated and civilian samples. In both studies we found that the TOAST exhibited a two-factor structure, measuring system understanding and performance (respectively), and that factor scores significantly predicted scores on theoretically related constructs demonstrating clear criterion validity. We discuss the implications of our findings for advancing the empirical literature and in improving interface design.
信任是人们是否依赖军事和公共领域自动化系统的关键决定因素。然而,目前还没有衡量对自动化系统信任的标准。在本研究中,我们提出了一个衡量对自动化系统信任的量表,该量表基于信任形成的当前研究和理论,我们称之为对自动化系统的信任测试(TOAST)。我们使用独立的、与军队有关的和民用的样本评估了量表结构的可靠性和效标效度。在两项研究中,我们发现 TOAST 表现出了两个因素结构,分别衡量系统理解和性能,并且因子得分显著预测了与理论相关的构念的得分,表现出明显的效标效度。我们讨论了我们的发现对推进实证文献和改进界面设计的意义。