University of Michigan, Ann Arbor, USA.
Hum Factors. 2020 Sep;62(6):987-1001. doi: 10.1177/0018720819862916. Epub 2019 Jul 26.
The study examines the effects of disclosing different types of likelihood information on human operators' trust in automation, their compliance and reliance behaviors, and the human-automation team performance.
To facilitate appropriate trust in and dependence on automation, explicitly conveying the likelihood of automation success has been proposed as one solution. Empirical studies have been conducted to investigate the potential benefits of disclosing likelihood information in the form of automation reliability, (un)certainty, and confidence. Yet, results from these studies are rather mixed.
We conducted a human-in-the-loop experiment with 60 participants using a simulated surveillance task. Each participant performed a compensatory tracking task and a threat detection task with the help of an imperfect automated threat detector. Three types of likelihood information were presented: overall likelihood information, predictive values, and hit and correct rejection rates. Participants' trust in automation, compliance and reliance behaviors, and task performance were measured.
Human operators informed of the predictive values or the overall likelihood value, rather than the hit and correct rejection rates, relied on the decision aid more appropriately and obtained higher task scores.
Not all likelihood information is equal in aiding human-automation team performance. Directly presenting the hit and correct rejection rates of an automated decision aid should be avoided.
The findings can be applied to the design of automated decision aids.
本研究考察了在人机团队中，向人类操作员披露不同类型的可能性信息对其对自动化的信任、遵守和依赖行为以及人机团队绩效的影响。
为了促进对自动化的适当信任和依赖，明确传达自动化成功的可能性被提出作为一种解决方案。已经进行了实证研究，以调查以自动化可靠性、（不）确定性和信心形式披露可能性信息的潜在好处。然而，这些研究的结果却相当混杂。
我们使用模拟监视任务，通过 60 名参与者进行了一项人在回路实验。每个参与者在不完美的自动化威胁探测器的帮助下执行补偿跟踪任务和威胁检测任务。展示了三种类型的可能性信息：总体可能性信息、预测值以及命中和正确拒绝率。测量了参与者对自动化的信任、遵守和依赖行为以及任务绩效。
与命中和正确拒绝率相比，被告知预测值或总体可能性值的人类操作员更恰当地依赖决策辅助工具，并获得了更高的任务得分。
并非所有可能性信息在辅助人机团队绩效方面都是平等的。应避免直接呈现自动化决策辅助工具的命中和正确拒绝率。
这些发现可应用于自动化决策辅助工具的设计。
