Health Informatics Research Group, Osnabrück University of Applied Science, Osnabrück, Germany.
Department of New Public Health, Osnabrück University, Osnabrück, Germany.
Stud Health Technol Inform. 2024 Aug 30;317:298-304. doi: 10.3233/SHTI240871.
INTRODUCTION: Automation bias poses a significant challenge to the effectiveness of Clinical Decision Support Systems (CDSS), potentially compromising diagnostic accuracy. Previous research highlights trust, self-confidence, and task difficulty as key determinants. With the increasing availability of AI-enabled CDSS, automation bias attains new attention. This study therefore aims to identify factors influencing automation bias in a diagnostic task. METHODS: A quantitative intervention study with participants from different backgrounds (n = 210) was conducted, employing regression analysis to analyze potential factors. Automation bias was measured as the agreement rate with wrong AI-enabled recommendations. RESULTS AND DISCUSSION: Diagnostic performance, certified wound care training, physician profession, and female gender significantly reduced false agreement rates. Higher perceived benefit of the system was significantly associated with promoting false agreement. Strategies like comprehensive diagnostic training are pivotal in the prevention of automation bias when implementing CDSS. CONCLUSION: Considering factors influencing automation bias when introducing a CDSS is critical to fully leverage the benefits of such a system. This study highlights that non-specialists, who stand to gain the most from CDSS, are also the most susceptible to automation bias, emphasizing the need for specialized training to mitigate this risk and ensure diagnostic accuracy and patient safety.
简介:自动化偏差对临床决策支持系统(CDSS)的有效性构成重大挑战,可能会降低诊断准确性。先前的研究强调信任、自信和任务难度是关键决定因素。随着人工智能支持的 CDSS 的可用性不断增加,自动化偏差引起了新的关注。因此,本研究旨在确定影响诊断任务中自动化偏差的因素。
方法:采用来自不同背景的参与者(n=210)的定量干预研究,运用回归分析来分析潜在因素。自动化偏差通过与错误的人工智能推荐一致的比率来衡量。
结果与讨论:诊断性能、经过认证的伤口护理培训、医生职业和女性性别显著降低了错误一致率。更高的系统感知益处与促进错误一致显著相关。在实施 CDSS 时,综合诊断培训等策略对于防止自动化偏差至关重要。
结论:在引入 CDSS 时考虑影响自动化偏差的因素对于充分利用该系统的优势至关重要。本研究表明,最有可能从 CDSS 中受益的非专业人员也是最容易受到自动化偏差影响的人员,这强调了需要专门的培训来减轻这种风险,确保诊断准确性和患者安全。
Stud Health Technol Inform. 2024-8-30
Int J Med Inform. 2014-1-17
J Med Internet Res. 2024-9-16
J Am Med Inform Assoc. 2023-9-25