Asan Onur, Choudhury Avishek
School of Systems and Enterprises, Stevens Institute of Technology, Hoboken, NJ, United States.
JMIR Hum Factors. 2021 Jun 18;8(2):e28236. doi: 10.2196/28236.
Despite advancements in artificial intelligence (AI) to develop prediction and classification models, little research has been devoted to real-world translations with a user-centered design approach. AI development studies in the health care context have often ignored two critical factors of ecological validity and human cognition, creating challenges at the interface with clinicians and the clinical environment.
The aim of this literature review was to investigate the contributions made by major human factors communities in health care AI applications. This review also discusses emerging research gaps, and provides future research directions to facilitate a safer and user-centered integration of AI into the clinical workflow.
We performed an extensive mapping review to capture all relevant articles published within the last 10 years in the major human factors journals and conference proceedings listed in the "Human Factors and Ergonomics" category of the Scopus Master List. In each published volume, we searched for studies reporting qualitative or quantitative findings in the context of AI in health care. Studies are discussed based on the key principles such as evaluating workload, usability, trust in technology, perception, and user-centered design.
Forty-eight articles were included in the final review. Most of the studies emphasized user perception, the usability of AI-based devices or technologies, cognitive workload, and user's trust in AI. The review revealed a nascent but growing body of literature focusing on augmenting health care AI; however, little effort has been made to ensure ecological validity with user-centered design approaches. Moreover, few studies (n=5 against clinical/baseline standards, n=5 against clinicians) compared their AI models against a standard measure.
Human factors researchers should actively be part of efforts in AI design and implementation, as well as dynamic assessments of AI systems' effects on interaction, workflow, and patient outcomes. An AI system is part of a greater sociotechnical system. Investigators with human factors and ergonomics expertise are essential when defining the dynamic interaction of AI within each element, process, and result of the work system.
尽管人工智能(AI)在开发预测和分类模型方面取得了进展,但很少有研究致力于采用以用户为中心的设计方法进行实际应用翻译。医疗保健领域的人工智能开发研究往往忽视了生态效度和人类认知这两个关键因素,在与临床医生和临床环境的交互中带来了挑战。
本综述的目的是调查主要人为因素群体在医疗保健人工智能应用中的贡献。本综述还讨论了新出现的研究差距,并提供了未来的研究方向,以促进人工智能更安全且以用户为中心地融入临床工作流程。
我们进行了广泛的映射综述,以获取过去10年内在Scopus主列表“人为因素与工效学”类别下列出的主要人为因素期刊和会议论文集中发表的所有相关文章。在每一卷已发表的文献中,我们搜索了在医疗保健人工智能背景下报告定性或定量研究结果的研究。根据评估工作量、可用性、对技术的信任、认知和以用户为中心的设计等关键原则对研究进行讨论。
最终综述纳入了48篇文章。大多数研究强调用户认知、基于人工智能的设备或技术的可用性、认知工作量以及用户对人工智能的信任。该综述揭示了一个新兴但不断增长的关注增强医疗保健人工智能的文献群体;然而,很少有人努力采用以用户为中心的设计方法来确保生态效度。此外,很少有研究(与临床/基线标准相比n = 5,与临床医生相比n = 5)将其人工智能模型与标准测量进行比较。
人为因素研究人员应积极参与人工智能设计和实施工作,以及对人工智能系统对交互、工作流程和患者结果影响的动态评估。人工智能系统是更大的社会技术系统的一部分。在定义人工智能在工作系统的每个要素、过程和结果中的动态交互时,具备人为因素和工效学专业知识的研究人员至关重要。