Histopathology Department, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, UK.
Warwick Medical School, University of Warwick, Coventry, UK.
Histopathology. 2024 Jan;84(2):279-287. doi: 10.1111/his.15071. Epub 2023 Nov 3.
Artificial intelligence (AI)-based diagnostic tools can offer numerous benefits to the field of histopathology, including improved diagnostic accuracy, efficiency and productivity. As a result, such tools are likely to have an increasing role in routine practice. However, all AI tools are prone to errors, and these AI-associated errors have been identified as a major risk in the introduction of AI into healthcare. The errors made by AI tools are different, in terms of both cause and nature, to the errors made by human pathologists. As highlighted by the National Institute for Health and Care Excellence, it is imperative that practising pathologists understand the potential limitations of AI tools, including the errors made. Pathologists are in a unique position to be gatekeepers of AI tool use, maximizing patient benefit while minimizing harm. Furthermore, their pathological knowledge is essential to understanding when, and why, errors have occurred and so to developing safer future algorithms. This paper summarises the literature on errors made by AI diagnostic tools in histopathology. These include erroneous errors, data concerns (data bias, hidden stratification, data imbalances, distributional shift, and lack of generalisability), reinforcement of outdated practices, unsafe failure mode, automation bias, and insensitivity to impact. Methods to reduce errors in both tool design and clinical use are discussed, and the practical roles for pathologists in error minimisation are highlighted. This aims to inform and empower pathologists to move safely through this seismic change in practice and help ensure that novel AI tools are adopted safely.
人工智能(AI)诊断工具可为组织病理学领域带来诸多益处,包括提高诊断准确性、效率和生产力。因此,这类工具很可能在常规实践中发挥越来越重要的作用。但是,所有 AI 工具都容易出错,而且这些与 AI 相关的错误已被确定为将 AI 引入医疗保健领域的主要风险。AI 工具造成的错误,无论是在原因还是性质方面,都与病理学家造成的错误不同。正如英国国家卫生与临床优化研究所所强调的那样,病理学家必须了解 AI 工具的潜在局限性,包括其造成的错误。病理学家在把关 AI 工具的使用方面具有独特的地位,在最大限度地提高患者获益的同时,将危害最小化。此外,他们的病理知识对于理解何时以及为何发生错误至关重要,因此对于开发更安全的未来算法也至关重要。本文总结了 AI 诊断工具在组织病理学中出现错误的相关文献。这些错误包括错误性错误、数据问题(数据偏差、隐藏分层、数据不平衡、分布偏移和缺乏通用性)、强化过时的实践、不安全的失效模式、自动化偏差以及对影响不敏感。本文还讨论了减少工具设计和临床应用中错误的方法,并强调了病理学家在减少错误方面的实际作用。其目的是为病理学家提供信息和能力,使他们能够安全地应对实践中的这一重大变革,并帮助确保安全采用新的 AI 工具。