文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

The METRIC-framework for assessing data quality for trustworthy AI in medicine: a systematic review.

作者信息

Schwabe Daniel, Becker Katinka, Seyferth Martin, Klaß Andreas, Schaeffter Tobias

机构信息

Division Medical Physics and Metrological Information Technology, Physikalisch-Technische Bundesanstalt, Berlin, Germany.

Department of Medical Engineering, Technical University Berlin, Berlin, Germany.

出版信息

NPJ Digit Med. 2024 Aug 3;7(1):203. doi: 10.1038/s41746-024-01196-4.


DOI:10.1038/s41746-024-01196-4
PMID:39097662
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11297942/
Abstract

The adoption of machine learning (ML) and, more specifically, deep learning (DL) applications into all major areas of our lives is underway. The development of trustworthy AI is especially important in medicine due to the large implications for patients' lives. While trustworthiness concerns various aspects including ethical, transparency and safety requirements, we focus on the importance of data quality (training/test) in DL. Since data quality dictates the behaviour of ML products, evaluating data quality will play a key part in the regulatory approval of medical ML products. We perform a systematic review following PRISMA guidelines using the databases Web of Science, PubMed and ACM Digital Library. We identify 5408 studies, out of which 120 records fulfil our eligibility criteria. From this literature, we synthesise the existing knowledge on data quality frameworks and combine it with the perspective of ML applications in medicine. As a result, we propose the METRIC-framework, a specialised data quality framework for medical training data comprising 15 awareness dimensions, along which developers of medical ML applications should investigate the content of a dataset. This knowledge helps to reduce biases as a major source of unfairness, increase robustness, facilitate interpretability and thus lays the foundation for trustworthy AI in medicine. The METRIC-framework may serve as a base for systematically assessing training datasets, establishing reference datasets, and designing test datasets which has the potential to accelerate the approval of medical ML products.

摘要
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/6acd88a491d2/41746_2024_1196_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/876ba42d46c9/41746_2024_1196_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/424e32c91958/41746_2024_1196_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/40c23302698c/41746_2024_1196_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/319ed7dcfe1b/41746_2024_1196_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/9082159b097d/41746_2024_1196_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/6acd88a491d2/41746_2024_1196_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/876ba42d46c9/41746_2024_1196_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/424e32c91958/41746_2024_1196_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/40c23302698c/41746_2024_1196_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/319ed7dcfe1b/41746_2024_1196_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/9082159b097d/41746_2024_1196_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3e1d/11297942/6acd88a491d2/41746_2024_1196_Fig6_HTML.jpg

相似文献

[1]
The METRIC-framework for assessing data quality for trustworthy AI in medicine: a systematic review.

NPJ Digit Med. 2024-8-3

[2]
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.

Cochrane Database Syst Rev. 2022-2-1

[3]
Guidelines and Standard Frameworks for AI in Medicine: Protocol for a Systematic Literature Review.

JMIR Res Protoc. 2023-10-25

[4]
Impact of Responsible AI on the Occurrence and Resolution of Ethical Issues: Protocol for a Scoping Review.

JMIR Res Protoc. 2024-6-5

[5]
The future of Cochrane Neonatal.

Early Hum Dev. 2020-11

[6]
Can I trust my fake data - A comprehensive quality assessment framework for synthetic tabular data in healthcare.

Int J Med Inform. 2024-5

[7]
Automatic transparency evaluation for open knowledge extraction systems.

J Biomed Semantics. 2023-8-31

[8]
Artificial intelligence technologies and compassion in healthcare: A systematic scoping review.

Front Psychol. 2023-1-17

[9]
A trustworthy AI reality-check: the lack of transparency of artificial intelligence products in healthcare.

Front Digit Health. 2024-2-20

[10]
Piloting a Survey-Based Assessment of Transparency and Trustworthiness with Three Medical AI Tools.

Healthcare (Basel). 2022-9-30

引用本文的文献

[1]
A simple and effective approach for body part recognition on CT scans based on projection estimation.

Sci Rep. 2025-8-28

[2]
Enhancing Clinical Data Infrastructure for AI Research: Comparative Evaluation of Data Management Architectures.

J Med Internet Res. 2025-8-1

[3]
A Framework for Evaluating the Use of Surveillance Systems for Short-Term Influenza Forecasting.

Influenza Other Respir Viruses. 2025-8

[4]
Medical laboratory data-based models: opportunities, obstacles, and solutions.

J Transl Med. 2025-7-24

[5]
Deep learning algorithm for identifying osteopenia/osteoporosis using cervical radiography.

Sci Rep. 2025-7-12

[6]
Artificial Intelligence in Detecting Periodontal Disease From Intraoral Photographs: A Systematic Review.

Int Dent J. 2025-7-9

[7]
Characteristics, licensing, and ethical considerations of openly accessible oral-maxillofacial imaging datasets: a systematic review.

NPJ Digit Med. 2025-7-5

[8]
AI in Medical Questionnaires: Innovations, Diagnosis, and Implications.

J Med Internet Res. 2025-6-23

[9]
A Method for Enabling Digital Health Technologies in Clinical and Translational Research at an Academic Medical Center.

AMIA Jt Summits Transl Sci Proc. 2025-6-10

[10]
A review of recent artificial intelligence for traditional medicine.

J Tradit Complement Med. 2025-2-21

本文引用的文献

[1]
Frameworks, Dimensions, Definitions of Aspects, and Assessment Methods for the Appraisal of Quality of Health Data for Secondary Use: Comprehensive Overview of Reviews.

JMIR Med Inform. 2024-3-6

[2]
The value of standards for health datasets in artificial intelligence-based applications.

Nat Med. 2023-11

[3]
Electronic health record data quality assessment and tools: a systematic review.

J Am Med Inform Assoc. 2023-9-25

[4]
Impact of imperfection in medical imaging data on deep learning-based segmentation performance: An experimental study using synthesized data.

Med Phys. 2023-10

[5]
Digital Health Data Quality Issues: Systematic Review.

J Med Internet Res. 2023-3-31

[6]
Data Quality in Health Care: Main Concepts and Assessment Methodologies.

Methods Inf Med. 2023-5

[7]
Rare Diseases in Hospital Information Systems-An Interoperable Methodology for Distributed Data Quality Assessments.

Methods Inf Med. 2023-9

[8]
The uncovered biases and errors in clinical determination of bone age by using deep learning models.

Eur Radiol. 2023-5

[9]
Accuracy and data efficiency in deep learning models of protein expression.

Nat Commun. 2022-12-15

[10]
Narrowing the Gap: Improved Detector Training With Noisy Location Annotations.

IEEE Trans Image Process. 2022

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索