Department of Oral Diagnostics, Digital Health and Health Services Research, Charité-Universitätsmedizin Berlin, Berlin, Germany.
Department of Economics, Freie Universität Berlin, Germany.
JAMA Netw Open. 2022 Mar 1;5(3):e220269. doi: 10.1001/jamanetworkopen.2022.0269.
To assess the cost-effectiveness of artificial intelligence (AI) for supporting clinicians in detecting and grading diseases in dermatology, dentistry, and ophthalmology.
AI has been referred to as a facilitator for more precise, personalized, and safer health care, and AI algorithms have been reported to have diagnostic accuracies at or above the average physician in dermatology, dentistry, and ophthalmology.
DESIGN, SETTING, AND PARTICIPANTS: This economic evaluation analyzed data from 3 Markov models used in previous cost-effectiveness studies that were adapted to compare AI vs standard of care to detect melanoma on skin photographs, dental caries on radiographs, and diabetic retinopathy on retina fundus imaging. The general US and German population aged 50 and 12 years, respectively, as well as individuals with diabetes in Brazil aged 40 years were modeled over their lifetime. Monte Carlo microsimulations and sensitivity analyses were used to capture lifetime efficacy and costs. An annual cycle length was chosen. Data were analyzed between February 2021 and August 2021.
AI vs standard of care.
Association of AI with tooth retention-years for dentistry and quality-adjusted life-years (QALYs) for individuals in dermatology and ophthalmology; diagnostic costs.
In 1000 microsimulations with 1000 random samples, AI as a diagnostic-support system showed limited cost-savings and gains in tooth retention-years and QALYs. In dermatology, AI showed mean costs of $750 (95% CI, $608-$970) and was associated with 86.5 QALYs (95% CI, 84.9-87.9 QALYs), while the control showed higher costs $759 (95% CI, $618-$970) with similar QALY outcome. In dentistry, AI accumulated costs of €320 (95% CI, €299-€341) (purchasing power parity [PPP] conversion, $429 [95% CI, $400-$458]) with 62.4 years per tooth retention (95% CI, 60.7-65.1 years). The control was associated with higher cost, €342 (95% CI, €318-€368) (PPP, $458; 95% CI, $426-$493) and fewer tooth retention-years (60.9 years; 95% CI, 60.5-63.1 years). In ophthalmology, AI accrued costs of R $1321 (95% CI, R $1283-R $1364) (PPP, $559; 95% CI, $543-$577) at 8.4 QALYs (95% CI, 8.0-8.7 QALYs), while the control was less expensive (R $1260; 95% CI, R $1222-R $1303) (PPP, $533; 95% CI, $517-$551) and associated with similar QALYs. Dominance in favor of AI was dependent on small differences in the fee paid for the service and the treatment assumed after diagnosis. The fee paid for AI was a factor in patient preferences in cost-effectiveness between strategies.
The findings of this study suggest that marginal improvements in diagnostic accuracy when using AI may translate into a marginal improvement in outcomes. The current evidence supporting AI as decision support from a cost-effectiveness perspective is limited; AI should be evaluated on a case-specific basis to capture not only differences in costs and payment mechanisms but also treatment after diagnosis.
评估人工智能(AI)在支持皮肤科、牙科和眼科医生检测和分级疾病方面的成本效益。
AI 被称为更精确、个性化和更安全医疗保健的推动者,并且 AI 算法在皮肤科、牙科和眼科的诊断准确性与平均医生相当或更高。
设计、设置和参与者:这项经济评估分析了来自 3 个先前成本效益研究中使用的马尔可夫模型的数据,这些模型经过改编以比较 AI 与标准护理在检测皮肤照片中的黑色素瘤、放射影像中的龋齿和眼底成像中的糖尿病视网膜病变方面的效果。一般来说,美国和德国分别为 50 岁和 12 岁的人群,以及巴西 40 岁的糖尿病患者,在其一生中都进行了建模。蒙特卡罗微模拟和敏感性分析用于捕获终生疗效和成本。选择了一个年度周期长度。数据在 2021 年 2 月至 2021 年 8 月之间进行了分析。
AI 与标准护理。
AI 与牙科的牙齿保留年数和皮肤科和眼科的质量调整生命年(QALY)相关;诊断成本。
在 1000 次微模拟中,每次模拟有 1000 个随机样本,作为诊断支持系统的 AI 显示出有限的节省成本和增加牙齿保留年数和 QALY 的效果。在皮肤科,AI 的平均成本为 750 美元(95%CI,608-970 美元),与 86.5 QALY(95%CI,84.9-87.9 QALY)相关,而对照显示出更高的成本 759 美元(95%CI,618-970 美元),但 QALY 结果相似。在牙科,AI 的累计成本为 320 欧元(95%CI,299-341 欧元)(购买力平价 [PPP] 转换,429 美元[95%CI,400-458 美元]),每颗牙齿保留 62.4 年(95%CI,60.7-65.1 年)。对照物与更高的成本相关,342 欧元(95%CI,318-368 欧元)(PPP,458 美元;95%CI,426-493 美元)和较少的牙齿保留年数(60.9 年;95%CI,60.5-63.1 年)。在眼科,AI 的累计成本为 1321 雷亚尔(95%CI,1283-1364 雷亚尔)(PPP,559 美元;95%CI,543-577 美元),获得 8.4 QALY(95%CI,8.0-8.7 QALY),而对照物的成本较低(1260 雷亚尔;95%CI,1222-1303 雷亚尔)(PPP,533 美元;95%CI,517-551 美元),并具有相似的 QALY。支持 AI 的优势取决于服务费用和诊断后治疗的微小差异。AI 的费用是患者在成本效益策略之间偏好的一个因素。
本研究的结果表明,使用 AI 时诊断准确性的微小提高可能转化为结果的微小改善。目前从成本效益角度支持 AI 作为决策支持的证据有限;应该根据具体情况评估 AI,不仅要考虑成本和支付机制的差异,还要考虑诊断后的治疗。