Department of Public Health and Preventive Medicine, School of Medicine, Jinan University, Guangzhou, China.
Faculty of Economics and Business, University of Groningen, Groningen, Netherlands.
J Med Internet Res. 2021 Feb 23;23(2):e22841. doi: 10.2196/22841.
Misdiagnosis, arbitrary charges, annoying queues, and clinic waiting times among others are long-standing phenomena in the medical industry across the world. These factors can contribute to patient anxiety about misdiagnosis by clinicians. However, with the increasing growth in use of big data in biomedical and health care communities, the performance of artificial intelligence (Al) techniques of diagnosis is improving and can help avoid medical practice errors, including under the current circumstance of COVID-19.
This study aims to visualize and measure patients' heterogeneous preferences from various angles of AI diagnosis versus clinicians in the context of the COVID-19 epidemic in China. We also aim to illustrate the different decision-making factors of the latent class of a discrete choice experiment (DCE) and prospects for the application of AI techniques in judgment and management during the pandemic of SARS-CoV-2 and in the future.
A DCE approach was the main analysis method applied in this paper. Attributes from different dimensions were hypothesized: diagnostic method, outpatient waiting time, diagnosis time, accuracy, follow-up after diagnosis, and diagnostic expense. After that, a questionnaire is formed. With collected data from the DCE questionnaire, we apply Sawtooth software to construct a generalized multinomial logit (GMNL) model, mixed logit model, and latent class model with the data sets. Moreover, we calculate the variables' coefficients, standard error, P value, and odds ratio (OR) and form a utility report to present the importance and weighted percentage of attributes.
A total of 55.8% of the respondents (428 out of 767) opted for AI diagnosis regardless of the description of the clinicians. In the GMNL model, we found that people prefer the 100% accuracy level the most (OR 4.548, 95% CI 4.048-5.110, P<.001). For the latent class model, the most acceptable model consists of 3 latent classes of respondents. The attributes with the most substantial effects and highest percentage weights are the accuracy (39.29% in general) and expense of diagnosis (21.69% in general), especially the preferences for the diagnosis "accuracy" attribute, which is constant across classes. For class 1 and class 3, people prefer the AI + clinicians method (class 1: OR 1.247, 95% CI 1.036-1.463, P<.001; class 3: OR 1.958, 95% CI 1.769-2.167, P<.001). For class 2, people prefer the AI method (OR 1.546, 95% CI 0.883-2.707, P=.37). The OR of levels of attributes increases with the increase of accuracy across all classes.
Latent class analysis was prominent and useful in quantifying preferences for attributes of diagnosis choice. People's preferences for the "accuracy" and "diagnostic expenses" attributes are palpable. AI will have a potential market. However, accuracy and diagnosis expenses need to be taken into consideration.
误诊、任意收费、烦人的排队和门诊候诊时间等现象在世界各地的医疗行业中由来已久。这些因素可能导致患者对临床医生误诊的焦虑。然而,随着大数据在生物医学和医疗保健领域的应用日益增多,人工智能(Al)技术的诊断性能正在提高,可以帮助避免医疗实践中的错误,包括在当前 COVID-19 疫情下。
本研究旨在从不同角度可视化和衡量患者在 COVID-19 疫情背景下对人工智能诊断与临床医生的异质偏好。我们还旨在说明离散选择实验(DCE)潜在类别中不同决策因素的差异和人工智能技术在判断和管理 SARS-CoV-2 大流行期间以及未来的应用前景。
DCE 方法是本文主要的分析方法。从不同维度假设了属性:诊断方法、门诊等候时间、诊断时间、准确性、诊断后随访和诊断费用。之后,形成一个问卷。根据 DCE 问卷收集的数据,我们应用 Sawtooth 软件构建广义多项逻辑(GMNL)模型、混合逻辑模型和数据集中的潜在类别模型。此外,我们计算变量的系数、标准误差、P 值和优势比(OR),并形成一个效用报告,以显示属性的重要性和加权百分比。
共有 55.8%(767 名受访者中有 428 名)的受访者选择了人工智能诊断,而不论对临床医生的描述如何。在 GMNL 模型中,我们发现人们最倾向于 100%的准确率(OR 4.548,95%CI 4.048-5.110,P<.001)。对于潜在类别模型,最可接受的模型由 3 个受访者潜在类别组成。具有最大影响和最高权重百分比的属性是准确性(总体上为 39.29%)和诊断费用(总体上为 21.69%),尤其是对诊断“准确性”属性的偏好,在各类别中保持不变。对于类别 1 和类别 3,人们更喜欢人工智能+临床医生的方法(类别 1:OR 1.247,95%CI 1.036-1.463,P<.001;类别 3:OR 1.958,95%CI 1.769-2.167,P<.001)。对于类别 2,人们更喜欢人工智能方法(OR 1.546,95%CI 0.883-2.707,P=.37)。所有类别中,属性水平的 OR 随准确性的提高而增加。
潜在类别分析在量化诊断选择属性偏好方面是突出和有用的。人们对“准确性”和“诊断费用”属性的偏好是明显的。人工智能将具有潜在的市场。然而,准确性和诊断费用需要考虑在内。