Diagnostic Accuracy of Artificial Intelligence Compared to Biopsy in Detecting Early Oral Squamous Cell Carcinoma: A Systematic Review and Meta Analysis.

OBJECTIVE

To summarize and compare the existing evidence on diagnostic accuracy of artificial intelligence (AI) models in detecting early oral squamous cell carcinoma (OSCC).

METHOD

Review was performed in accordance to Preferred Reporting Items for Systematic Reviews and Meta-Analysis - Diagnostic Test Accuracy (PRISMA- DTA) checklist and the review protocol is registered under PROSPERO(CRD42023456355). PubMed, Google Scholar, EBSCOhost were searched from January 2000 to November 2023 to identify the diagnostic potential of AI based tools and models. True-positive, false-positive, true-negative, false-negative, sensitivity, specificity values were extracted or calculated if not present for each study. Quality of selected studies was evaluated based on QUADAS (Quality assessment of diagnostic accuracy studies)- 2 tool. Meta-analysis was performed in Meta-Disc 1.4 software and Review Manager 5.3 RevMan using a bivariate model parameter for the sensitivity and specificity and summary points, summary receiver operating curve (SROC), diagnostic odds ratio (DOR) confidence region, and area under curve (AUC) were calculated.

RESULTS

Fourteen studies were included for qualitative synthesis and for meta-analysis. Included studies had presence of low to moderate risk of bias. Pooled sensitivity and specificity of 0.43 (CI 0.18- 0.71) and 0.50 (CI 0.20- 0.80) was observed with a pooled positive likelihood ratio of (PLR) 0.86 (0.43 - 1.71) and negative likelihood ratio (NLR) of 1.04 (0.42 - 1.68) was observed with DOR of 0.78 (0.12 - 5.18) and overall accuracy (AUC) being 0.45 respectively.

CONCLUSION

AI based tools has poor to moderate overall diagnostic accuracy. However, to validate our study findings further more standardized diagnostic accuracy studies should be conducted with proper reporting through QUADAS-2 tool. Thus, we can conclude AI based based tool for secondary level of prevention for early OSCC under early diagnosis and prompt treatment.