Kidd M, Drozdov I A, Chirindel A, Nicolas G, Imagawa D, Gulati A, Tsuchikawa T, Prasad V, Halim A B, Strosberg J
Wren Laboratories, Branford, Connecticut, USA.
Bering Research, London, UK.
J Neuroendocrinol. 2025 Apr;37(4):e70002. doi: 10.1111/jne.70002. Epub 2025 Feb 13.
Gastroenteropancreatic neuroendocrine neoplasms (GEP-NENs) are challenging to diagnose and manage. Because there is a critical need for a reliable biomarker, we previously developed the NETest, a liquid biopsy test that quantifies the expression of 51 neuroendocrine tumor (NET)-specific genes in blood using real-time PCR (NETest 1.0). In this study, we have leveraged our well-established laboratory approach (blood collection, RNA isolation, qPCR) with contemporary supervised machine learning methods and expanded training and testing sets to improve the discrimination and calibration of the NETest algorithm (NETest 2.0). qPCR measurements of RNA-stabilized blood-derived gene expression of 51 NET markers were used to train two supervised classifiers. The first classifier trained on 78 Controls and 162 NETs, distinguishing NETs from controls; the second, trained on 134 stable disease samples, 61 progressive disease samples, differentiated stable from progressive NET disease. In all cases, 80% of data was retained for model training, while remaining 20% were used for performance evaluation. The predictive performance of the AI system was assessed using sensitivity, specificity, and Area under Received Operating Characteristic curves (AUROC). The algorithm with the highest performance was retained for validation in two independent validation sets. Validation Cohort #I consisted of 277 patients and 186 healthy controls from the United States, Latin America, Europe, Africa and Asia, while Validation Cohort #II comprised 291 European patients from the Swiss NET Registry. A specificity cohort of 147 gastrointestinal, pancreatic and lung malignancies (non-NETs) was also evaluated. NETest 2.0 Algorithm #1 (Random Forest/gene expression normalized to ATG4B) achieved an AUROC of 0.91 for distinguishing NETs from controls (Validation Cohort #I), with a sensitivity of 95% and specificity of 81%. In Validation Cohort #II, 92% of NETs with image-positive disease were detected. The AUROC for differentiating NETs from other malignancies was 0.95; the sensitivity was 92% and specificity 90%. NETest 2.0 Algorithm #2 (Random Forest/gene expression normalized to ALG9) demonstrated an AUROC of 0.81 in Validation Cohort #I and 0.82 in Validation Cohort #II for differentiating stable from progressive disease, with specificities of 81% and 82%, respectively. Model performance was not affected by gender, ethnicity or age. Substantial improvements in performance for both algorithms were identified in head-to-head comparisons with NETest 1.0 (diagnostic: p = 1.73 × 10; prognostic: p = 1.02 × 10). NETest 2.0 exhibited improved diagnostic and prognostic capabilities over NETest 1.0. The assay also demonstrated improved sensitivity for differentiating NETs from other gastrointestinal, pancreatic and lung malignancies. The validation of this tool in geographically diverse cohorts highlights their potential for widespread clinical use.
胃肠胰神经内分泌肿瘤(GEP-NENs)的诊断和管理具有挑战性。由于迫切需要一种可靠的生物标志物,我们之前开发了NETest,这是一种液体活检测试,使用实时PCR(NETest 1.0)对血液中51种神经内分泌肿瘤(NET)特异性基因的表达进行定量。在本研究中,我们将成熟的实验室方法(血液采集、RNA分离、qPCR)与当代监督机器学习方法相结合,并扩大了训练和测试集,以改进NETest算法(NETest 2.0)的辨别能力和校准。对51种NET标志物的RNA稳定化血液衍生基因表达进行qPCR测量,用于训练两个监督分类器。第一个分类器在78例对照和162例NET患者上进行训练,以区分NET患者与对照;第二个分类器在134例病情稳定样本和61例病情进展样本上进行训练,以区分NET疾病的稳定期和进展期。在所有情况下,80%的数据用于模型训练,其余20%用于性能评估。使用敏感性、特异性和接受者操作特征曲线下面积(AUROC)评估人工智能系统的预测性能。性能最高的算法被保留用于在两个独立验证集中进行验证。验证队列#I由来自美国、拉丁美洲、欧洲、非洲和亚洲的277例患者和186例健康对照组成,而验证队列#II由来自瑞士NET注册中心的291例欧洲患者组成。还评估了147例胃肠道、胰腺和肺部恶性肿瘤(非NET)的特异性队列。NETest 2.0算法#1(随机森林/基因表达标准化为ATG4B)在区分NET患者与对照方面(验证队列#I)的AUROC为0.