Oak Ridge Institute for Science and Education, Oak Ridge, TN 37830, USA.
Center for Military Psychology and Neuroscience, Walter Reed Army Institute of Research, Silver Spring, MD 20910, USA.
Mil Med. 2024 Aug 19;189(Suppl 3):628-635. doi: 10.1093/milmed/usae205.
Presently, traumatic brain injury (TBI) triage in field settings relies on symptom-based screening tools such as the updated Military Acute Concussion Evaluation. Objective eye-tracking may provide an alternative means of neurotrauma screening due to sensitivity to neurotrauma brain-health changes. Previously, the US Army Medical Research and Development Command Non-Invasive NeuroAssessment Devices (NINAD) Integrated Product Team identified 3 commercially available eye-tracking devices (SyncThink EYE-SYNC, Oculogica EyeBOX, NeuroKinetics IPAS) as meeting criteria toward being operationally effective in the detection of TBI in service members. We compared these devices to assess their relative performance in the classification of mild traumatic brain injury (mTBI) subjects versus normal healthy controls.
Participants 18 to 45 years of age were assigned to Acute mTBI, Chronic mTBI, or Control group per study criteria. Each completed a TBI assessment protocol with all 3 devices counterbalanced across participants. Acute mTBI participants were tested within 72 hours following injury whereas time since last injury for the Chronic mTBI group ranged from months to years. Discriminant analysis was undertaken to determine device classification performance in separating TBI subjects from controls. Area Under the Curves (AUCs) were calculated and used to compare the accuracy of device performance. Device-related factors including data quality, the need to repeat tests, and technical issues experienced were aggregated for reporting.
A total of 63 participants were recruited as Acute mTBI subjects, 34 as Chronic mTBI subjects, and 119 participants without history of TBI as controls. To maximize outcomes, poorer quality data were excluded from analysis using specific criteria where possible. Final analysis utilized 49 (43 male/6 female, mean [x̅] age = 24.3 years, SD [s] = 5.1) Acute mTBI subjects, and 34 (33 male/1 female, x̅ age = 38.8 years, s = 3.9) Chronic mTBI subjects were age- and gender-matched as closely as possible with Control subjects. AUCs obtained with 80% of total dataset ranged from 0.690 to 0.950 for the Acute Group and from 0.753 to 0.811 for the Chronic mTBI group. Validation with the remaining 20% of dataset produced AUCs ranging from 0.600 to 0.750 for Acute mTBI group and 0.490 to 0.571 for the Chronic mTBI group.
Potential eye-tracking detection of mTBI, per training model outcomes, ranged from acceptable to excellent for the Acute mTBI group; however, it was less consistent for the Chronic mTBI group. The self-imposed targeted performance (AUC of 0.850) appears achievable, but further device improvements and research are necessary. Discriminant analysis models differed for the Acute versus Chronic mTBI groups, suggesting performance differences in eye-tracking. Although eye-tracking demonstrated sensitivity in the Chronic group, a more rigorous and/or longitudinal study design is required to evaluate this observation. mTBI injuries were not controlled for this study, potentially reducing eye-tracking assessment sensitivity. Overall, these findings indicate that while eye-tracking remains a viable means of mTBI screening, device-specific variability in data quality, length of testing, and ease of use must be addressed to achieve NINAD objectives and DoD implementation.
目前,创伤性脑损伤 (TBI) 在现场的分诊依赖于基于症状的筛查工具,例如更新的军事急性脑震荡评估。客观的眼动追踪可能提供一种替代的神经创伤筛查方法,因为它对神经创伤大脑健康变化敏感。此前,美国陆军医学研究与发展司令部非侵入性神经评估设备 (NINAD) 综合产品团队确定了 3 种商业上可用的眼动追踪设备(SyncThink EYE-SYNC、Oculogica EyeBOX、NeuroKinetics IPAS),这些设备符合在服务人员中检测 TBI 的操作有效性标准。我们比较了这些设备,以评估它们在分类轻度创伤性脑损伤 (mTBI) 受试者与正常健康对照方面的相对性能。
根据研究标准,18 至 45 岁的参与者被分配到急性 mTBI、慢性 mTBI 或对照组。每个参与者都完成了 TBI 评估方案,所有 3 种设备在参与者之间进行了平衡。急性 mTBI 参与者在受伤后 72 小时内进行测试,而慢性 mTBI 组的最后一次受伤时间从几个月到几年不等。进行判别分析以确定设备在将 TBI 受试者与对照组区分开来的分类性能。计算了曲线下面积 (AUC),并用于比较设备性能的准确性。设备相关因素,包括数据质量、重复测试的需要和遇到的技术问题,进行了汇总报告。
共招募了 63 名急性 mTBI 受试者、34 名慢性 mTBI 受试者和 119 名无 TBI 病史的对照组参与者。为了最大限度地提高结果,使用特定标准尽可能排除了较差质量数据的分析。最终分析利用了 49 名(43 名男性/6 名女性,平均[ x̅ ]年龄 24.3 岁,标准差[s] 5.1)急性 mTBI 受试者和 34 名(33 名男性/1 名女性, x̅ 年龄 38.8 岁,s 3.9)慢性 mTBI 受试者尽可能紧密地与对照组相匹配。使用 80%的总数据集获得的 AUC 值范围为急性组的 0.690 至 0.950,慢性 mTBI 组的 0.753 至 0.811。使用剩余的 20%数据集进行验证,得出急性 mTBI 组的 AUC 值范围为 0.600 至 0.750,慢性 mTBI 组的 AUC 值范围为 0.490 至 0.571。
根据训练模型的结果,眼动追踪对 mTBI 的潜在检测,急性 mTBI 组的范围从可接受到优秀;然而,对于慢性 mTBI 组,情况就不那么一致了。自我设定的目标性能(AUC 为 0.850)似乎可以实现,但需要进一步改进设备和研究。急性与慢性 mTBI 组的判别分析模型不同,表明眼动追踪存在性能差异。尽管眼动追踪在慢性组中表现出了敏感性,但需要更严格和/或纵向的研究设计来评估这一观察结果。本研究未控制 mTBI 损伤,可能降低了眼动追踪评估的敏感性。总的来说,这些发现表明,虽然眼动追踪仍然是 mTBI 筛查的一种可行方法,但必须解决设备特定的数据质量、测试长度和易用性方面的差异,以实现 NINAD 目标和国防部的实施。