• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

嵌入式CPU-GPU瞳孔追踪。

Embedded CPU-GPU pupil tracking.

作者信息

Kowalski Bartlomiej, Huang Xiaojing, Dubra Alfredo

机构信息

Department of Ophthalmology, Stanford University, Palo Alto, CA 94303, USA.

出版信息

Biomed Opt Express. 2024 Nov 13;15(12):6799-6815. doi: 10.1364/BOE.541421. eCollection 2024 Dec 1.

DOI:10.1364/BOE.541421
PMID:39679407
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11640584/
Abstract

We explore camera-based pupil tracking using high-level programming in computing platforms with end-user discrete and integrated central processing units (CPUs) and graphics processing units (GPUs), seeking low calculation latencies previously achieved with specialized hardware and programming (Kowalski et al., [Biomed. Opt. Express12, 6496 (2021)10.1364/BOE.433766]. Various desktop and embedded computers were tested, some with two operating systems, using the traditional sequential pupil tracking paradigm, in which the processing of the camera image only starts after it is fully downloaded to the computer. The pupil tracking was demonstrated using two Scheimpflug optical setups, telecentric in both image and object spaces, with different optical magnifications and nominal diffraction-limited performance over an ∼18 mm full field of view illuminated with 940 nm light. Eye images from subjects with different iris and skin pigmentation captured at this wavelength suggest that the proposed pupil tracking does not suffer from ethnic bias. The optical axis of the setups is tilted at 45° to facilitate integration with other instruments without the need for beam splitting. Tracking with ∼0.9-4.4 µm precision and safe light levels was demonstrated using two complementary metal-oxide-semiconductor cameras with global shutter, operating at 438 and 1,045 fps with an ∼500 × 420 pixel region of interest (ROI), and at 633 and 1,897 fps with ∼315 × 280 pixel ROI. For these image sizes, the desktop computers achieved calculation times as low as 0.5 ms, while low-cost embedded computers delivered calculation times in the 0.8-1.3 ms range.

摘要

我们在具有终端用户离散和集成中央处理器(CPU)以及图形处理器(GPU)的计算平台上,使用高级编程来探索基于摄像头的瞳孔跟踪技术,旨在实现此前通过专用硬件和编程才能达到的低计算延迟(Kowalski等人,[《生物医学光学快报》12, 6496 (2021)10.1364/BOE.433766])。我们测试了各种台式机和嵌入式计算机,其中一些配备了两种操作系统,采用传统的顺序瞳孔跟踪范式,即摄像头图像在完全下载到计算机后才开始处理。使用两种施密特-普吕克光学装置演示了瞳孔跟踪,这两种装置在图像空间和物空间均为远心,具有不同的光学放大倍数,并且在约18毫米的全视场范围内,在940纳米光照射下具有标称的衍射极限性能。在该波长下捕获的不同虹膜和皮肤色素沉着受试者的眼睛图像表明,所提出的瞳孔跟踪不存在种族偏差。这些装置的光轴倾斜45°,以便于与其他仪器集成,而无需分光。使用两个具有全局快门的互补金属氧化物半导体相机进行了演示,在约500×420像素感兴趣区域(ROI)下,帧率分别为438和1045帧/秒,在约315×280像素ROI下,帧率分别为633和1897帧/秒,实现了约0.9 - 4.4微米的跟踪精度和安全的光水平。对于这些图像尺寸,台式计算机的计算时间低至0.5毫秒,而低成本嵌入式计算机的计算时间在0.8 - 1.3毫秒范围内。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/a0f73da80453/boe-15-12-6799-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/2c3315c9b9a9/boe-15-12-6799-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/6cd38604808b/boe-15-12-6799-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/66487a8fd773/boe-15-12-6799-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/f5a2e22e02b1/boe-15-12-6799-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/314ca2edf15d/boe-15-12-6799-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/39a19d038783/boe-15-12-6799-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/e5022706fd5e/boe-15-12-6799-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/8ed7dff9221b/boe-15-12-6799-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/e9615901c350/boe-15-12-6799-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/a0f73da80453/boe-15-12-6799-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/2c3315c9b9a9/boe-15-12-6799-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/6cd38604808b/boe-15-12-6799-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/66487a8fd773/boe-15-12-6799-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/f5a2e22e02b1/boe-15-12-6799-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/314ca2edf15d/boe-15-12-6799-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/39a19d038783/boe-15-12-6799-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/e5022706fd5e/boe-15-12-6799-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/8ed7dff9221b/boe-15-12-6799-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/e9615901c350/boe-15-12-6799-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8048/11640584/a0f73da80453/boe-15-12-6799-g010.jpg

相似文献

1
Embedded CPU-GPU pupil tracking.嵌入式CPU-GPU瞳孔追踪。
Biomed Opt Express. 2024 Nov 13;15(12):6799-6815. doi: 10.1364/BOE.541421. eCollection 2024 Dec 1.
2
Hybrid FPGA-CPU pupil tracker.混合式现场可编程门阵列-中央处理器瞳孔追踪器。
Biomed Opt Express. 2021 Sep 22;12(10):6496-6513. doi: 10.1364/BOE.433766. eCollection 2021 Oct 1.
3
Exploiting graphics processing units for computational biology and bioinformatics.利用图形处理单元进行计算生物学和生物信息学。
Interdiscip Sci. 2010 Sep;2(3):213-20. doi: 10.1007/s12539-010-0002-4. Epub 2010 Jul 25.
4
High performance computing for deformable image registration: towards a new paradigm in adaptive radiotherapy.用于可变形图像配准的高性能计算:迈向自适应放射治疗的新范式。
Med Phys. 2008 Aug;35(8):3546-53. doi: 10.1118/1.2948318.
5
Ultra-fast digital tomosynthesis reconstruction using general-purpose GPU programming for image-guided radiation therapy.基于通用 GPU 编程的用于图像引导放射治疗的超快速数字断层合成重建。
Technol Cancer Res Treat. 2011 Aug;10(4):295-306. doi: 10.7785/tcrt.2012.500206.
6
Efficient methods for implementation of multi-level nonrigid mass-preserving image registration on GPUs and multi-threaded CPUs.在图形处理器(GPU)和多线程中央处理器(CPU)上实现多级非刚性质量守恒图像配准的高效方法。
Comput Methods Programs Biomed. 2016 Apr;127:290-300. doi: 10.1016/j.cmpb.2015.12.018. Epub 2016 Jan 6.
7
GPU/CPU Algorithm for Generalized Born/Solvent-Accessible Surface Area Implicit Solvent Calculations.用于广义玻恩/溶剂可及表面积隐式溶剂计算的GPU/CPU算法
J Chem Theory Comput. 2012 Jul 10;8(7):2521-2530. doi: 10.1021/ct3003089. Epub 2012 Jun 15.
8
GPU computing for systems biology.GPU 计算在系统生物学中的应用。
Brief Bioinform. 2010 May;11(3):323-33. doi: 10.1093/bib/bbq006. Epub 2010 Mar 7.
9
Accelerating epistasis analysis in human genetics with consumer graphics hardware.利用消费级图形硬件加速人类遗传学中的上位性分析。
BMC Res Notes. 2009 Jul 24;2:149. doi: 10.1186/1756-0500-2-149.
10
Embedded-Based Graphics Processing Unit Cluster Platform for Multiple Sequence Alignments.用于多序列比对的基于嵌入式的图形处理单元集群平台
Evol Bioinform Online. 2017 Aug 8;13:1176934317724764. doi: 10.1177/1176934317724764. eCollection 2017.

本文引用的文献

1
Hybrid FPGA-CPU pupil tracker.混合式现场可编程门阵列-中央处理器瞳孔追踪器。
Biomed Opt Express. 2021 Sep 22;12(10):6496-6513. doi: 10.1364/BOE.433766. eCollection 2021 Oct 1.
2
Eye Tracking in Virtual Reality.虚拟现实中的眼动追踪
J Eye Mov Res. 2019 Apr 5;12(1). doi: 10.16910/jemr.12.1.3.
3
Accuracy comparison across face recognition algorithms: Where are we on measuring race bias?不同人脸识别算法的准确性比较:在衡量种族偏见方面我们处于什么位置?
IEEE Trans Biom Behav Identity Sci. 2021 Jan;3(1):101-111. doi: 10.1109/TBIOM.2020.3027269. Epub 2020 Sep 29.
4
Integrating Eye-Tracking to Augmented Reality System for Surgical Training.将眼动追踪技术集成到增强现实手术训练系统中。
J Med Syst. 2020 Sep 29;44(11):192. doi: 10.1007/s10916-020-01656-w.
5
Pupil motion analysis and tracking in ophthalmic systems equipped with wavefront sensing technology.配备波前传感技术的眼科系统中的瞳孔运动分析与跟踪
Appl Opt. 2017 Mar 20;56(9):D66-D71. doi: 10.1364/AO.56.000D66.
6
Pupil Tracking for Real-Time Motion Corrected Anterior Segment Optical Coherence Tomography.用于实时运动校正眼前节光学相干断层扫描的瞳孔追踪
PLoS One. 2016 Aug 30;11(8):e0162015. doi: 10.1371/journal.pone.0162015. eCollection 2016.
7
Pupil tracking optical coherence tomography for precise control of pupil entry position.用于精确控制瞳孔入射位置的瞳孔跟踪光学相干断层扫描技术。
Biomed Opt Express. 2015 Aug 17;6(9):3405-19. doi: 10.1364/BOE.6.003405. eCollection 2015 Sep 1.
8
Lens oscillations in the human eye. Implications for post-saccadic suppression of vision.人眼的晶状体振荡。对眼跳后抑制视觉的影响。
PLoS One. 2014 Apr 22;9(4):e95764. doi: 10.1371/journal.pone.0095764. eCollection 2014.
9
Monitoring vigilance during perimetry by using pupillography.利用瞳孔描记术监测视野检查期间的警觉性。
Invest Ophthalmol Vis Sci. 2010 Jul;51(7):3540-3. doi: 10.1167/iovs.09-4413. Epub 2010 Mar 5.
10
In the eye of the beholder: a survey of models for eyes and gaze.在观察者的眼中:眼睛和注视模型的调查。
IEEE Trans Pattern Anal Mach Intell. 2010 Mar;32(3):478-500. doi: 10.1109/TPAMI.2009.30.