Department of Biomedical Engineering, National Taiwan University, Taipei, 10051, Taiwan.
Institute of Medical Device and Imaging, National Taiwan University, Taipei, 10051, Taiwan.
Adv Sci (Weinh). 2024 May;11(20):e2307837. doi: 10.1002/advs.202307837. Epub 2024 Mar 15.
Endo-microscopy is crucial for real-time 3D visualization of internal tissues and subcellular structures. Conventional methods rely on axial movement of optical components for precise focus adjustment, limiting miniaturization and complicating procedures. Meta-device, composed of artificial nanostructures, is an emerging optical flat device that can freely manipulate the phase and amplitude of light. Here, an intelligent fluorescence endo-microscope is developed based on varifocal meta-lens and deep learning (DL). The breakthrough enables in vivo 3D imaging of mouse brains, where varifocal meta-lens focal length adjusts through relative rotation angle. The system offers key advantages such as invariant magnification, a large field-of-view, and optical sectioning at a maximum focal length tuning range of ≈2 mm with 3 µm lateral resolution. Using a DL network, image acquisition time and system complexity are significantly reduced, and in vivo high-resolution brain images of detailed vessels and surrounding perivascular space are clearly observed within 0.1 s (≈50 times faster). The approach will benefit various surgical procedures, such as gastrointestinal biopsies, neural imaging, brain surgery, etc.
内窥显微镜对于实时 3D 可视化内部组织和亚细胞结构至关重要。传统方法依赖于光学组件的轴向运动来进行精确的焦点调整，这限制了微型化并使操作复杂化。元器件由人工纳米结构组成，是一种新兴的光学平板器件，可以自由地操控光的相位和幅度。在此，基于变焦点元透镜和深度学习 (DL) 开发了一种智能荧光内窥显微镜。该突破实现了对小鼠大脑的活体 3D 成像，其中变焦点元透镜的焦距通过相对旋转角度进行调整。该系统具有不变的放大率、大视野和光学切片等关键优势，在最大焦距调节范围内为 ≈2mm，具有 3µm 的横向分辨率。通过使用 DL 网络，大大减少了图像采集时间和系统复杂性，并且在 0.1s 内（约快 50 倍）可以清楚地观察到体内高分辨率的详细血管和周围血管周围空间的大脑图像。该方法将有益于各种手术程序，例如胃肠道活检、神经成像、脑部手术等。
