Kudryavtsev Andrey V, Dembélé Sounkalo, Piat Nadine
FEMTO-ST Institute, AS2M department, Univ. Bourgogne Franche-Comté, Univ. de Franche-Comté/CNRS/ENSMM, 24 rue Savary, Besançon F-25000, France.
Ultramicroscopy. 2017 Nov;182:216-225. doi: 10.1016/j.ultramic.2017.07.008. Epub 2017 Jul 12.
The sharpness of the images coming from a Scanning Electron Microscope (SEM) is a very important property for many computer vision applications at micro- and nanoscale. It represents how much object details are distinctive in the images: the object may be perceived sharp or blurred. Image sharpness highly depends on the value of focal distance, or working distance in the case of the SEM. Autofocus is the technique allowing to automatically adjust the working distance to maximize the sharpness. Most of the existing algorithms allows working only with a static object which is enough for the tasks of visualization, manual microanalysis or microcharacterization. These applications work with a low frame rate, less than 1 Hz, that guarantees a low level of noise. However, static autofocus can not be used for samples performing continuous 3D motion, which is the case of robotic applications where it is required to carry out a continuous 3D position measurement, e.g., nano-assembly or nanomanipulation. Moreover, in addition to constantly keeping object in focus while it is moving, it is required to perform the operation at high frame rate. The approach offering both these possibilities is presented in this paper and is referred as dynamic autofocus. The presented solution is based on stochastic optimization techniques. It allows tracking the maximum of the sharpness of the images without sweep and without training. It works under uncertainty conditions: presence of noise in images, unknown maximal sharpness and unknown 3D motion of the specimen. The experiments, that were performed with noisy images at high frame rate (5 Hz), were conducted on a Carl Zeiss Auriga 60 FE-SEM. They prove the robustness of the algorithm with respect to the variation of optimization parameters, object speed and magnification. Moreover, it is invariant to the object structure and its variation in time.
对于许多微米和纳米尺度的计算机视觉应用而言,扫描电子显微镜(SEM)所成图像的清晰度是一项非常重要的特性。它体现了图像中物体细节的清晰程度:物体可能看起来清晰或模糊。图像清晰度在很大程度上取决于焦距值,对于扫描电子显微镜而言则是工作距离。自动对焦是一种能自动调整工作距离以最大化图像清晰度的技术。现有的大多数算法仅适用于静态物体,这对于可视化、手动微分析或微表征任务来说已经足够。这些应用的帧率较低,低于1赫兹,可保证低噪声水平。然而,静态自动对焦无法用于进行连续三维运动的样本,例如在需要进行连续三维位置测量的机器人应用中,如纳米装配或纳米操作。此外,除了在物体移动时持续保持对焦外,还需要以高帧率执行该操作。本文提出了一种兼具这两种可能性的方法,称为动态自动对焦。所提出的解决方案基于随机优化技术。它能够在不进行扫描和训练的情况下跟踪图像清晰度的最大值。它在不确定条件下工作:图像中存在噪声、未知的最大清晰度以及样本的未知三维运动。在卡尔蔡司Auriga 60 FE - SEM上使用高帧率(5赫兹)的噪声图像进行了实验。实验证明了该算法在优化参数、物体速度和放大倍数变化方面的鲁棒性。此外,它对物体结构及其随时间的变化具有不变性。