Division of Bioengineering, Graduate School of Engineering Science, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka, 5608531, Japan.
Niels Bohr Institute, University of Copenhagen, Blegdamsvej 17, 2100, Copenhagen, Denmark.
Commun Biol. 2022 Apr 14;5(1):361. doi: 10.1038/s42003-022-03288-x.
Combining experiments with artificial intelligence algorithms, we propose a machine learning based approach called wrinkle force microscopy (WFM) to extract the cellular force distributions from the microscope images. The full process can be divided into three steps. First, we culture the cells on a special substrate allowing to measure both the cellular traction force on the substrate and the corresponding substrate wrinkles simultaneously. The cellular forces are obtained using the traction force microscopy (TFM), at the same time that cell-generated contractile forces wrinkle their underlying substrate. Second, the wrinkle positions are extracted from the microscope images. Third, we train the machine learning system with GAN (generative adversarial network) by using sets of corresponding two images, the traction field and the input images (raw microscope images or extracted wrinkle images), as the training data. The network understands the way to convert the input images of the substrate wrinkles to the traction distribution from the training. After sufficient training, the network is utilized to predict the cellular forces just from the input images. Our system provides a powerful tool to evaluate the cellular forces efficiently because the forces can be predicted just by observing the cells under the microscope, which is much simpler method compared to the TFM experiment. Additionally, the machine learning based approach presented here has the profound potential for being applied to diverse cellular assays for studying mechanobiology of cells.
我们结合实验和人工智能算法,提出了一种基于机器学习的方法,称为皱纹力显微镜(WFM),从显微镜图像中提取细胞力分布。整个过程可以分为三个步骤。首先,我们在特殊的基底上培养细胞,允许同时测量细胞对基底的牵引力和相应的基底皱纹。使用牵引力显微镜(TFM)获得细胞力,同时细胞产生的收缩力使它们下面的基底起皱。其次,从显微镜图像中提取皱纹位置。第三,我们通过使用一系列对应的两幅图像,即牵引力场和输入图像(原始显微镜图像或提取的皱纹图像),来训练 GAN(生成对抗网络)的机器学习系统作为训练数据。网络理解将基底皱纹的输入图像转换为从训练中获得的牵引力分布的方法。经过充分的训练,该网络可以仅通过观察显微镜下的细胞来预测细胞力。我们的系统提供了一种评估细胞力的强大工具,因为与 TFM 实验相比,仅通过观察显微镜下的细胞就可以预测力,这是一种更简单的方法。此外,这里提出的基于机器学习的方法具有广泛应用于研究细胞机械生物学的各种细胞测定的巨大潜力。