Department of Computer Science and Information Engineering, National Yunlin University of Science and Technology, Yunlin 64002, Taiwan.
Artificial Intelligence Recognition Industry Service Research Center, National Yunlin University of Science and Technology, Yunlin 64002, Taiwan.
Sensors (Basel). 2021 Mar 16;21(6):2077. doi: 10.3390/s21062077.
The life cycle of leaves, from sprout to senescence, is the phenomenon of regular changes such as budding, branching, leaf spreading, flowering, fruiting, leaf fall, and dormancy due to seasonal climate changes. It is the effect of temperature and moisture in the life cycle on physiological changes, so the detection of newly grown leaves (NGL) is helpful for the estimation of tree growth and even climate change. This study focused on the detection of NGL based on deep learning convolutional neural network (CNN) models with sparse enhancement (SE). As the NGL areas found in forest images have similar sparse characteristics, we used a sparse image to enhance the signal of the NGL. The difference between the NGL and the background could be further improved. We then proposed hybrid CNN models that combined U-net and SegNet features to perform image segmentation. As the NGL in the image were relatively small and tiny targets, in terms of data characteristics, they also belonged to the problem of imbalanced data. Therefore, this paper further proposed 3-Layer SegNet, 3-Layer U-SegNet, 2-Layer U-SegNet, and 2-Layer Conv-U-SegNet architectures to reduce the pooling degree of traditional semantic segmentation models, and used a loss function to increase the weight of the NGL. According to the experimental results, our proposed algorithms were indeed helpful for the image segmentation of NGL and could achieve better kappa results by 0.743.
叶片的生命周期,从萌芽到衰老,是由于季节气候变化而出现的定期变化现象,如萌芽、分枝、叶片展开、开花、结果、落叶和休眠。这是生命周期中温度和水分对生理变化的影响,因此检测新生长的叶片(NGL)有助于估计树木的生长甚至气候变化。本研究基于深度学习卷积神经网络(CNN)模型,使用稀疏增强(SE)方法,重点研究了 NGL 的检测。由于森林图像中发现的 NGL 区域具有相似的稀疏特征,因此我们使用稀疏图像来增强 NGL 的信号。可以进一步提高 NGL 和背景之间的差异。然后,我们提出了结合 U-net 和 SegNet 特征的混合 CNN 模型,以执行图像分割。由于图像中的 NGL 相对较小且为微小目标,从数据特征来看,它们也属于不平衡数据问题。因此,本文进一步提出了 3 层 SegNet、3 层 U-SegNet、2 层 U-SegNet 和 2 层 Conv-U-SegNet 架构,以降低传统语义分割模型的池化程度,并使用损失函数增加 NGL 的权重。根据实验结果,我们提出的算法确实有助于 NGL 的图像分割,可以通过 0.743 实现更好的 kappa 结果。