Tung Whye Loon, Quek Chai
Centre for Computational Intelligence, School of Computer Engineering, Nanyang Technological University, Singapore.
IEEE Trans Neural Netw. 2010 Jan;21(1):136-57. doi: 10.1109/TNN.2009.2035116. Epub 2009 Dec 11.
Fuzzy rule-based systems (FRBSs) have been successfully applied to many areas. However, traditional fuzzy systems are often manually crafted, and their rule bases that represent the acquired knowledge are static and cannot be trained to improve the modeling performance. This subsequently leads to intensive research on the autonomous construction and tuning of a fuzzy system directly from the observed training data to address the knowledge acquisition bottleneck, resulting in well-established hybrids such as neural-fuzzy systems (NFSs) and genetic fuzzy systems (GFSs). However, the complex and dynamic nature of real-world problems demands that fuzzy rule-based systems and models be able to adapt their parameters and ultimately evolve their rule bases to address the nonstationary (time-varying) characteristics of their operating environments. Recently, considerable research efforts have been directed to the study of evolving Tagaki-Sugeno (T-S)-type NFSs based on the concept of incremental learning. In contrast, there are very few incremental learning Mamdani-type NFSs reported in the literature. Hence, this paper presents the evolving neural-fuzzy semantic memory (eFSM) model, a neural-fuzzy Mamdani architecture with a data-driven progressively adaptive structure (i.e., rule base) based on incremental learning. Issues related to the incremental learning of the eFSM rule base are carefully investigated, and a novel parameter learning approach is proposed for the tuning of the fuzzy set parameters in eFSM. The proposed eFSM model elicits highly interpretable semantic knowledge in the form of Mamdani-type if-then fuzzy rules from low-level numeric training data. These Mamdani fuzzy rules define the computing structure of eFSM and are incrementally learned with the arrival of each training data sample. New rules are constructed from the emergence of novel training data and obsolete fuzzy rules that no longer describe the recently observed data trends are pruned. This enables eFSM to maintain a current and compact set of Mamdani-type if-then fuzzy rules that collectively generalizes and describes the salient associative mappings between the inputs and outputs of the underlying process being modeled. The learning and modeling performances of the proposed eFSM are evaluated using several benchmark applications and the results are encouraging.
基于模糊规则的系统(FRBSs)已成功应用于许多领域。然而,传统的模糊系统通常是人工构建的,其表示所获取知识的规则库是静态的,无法通过训练来提高建模性能。这随后引发了对直接从观测到的训练数据中自主构建和调整模糊系统以解决知识获取瓶颈的深入研究,从而产生了诸如神经模糊系统(NFSs)和遗传模糊系统(GFSs)等成熟的混合系统。然而,现实世界问题的复杂性和动态性要求基于模糊规则的系统和模型能够调整其参数,并最终演化其规则库以应对其运行环境的非平稳(时变)特性。最近,大量的研究工作致力于基于增量学习概念的演化Takagi-Sugeno(T-S)型NFSs的研究。相比之下,文献中报道的增量学习Mamdani型NFSs非常少。因此,本文提出了演化神经模糊语义记忆(eFSM)模型,这是一种基于增量学习的数据驱动渐进自适应结构(即规则库)的神经模糊Mamdani架构。仔细研究了与eFSM规则库增量学习相关的问题,并提出了一种新颖的参数学习方法来调整eFSM中的模糊集参数。所提出的eFSM模型从低级数值训练数据中以Mamdani型if-then模糊规则的形式引出高度可解释的语义知识。这些Mamdani模糊规则定义了eFSM的计算结构,并随着每个训练数据样本的到来而增量学习。新规则根据新出现的训练数据构建,不再描述最近观测到的数据趋势的过时模糊规则被修剪。这使得eFSM能够维护一组当前且紧凑的Mamdani型if-then模糊规则,这些规则共同概括并描述了所建模的基础过程的输入和输出之间的显著关联映射。使用几个基准应用评估了所提出的eFSM的学习和建模性能,结果令人鼓舞。