Liu Feng, Quek Chai, Ng Geok See
Neural Comput. 2007 Jun;19(6):1656-80. doi: 10.1162/neco.2007.19.6.1656.
There are two important issues in neuro-fuzzy modeling: (1) interpretability--the ability to describe the behavior of the system in an interpretable way--and (2) accuracy--the ability to approximate the outcome of the system accurately. As these two objectives usually exert contradictory requirements on the neuro-fuzzy model, certain compromise has to be undertaken. This letter proposes a novel rule reduction algorithm, namely, Hebb rule reduction, and an iterative tuning process to balance interpretability and accuracy. The Hebb rule reduction algorithm uses Hebbian ordering, which represents the degree of coverage of the samples by the rule, as an importance measure of each rule to merge the membership functions and hence reduces the number of the rules. Similar membership functions (MFs) are merged by a specified similarity measure in an order of Hebbian importance, and the resultant equivalent rules are deleted from the rule base. The rule with a higher Hebbian importance will be retained among a set of rules. The MFs are tuned through the least mean square (LMS) algorithm to reduce the modeling error. The tuning of the MFs and the reduction of the rules proceed iteratively to achieve a balance between interpretability and accuracy. Three published data sets by Nakanishi (Nakanishi, Turksen, & Sugeno, 1993), the Pat synthetic data set (Pal, Mitra, & Mitra, 2003), and the traffic flow density prediction data set are used as benchmarks to demonstrate the effectiveness of the proposed method. Good interpretability, as well as high modeling accuracy, are derivable simultaneously and are suitably benchmarked against other well-established neuro-fuzzy models.
(1)可解释性——以可解释的方式描述系统行为的能力;(2)准确性——准确逼近系统结果的能力。由于这两个目标通常对神经模糊模型提出相互矛盾的要求,因此必须进行一定的折衷。本文提出了一种新颖的规则约简算法,即赫布规则约简,以及一种迭代调整过程,以平衡可解释性和准确性。赫布规则约简算法使用赫布排序(它表示规则对样本的覆盖程度)作为每个规则的重要性度量,以合并隶属函数,从而减少规则数量。相似的隶属函数通过指定的相似性度量按赫布重要性顺序进行合并,然后从规则库中删除由此产生的等效规则。在一组规则中,具有较高赫布重要性的规则将被保留。通过最小均方(LMS)算法对隶属函数进行调整,以减少建模误差。隶属函数的调整和规则的约简迭代进行,以在可解释性和准确性之间取得平衡。以西木(Nakanishi、Turksen和Sugeno,1993年)发表的三个数据集、帕特合成数据集(Pal、Mitra和Mitra,2003年)以及交通流密度预测数据集作为基准,来证明所提方法的有效性。该方法能够同时实现良好的可解释性以及较高的建模准确性,并且与其他成熟的神经模糊模型相比具有适当的基准优势。