Anagnostopoulo Georgios C, Georgiopoulos Michael
School of Electrical Engineering and Computer Science, University of Central Florida, Orlando 32816, USA.
Neural Netw. 2002 Dec;15(10):1205-21. doi: 10.1016/s0893-6080(02)00063-1.
In this paper we introduce novel geometric concepts, namely category regions, in the original framework of Fuzzy-ART (FA) and Fuzzy-ARTMAP (FAM). The definitions of these regions are based on geometric interpretations of the vigilance test and the F2 layer competition of committed nodes with uncommitted ones, that we call commitment test. It turns out that not only these regions have the same geometrical shape (polytope structure), but they also share a lot of common and interesting properties that are demonstrated in this paper. One of these properties is the shrinking of the volume that each one of these polytope structures occupies, as training progresses, which alludes to the stability of learning in FA and FAM, a well-known result. Furthermore, properties of learning of FA and FAM are also proven utilizing the geometrical structure and properties that these regions possess; some of these properties were proven before using counterintuitive, algebraic manipulations and are now demonstrated again via intuitive geometrical arguments. One of the results that is worth mentioning as having practical ramifications is the one which states that for certain areas of the vigilance-choice parameter space (rho,a), the training and performance (testing) phases of FA and FAM do not depend on the particular choices of the vigilance parameter. Finally, it is worth noting that, although the idea of the category regions has been developed under the premises of FA and FAM, category regions are also meaningful for later developed ART neural network structures, such as ARTEMAP, ARTMAP-IC, Boosted ARTMAP, Micro-ARTMAP, Ellipsoid-ART/ARTMAP, among others.
在本文中,我们在模糊自适应共振理论(Fuzzy-ART,FA)和模糊自适应共振理论映射(Fuzzy-ARTMAP,FAM)的原始框架中引入了新颖的几何概念,即类别区域。这些区域的定义基于对警戒性测试以及已承诺节点与未承诺节点的F2层竞争(我们称之为承诺测试)的几何解释。结果表明,这些区域不仅具有相同的几何形状(多面体结构),而且还具有许多共同且有趣的特性,本文对此进行了论证。其中一个特性是,随着训练的进行,这些多面体结构中每一个所占据的体积会缩小,这暗示了FA和FAM中学习的稳定性,这是一个众所周知的结果。此外,还利用这些区域所具有的几何结构和特性证明了FA和FAM的学习特性;其中一些特性之前是通过反直觉的代数运算证明的,现在通过直观的几何论证再次得到证明。一个值得一提且具有实际意义的结果是,对于警戒性选择参数空间(rho,a)的某些区域,FA和FAM的训练和性能(测试)阶段不依赖于警戒参数的具体选择。最后,值得注意的是,尽管类别区域的概念是在FA和FAM的前提下发展起来的,但类别区域对于后来发展的ART神经网络结构,如ARTEMAP、ARTMAP-IC、增强型ARTMAP、微型ARTMAP、椭球体ART/ARTMAP等,也具有重要意义。