Normalized mutual information feature selection.
作者信息
Estévez Pablo A, Tesmer Michel, Perez Claudio A, Zurada Jacek M
机构信息
Department of Electrical Engineering, University of Chile, Casilla 412-3, Santiago 8370451, Chile.
出版信息
IEEE Trans Neural Netw. 2009 Feb;20(2):189-201. doi: 10.1109/TNN.2008.2005601. Epub 2009 Jan 13.
A filter method of feature selection based on mutual information, called normalized mutual information feature selection (NMIFS), is presented. NMIFS is an enhancement over Battiti's MIFS, MIFS-U, and mRMR methods. The average normalized mutual information is proposed as a measure of redundancy among features. NMIFS outperformed MIFS, MIFS-U, and mRMR on several artificial and benchmark data sets without requiring a user-defined parameter. In addition, NMIFS is combined with a genetic algorithm to form a hybrid filter/wrapper method called GAMIFS. This includes an initialization procedure and a mutation operator based on NMIFS to speed up the convergence of the genetic algorithm. GAMIFS overcomes the limitations of incremental search algorithms that are unable to find dependencies between groups of features.