Information Discriminant Feature Extraction Based on Mutual Information Gradient Optimal Computation
Xie Wen-biao①②; Fan Shao-sheng①; Fei Hong-xiao②; Fan Xiao-ping②
①School of Electrical & Information Engineering, Changsha University of Science and Technology, Changsha 410004, China; ②School of Information Science and Engineering, Central South University, Changsha 410083, China
Abstract：A linear feature extraction method is present with information discriminant analysis, it is based on a feasible computationally feature extraction matrix used mutual information gradient. Firstly, this paper analyzes the limitation for current linear discriminant, and constructs a information discriminant analysis model which facilitates the maximization of the mutual information under the parametric class-conditional PDF. Then, it is proved that the mutual information is linear transformation invariance and optimal in the sense of Bayes, and the algorithm is present for computing feature extraction matrix with mutual information gradient. Finally, the good performance of the method is proved on real-world data set.
2009, Vol. 31 
