Abstract Both PCA and LDA are performed by only using the second-order statistics among image pixels, and not sensitive to high order statistics in the data. In this paper, the kernel function method is used to extract the high order relations, and the Linear Support Vector Machines (LSVM) is selected to perform the face classification. The experiment on Yale face database shows that the nonlinear feature extraction method is effective, and SVM is better than nearest neighbor classifier.