Facial Expression Recognition Based on Local Texture and Shape Features
HU Min①② TENG Wendi①② WANG Xiaohua①② XU Liangfeng① YANG Juan①
①(School of Computer and Information of Hefei University of Technology, Hefei 230009, China) ②(Anhui Province Key Laboratory of Affective Computing and Advanced Intelligent Machine, Hefei 230009, China)
Abstract：In order to improve the inadequacies of Local Binary Pattern (LBP), Center-Symmetric Local Binary Pattern (CS-LBP) and Histogram of Oriented Gradient (HOG) algorithm, Center-Symmetric Local Smooth Binary Pattern (CS-LSBP) and Histogram of Oriented Absolute Gradient (HOAG) are proposed, and a facial expression recognition method based on local texture and local shape features is proposed in this paper. Firstly, CS-LSBP and HOAG are used to extract two local features of expression image of the face. Then, Canonical Correlation Analysis (CCA) is used to fuse two local features. Finally, Support Vector Machine (SVM) is performed for the expression classification. Experimental results on JAFFE and Cohn-Kanade (CK) facial expression databases show that, the improved feature extraction method can extract the detail information of the image more completely and accurately. And the fusion method based on CCA can give full play to the representation ability of each feature. The facial expression recognition method proposed in this paper obtains a better recognition effect.
胡敏,滕文娣,王晓华,许良凤,杨娟. 融合局部纹理和形状特征的人脸表情识别[J]. 电子与信息学报, 2018, 40(6): 1338-1344.
HU Min, TENG Wendi, WANG Xiaohua, XU Liangfeng, YANG Juan. Facial Expression Recognition Based on Local Texture and Shape Features. JEIT, 2018, 40(6): 1338-1344.
KYPEROUNTAS M, TEFAS A, and PITAS I. Salient feature and reliable classifier selection for facial expression classification[J]. Pattern Recognition, 2010, 43(3): 972-986. doi: 10.1016/j.patcog.2009.07.007.
FU Xiaofeng and WEI Wei. Facial expression recognition based on multi-scale centralized binary pattern[J]. Control Theory & Applications, 2009, 26(6): 629-633.
[3]
UÇAR A, DEMIR Y, and GÜZELI C. A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering[J]. Neural Computing and Applications, 2016, 27(1): 131-142. doi: 10.1007/s00521-014-1569-1.
[4]
TAN H C, ZHANG Y J, HAO C, et al. Person-independent expression recognition based on person-similarity weighted expression feature[J]. Journal of Systems Engineering and Electronics, 2010, 21(1): 118-126. doi: 10.3969/j.issn.1004- 4132.2010.01.019.
[5]
ZHANG S, ZHAO X, and LEI B. Facial expression recognition based on local binary patterns and local fisher discriminant analysis[J]. WSEAS Transactions on Signal Processing, 2012, 8(1): 21-31.
[6]
WANG Z, RUAN Q, and AN G. Facial expression recognition using sparse local Fisher discriminant analysis[J]. Neurocomputing, 2016, 174(174): 756-766. doi: 10.1016/ j.neucom.2015.09.083.
[7]
ZHAO X and ZHANG S. Facial expression recognition based on local binary patterns and kernel discriminant isomap[J]. Sensors, 2011, 11(10): 9573-9588. doi: 10.3390/s111009573.
[8]
CHEN J, TAKIGUCHI T, and ARIKI Y. Rotation-reversal invariant HOG cascade for facial expression recognition[J]. Signal Image & Video Processing, 2017(1-3): 1-8. doi: 10.1007 /s11760-017-1111-x.
[9]
HEGDE G, SEETHA M, and HEGDE N. Facial expression recognition using entire gabor filter matching score level fusion approach based on subspace methods[J]. Microelectronics Reliability, 2015, 52(3): 497-502. doi: 10.1007/978-3-319-26832-3_6.
[10]
ZHOU H, LAM K M, and HE X. Shape-appearance- correlated active appearance model[J]. Pattern Recognition, 2016, 56(C): 88-99. doi: 10.1016/j.patcog.2016.03.002.
[11]
OJALA T, PIETIKÄINEN M, and HARWOOD D. A comparative study of texture measures with classification based on featured distributions[J]. Pattern recognition, 1996, 29(1): 51-59. doi: 10.1016/0031-3203(95)00067-4.
[12]
HEIKKILÄ M, PIETIKÄINEN M, and SCHMID C. Description of interest regions with local binary patterns[J]. Pattern Recognition, 2009, 42(3): 425-436. doi: 10.1016/ j.patcog.2008.08.014.
WANG Xiaohua, LI Ruijing, HU Min, et al. Occluded facial expression recognition based on the fusion of local features[J]. Journal of Image and Graphics, 2016, 21(11): 1473-1482. doi: 10.11834/jig.20161107.
YANG Liping and GU Xiaohua. Relative gradient histogram features for face recognition[J]. Optics and Precision Engineering, 2014, 22(1): 152-159. doi: 10.3788/OPE. 20142201.0152.
LIU Shuishi, TIAN Yantao, and WAN Chuan. Facial expression recognition method based on gabor multi- orientation features fusion and block histogram[J]. Acta Automatica Sinica, 2011, 37(12): 1455-1463. doi: 10.3724 /SP.J.1004.2011.01455.
[16]
TURAN C and LAM K M. Region-based feature fusion for facial-expression recognition[C]. IEEE International Conference on Image Processing, Paris, 2014: 5966-5970. doi: 10.1109/ICIP.2014.7026204.
YI Jizheng, MAO Xia, ISHIZUKA M, et al. Facial expression recognition based on feature point vector and texture deformation energy parameters[J]. Journal of Electronics & Information Technology, 2013, 35(10): 2403-2410. doi: 10.3724/SP.J.1146.2012.01569.
HU Min, JIANG He, WANG Xiaohua, et al. A hierarchical classification method of expressions based on geometric and texture features[J]. Acta Electronica Sinica, 2017, 45(1): 164-172. doi: 10.3969/j.issn.0372-2112.2017.01.023.
SUN Quansen, ZENG Shenggen, WANG Pingan, et al. The theory of canonical correlation analysis and its application to feature fusion[J]. Chinese Journal of Computers, 2005, 28(9): 1524-1533. doi: 10.3321/j.issn:0254-4164.2005.09.015.
