Computer Science ›› 2019, Vol. 46 ›› Issue (6): 322-327.doi: 10.11896/j.issn.1002-137X.2019.06.049

Special Issue: Face Recognition

Previous Articles     Next Articles

Face Expression Recognition Model Based on Enhanced Head Pose Estimation

CUI Jing-chun, WANG Jing   

  1. (School of Computer Science and Technology,Nanjing Tech University,Nanjing 211816,China)
  • Received:2018-05-21 Published:2019-06-24

Abstract: Aiming at the problem that the existing expression recognition algorithm does not consider the head pose and cannot use the high-pixel picture,this paper proposed a model based on the random forest algorithm-head pose estimation (RF-HPE) network combining a convolutional neural network.First,the input image is normalized by intensity.Then the key points of the face marker are determined by using RF-HPE to determine the position of the face marker.Finally,a convolutional neural network is used to extract features and train model.This model reduces the influence of light intensity on the recognition result and improves the training accuracy without sacrificing the efficiency of the algorithm.Experimental results show that the improved model has greater advantages than other similar models,and the classification accuracy is also significantly improved.

Key words: Expression recognition, Head pose estimation, Intensity normalization, Random forest algorithm

CLC Number: 

  • TP183
[1]ZOU G F,FU G X,LI H T,et al.A Survey of Multi-pose Face Recognition [J].Pattern Recognition and Artificial Intelligence,2015,28(7):613-625.(in Chinese)
邹国锋,傅桂霞,李海涛,等.多姿态人脸识别综述[J].模式识别与人工智能,2015,28(7):613-625.
[2]LEVI G,HASSNER T.Emotion Recognition in the Wild via Convolutional Neural Networks and Mapped Binary Patterns[C]∥ACM on International Conference on Multimodal Interaction.ACM,2015:503-510.
[3]WANG D W,ZHOU J,MEI H Y,et al.Summary of facial expression recognition[J].Computer Engineering and Applications,2014,50(20):149-157.(in Chinese)
王大伟,周军,梅红岩,等.人脸表情识别综述[J].计算机工程与应用,2014,50(20):149-157.
[4]ZHANG Z,LUO P,CHEN C L,et al.From Facial Expression Recognition to Interpersonal Relation Prediction[J].International Journal of Computer Vision,2018,126(5):550-569.
[5]HAPPY S L,ROUTRAY A.Automatic facial expression recog-nition using features of salient facial patches[J].IEEE Transactions on Affective Computing,2015,6(1):1-12.
[6]GIRSHICK R.Fast R-CNN[J].Computer Science,arXiv:1504.08083.
[7]ZHOU E,FAN H,CAO Z,et al.Extensive Facial Landmark Lo-calization with Coarse-to-Fine Convolutional Network Cascade[C]∥IEEE International Conference on Computer Vision Workshops.IEEE Computer Society,2013:386-391.
[8]KOTSIA I,ZAFEIRIOU S,PITAS I.Texture and shape information fusion for facial expression and facial action unit recognition[C]∥First International Conference on Advances in Computer-Human Interaction.IEEE,2008:833-851.
[9]PIETIKINEN M,HADID A,ZHAO G,et al.Computer Vision Using Local Binary Patterns[M].Springer London,2011.
[10]LECUN Y,BOTTOU L,BENGIO Y,et al.Gradient-based learning applied to document recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324.
[11]LOPES A T,AGUIAR E D,SOUZA A F D,et al.Facial Expression Recognition with Convolutional Neural Networks:Co-ping with Few Data and the Training Sample Order[J].Pattern Recognition,2016,61:610-628.
[12]WANI F J,RIZVI S E H,SHARMA M K,et al.A study on cross validation for model selection and estimation[J].International Journal of Agricultural Sciences,2018,14:165-172.
[13]LIU M,SHAN S,WANG R,et al.Learning Expressionlets on Spatio-temporal Manifold for Dynamic Facial Expression Recognition[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2014:1749-1756.
[14]JUNG H,LEE S,YIM J,et al.Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition[C]∥IEEE International Conference on Computer Vision.IEEE Computer Society,2015:2983-2991.
[15]VALSTAR M F,JIANG B,MEHU M,et al.The first facial expression recognition and analysis challenge[C]∥IEEE International Conference on Automatic Face & Gesture Recognition and Workshops.IEEE,2011:921-926.
[1] ZHANG Jia-hao, LIU Feng, QI Jia-yin. Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer [J]. Computer Science, 2022, 49(6A): 370-377.
[2] WANG Wen-qiang, JIA Xing-xing, LI Peng. Adaptive Ensemble Ordering Algorithm [J]. Computer Science, 2022, 49(6A): 242-246.
[3] LI Xing-ran, ZHANG Li-yan, YAO Shu-jing. Micro-expression Recognition Method Combining Feature Fusion and Attention Mechanism [J]. Computer Science, 2022, 49(2): 4-11.
[4] LIANG Zheng-you, HE Jing-lin, SUN Yu. Three-dimensional Convolutional Neural Network Evolution Method for Facial Micro-expression Auto-recognition [J]. Computer Science, 2020, 47(8): 227-232.
[5] JIANG Bin,GAN Yong,ZHANG Huan-long,ZHANG Qiu-wen. Survey on Non-frontal Facial Expression Recognition Methods [J]. Computer Science, 2019, 46(3): 53-62.
[6] DU Jin, CHEN Yun-hua, ZHANG Ling, MAI Ying-chao. Energy-efficient Facial Expression Recognition Based on Improved Deep Residual Networks [J]. Computer Science, 2018, 45(9): 303-307.
[7] LIU Tao, ZHOU Xian-chun, YAN Xi-jun. LDA Facial Expression Recognition Algorithm Combining Optical Flow Characteristics with Gaussian [J]. Computer Science, 2018, 45(10): 286-290.
[8] HUANG Jian, LI Wen-shu and GAO Yu-juan. Research Advance of Facial Expression Recognition [J]. Computer Science, 2016, 43(Z11): 123-126.
[9] GE Yun. 3D Face Expression Recognition Based on Differential Operator [J]. Computer Science, 2014, 41(Z11): 128-132.
[10] PENG Hui. Research on Gabor Wavelet Transform Feature Recognition Robustness Based on Vector of Face [J]. Computer Science, 2014, 41(2): 308-311.
[11] YANG Ning,ZHANG Hong. Non-contact Health Monitoring System Based on the Internet of Things and Expression Recognition [J]. Computer Science, 2011, 38(Z10): 10-11.
[12] JIANG Bin,JIA Ke-bin,YANG Guo-sheng. Research Advance of Facial Expression Recognition [J]. Computer Science, 2011, 38(4): 25-31.
[13] . [J]. Computer Science, 2009, 36(5): 262-264.
[14] WANG Rong, MA Xi- rong (College of Computer and Information Engineering, Tianjin Normal University, Tianjin 300387). [J]. Computer Science, 2009, 36(1): 231-233.
[15] . [J]. Computer Science, 2009, 36(1): 181-183.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!