计算机科学 ›› 2019, Vol. 46 ›› Issue (6): 322-327.doi: 10.11896/j.issn.1002-137X.2019.06.049

所属专题: 人脸识别

• 图形图像与模式识别 • 上一篇    下一篇

基于增强头部姿态估计的人脸表情识别模型

崔景春, 王静   

  1. (南京工业大学计算机科学与技术学院 南京211816)
  • 收稿日期:2018-05-21 发布日期:2019-06-24
  • 通讯作者: 王 静(1982-),女,副研究员,主要研究方向为无线传感器网络技术,E-mail:wj_cec@126.com
  • 作者简介:崔景春(1993-),男,硕士生,主要研究方向为机器学习与深度学习;
  • 基金资助:
    南京工业大学引进人才启动基金项目(39809110)资助。

Face Expression Recognition Model Based on Enhanced Head Pose Estimation

CUI Jing-chun, WANG Jing   

  1. (School of Computer Science and Technology,Nanjing Tech University,Nanjing 211816,China)
  • Received:2018-05-21 Published:2019-06-24

摘要: 针对现有表情识别算法未考虑头部姿态及不能使用高像素图像的问题,提出一种基于随机森林算法的头部姿态估计(RF-HPE)网络与卷积神经网络相结合的模型。首先对输入图像作强度归一化,然后利用RF-HPE确定脸部标志关键点,从而确定脸部标志的位置,最后使用卷积神经网络提取特征并训练模型。该模型降低了光线强度对识别结果的影响,并且在不牺牲算法效率的情况下提高了训练精度。实验结果表明,所提出的改进模型的学习能力相比其他同类模型有较大优势,分类精度也显著提高。

关键词: 表情识别, 强度归一化, 随机森林算法, 头部姿态估计

Abstract: Aiming at the problem that the existing expression recognition algorithm does not consider the head pose and cannot use the high-pixel picture,this paper proposed a model based on the random forest algorithm-head pose estimation (RF-HPE) network combining a convolutional neural network.First,the input image is normalized by intensity.Then the key points of the face marker are determined by using RF-HPE to determine the position of the face marker.Finally,a convolutional neural network is used to extract features and train model.This model reduces the influence of light intensity on the recognition result and improves the training accuracy without sacrificing the efficiency of the algorithm.Experimental results show that the improved model has greater advantages than other similar models,and the classification accuracy is also significantly improved.

Key words: Expression recognition, Head pose estimation, Intensity normalization, Random forest algorithm

中图分类号: 

  • TP183
[1]ZOU G F,FU G X,LI H T,et al.A Survey of Multi-pose Face Recognition [J].Pattern Recognition and Artificial Intelligence,2015,28(7):613-625.(in Chinese)
邹国锋,傅桂霞,李海涛,等.多姿态人脸识别综述[J].模式识别与人工智能,2015,28(7):613-625.
[2]LEVI G,HASSNER T.Emotion Recognition in the Wild via Convolutional Neural Networks and Mapped Binary Patterns[C]∥ACM on International Conference on Multimodal Interaction.ACM,2015:503-510.
[3]WANG D W,ZHOU J,MEI H Y,et al.Summary of facial expression recognition[J].Computer Engineering and Applications,2014,50(20):149-157.(in Chinese)
王大伟,周军,梅红岩,等.人脸表情识别综述[J].计算机工程与应用,2014,50(20):149-157.
[4]ZHANG Z,LUO P,CHEN C L,et al.From Facial Expression Recognition to Interpersonal Relation Prediction[J].International Journal of Computer Vision,2018,126(5):550-569.
[5]HAPPY S L,ROUTRAY A.Automatic facial expression recog-nition using features of salient facial patches[J].IEEE Transactions on Affective Computing,2015,6(1):1-12.
[6]GIRSHICK R.Fast R-CNN[J].Computer Science,arXiv:1504.08083.
[7]ZHOU E,FAN H,CAO Z,et al.Extensive Facial Landmark Lo-calization with Coarse-to-Fine Convolutional Network Cascade[C]∥IEEE International Conference on Computer Vision Workshops.IEEE Computer Society,2013:386-391.
[8]KOTSIA I,ZAFEIRIOU S,PITAS I.Texture and shape information fusion for facial expression and facial action unit recognition[C]∥First International Conference on Advances in Computer-Human Interaction.IEEE,2008:833-851.
[9]PIETIKINEN M,HADID A,ZHAO G,et al.Computer Vision Using Local Binary Patterns[M].Springer London,2011.
[10]LECUN Y,BOTTOU L,BENGIO Y,et al.Gradient-based learning applied to document recognition[J].Proceedings of the IEEE,1998,86(11):2278-2324.
[11]LOPES A T,AGUIAR E D,SOUZA A F D,et al.Facial Expression Recognition with Convolutional Neural Networks:Co-ping with Few Data and the Training Sample Order[J].Pattern Recognition,2016,61:610-628.
[12]WANI F J,RIZVI S E H,SHARMA M K,et al.A study on cross validation for model selection and estimation[J].International Journal of Agricultural Sciences,2018,14:165-172.
[13]LIU M,SHAN S,WANG R,et al.Learning Expressionlets on Spatio-temporal Manifold for Dynamic Facial Expression Recognition[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2014:1749-1756.
[14]JUNG H,LEE S,YIM J,et al.Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition[C]∥IEEE International Conference on Computer Vision.IEEE Computer Society,2015:2983-2991.
[15]VALSTAR M F,JIANG B,MEHU M,et al.The first facial expression recognition and analysis challenge[C]∥IEEE International Conference on Automatic Face & Gesture Recognition and Workshops.IEEE,2011:921-926.
[1] 王文强, 贾星星, 李朋.
自适应的集成定序算法
Adaptive Ensemble Ordering Algorithm
计算机科学, 2022, 49(6A): 242-246. https://doi.org/10.11896/jsjkx.210200108
[2] 张嘉淏, 刘峰, 齐佳音.
一种基于Bottleneck Transformer的轻量级微表情识别架构
Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer
计算机科学, 2022, 49(6A): 370-377. https://doi.org/10.11896/jsjkx.210500023
[3] 李星燃, 张立言, 姚树婧.
结合特征融合和注意力机制的微表情识别方法
Micro-expression Recognition Method Combining Feature Fusion and Attention Mechanism
计算机科学, 2022, 49(2): 4-11. https://doi.org/10.11896/jsjkx.210900028
[4] 梁正友, 何景琳, 孙宇.
一种用于微表情自动识别的三维卷积神经网络进化方法
Three-dimensional Convolutional Neural Network Evolution Method for Facial Micro-expression Auto-recognition
计算机科学, 2020, 47(8): 227-232. https://doi.org/10.11896/jsjkx.190700009
[5] 蒋斌,甘勇,张焕龙,张秋闻.
非正面人脸表情识别方法综述
Survey on Non-frontal Facial Expression Recognition Methods
计算机科学, 2019, 46(3): 53-62. https://doi.org/10.11896/j.issn.1002-137X.2019.03.007
[6] 杜进, 陈云华, 张灵, 麦应潮.
基于改进深度残差网络的低功耗表情识别
Energy-efficient Facial Expression Recognition Based on Improved Deep Residual Networks
计算机科学, 2018, 45(9): 303-307. https://doi.org/10.11896/j.issn.1002-137X.2018.09.051
[7] 刘涛, 周先春, 严锡君.
基于光流特征与高斯LDA的面部表情识别算法
LDA Facial Expression Recognition Algorithm Combining Optical Flow Characteristics with Gaussian
计算机科学, 2018, 45(10): 286-290. https://doi.org/10.11896/j.issn.1002-137X.2018.10.053
[8] 黄建,李文书,高玉娟.
人脸表情识别研究进展
Research Advance of Facial Expression Recognition
计算机科学, 2016, 43(Z11): 123-126. https://doi.org/10.11896/j.issn.1002-137X.2016.11A.026
[9] 卢照敢,许春梅,孙楠,苗许娜.
采用改进高斯核的MLS-SVM人脸表情识别算法
Improved Face Emotion Identification Algorithm by MLS-SVM with Modified Gauss Kernel Function
计算机科学, 2014, 41(Z6): 132-134.
[10] 盖赟.
基于微分算子的三维人脸表情识别
3D Face Expression Recognition Based on Differential Operator
计算机科学, 2014, 41(Z11): 128-132.
[11] 彭辉.
基于Gabor小波变换多特征向量的人脸识别鲁棒性研究
Research on Gabor Wavelet Transform Feature Recognition Robustness Based on Vector of Face
计算机科学, 2014, 41(2): 308-311.
[12] 杨宁,张虹.
一种基于物联网和表情识别的健康监护系统
Non-contact Health Monitoring System Based on the Internet of Things and Expression Recognition
计算机科学, 2011, 38(Z10): 10-11.
[13] 蒋斌,贾克斌,杨国胜.
人脸表情识别的研究进展
Research Advance of Facial Expression Recognition
计算机科学, 2011, 38(4): 25-31.
[14] .
一种特征融合算法的表情识别

计算机科学, 2009, 36(5): 262-264.
[15] 王嵘 马希荣.
基于D—S证据理论的表情识别技术

计算机科学, 2009, 36(1): 231-233.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!