计算机科学 ›› 2020, Vol. 47 ›› Issue (6A): 250-253.doi: 10.11896/JsJkx.190700081

• 计算机图形学 & 多媒体 • 上一篇    下一篇

三角坐标系下人脸表情表示方法

肖潇, 孔凡芝   

  1. 浙江传媒学院电子信息学院 杭州 310018
  • 发布日期:2020-07-07
  • 通讯作者: 肖潇(xiaoxiao800412@163.com)
  • 基金资助:
    浙江省公益项目(LGG19E050002,LGG18F010001);院级教改项目《视频监控技术》课程讲义建设

New Representation of Facial Affect Based on Triangular Coordinate System

XIAO Xiao and KONG Fan-zhi   

  1. College of Electronics Information,ZheJiang University of Media and Communication,Hangzhou 310018,China
  • Published:2020-07-07
  • About author:XIAO Xiao, born in 1980, Ph.D, lectu-rer.Her research interests include pattern recognition and intelligence computation.
  • Supported by:
    This work was supported by Public Welfare ProJect of ZheJiang Province (LGG19E050002, LGG18F010001) and College Educational Reform ProJect ‘Video Monitoring Technology’ Course Construction.

摘要: 对三角形坐标系作了推广,给出了广义三角坐标,使之使用于人脸表情特征表示,结合高斯核SVM分类器,采用留一主体交叉验证技术。针对CK+人脸表情数据库,得到了人脸表情正确识别率为98.2%,相比于其基准算法和M-CRT算法,正确率有较大提高。这表明所提出的人脸表情特征表示方法的有效性。

关键词: 人脸表情, 三角坐标系, 特征表示, 位移矢量

Abstract: Based on the triangular coordinate system,the generalized triangular coordinates are given to be used in facial expression feature representation.Combined with the Gaussian kernel SVM classifier,the left-face cross-validation technique is used to obtain the correct facial expression.For the CK+ facial expression database,the recognition rate is 98.2%,which is greatly improved compared with benchmark algorithm and M-CRT algorithm,indicating the effectiveness of the proposed facial expression feature representation method.

Key words: Facial Expression, Feature representation, Transform vector, Triangle coordinate system

中图分类号: 

  • TP391.41
[1] THIES J,ZOLLHFER M,NIEβNER M,et al.Real-time expression transfer forfacial reenactment.ACM Transactions on Graphics (TOG),2015,34(6).
[2] SARIYANIDI E,GUNES H,CAVALLARO A.Automatic Analysis of Facial Affect:A Survey ofRegistration,Representation,and Recognition.IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(6):1113-1133.
[3] PRAMERDORFER C.KAMPEL M.Facial Expression Recognition using Convolutional Neural Networks:State of the Art.arXiv:1612.02903.
[4] LI S,DENG W.Deep Facial Expression Recognition:A Survey.arXiv:1804.08348,2018.
[5] OJALA T,PIETIKINEN M,HARWOOD D.A Comparative Study of Texture Measures with Classification Based on Feature Distributions.Pattern Recognition,1996,29:51-59.
[6] SHAN C,GONG S,MCOWAN P W.Facial expression recognition based on local binary patterns:A comprehensive study,Image Vis.Comput.,2009,27(6):803-816.
[7] DU L,HU H.Modified classification and regression tree for facial expression recognition with using difference expression images.Electronics Letters,2017,53(9):590-592,274.
[8] EKMAN P,FRIESEN P.Facial action coding system:a tech-nique for the measurement of facial movement.Palo Alto:Consulting Psychologists Press,1978.
[9] ELEFTHERIADIS S,et al.Variational Gaussian Process Auto-Encoder for Ordinal Prediction of Facial Action Units//AsianConference on Computer Vision Springer.Cham,2016.
[10] JENI L A,GIRARD J,COHN J,et al.Continuous A Uintensity estimation using localized,sparse facial feature space//Proc.IEEE Int.Conf.Autom.Face and Gesture Recognit.Workshops,2013:1-7.
[11] ZHONG L,LIU Q,YANG P,et al.Learning active facial patches for expression analysis//Proc.IEEE Conf.Comput.Vis.Pattern Recognit..2012:2562-2569.
[12] LONG F,WU T,MOVELLAN J R,et al.Learning spatiotemporal features by using independent component analysis with application to facial expression recognition.Neurocomputing,2012,93:126-132.
[13] ZHI R,FLIERL M,RUAN Q,et al.Graph-preserving sparse nonnegative matrix factorization with application to facialexpression recognition.IEEE Trans.Systems,Man,Cybern.B,Cybern.,2011,41(1):38-52.
[14] KRIZHEVSKY A,et al.Imagenet classification with deep convolutional neural networks//Advances in Neural Information Processing Systems.2012.
[15] HASANI B,MAHOOR M H.Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields//Proceedings 12th IEEE International Conference on Automatic Face and Gesture Recognition.FG 2017.
[16] RIFAI S,BENGIO Y,COURVILLE A,et al.Disentangling factors of variation for facial expression recognition//European Conference on Computer Vision.2012:808-822.
[17] LI H B,SUN J,XU Z B,et al.Multimodal 2D+3D Facial Expression Recognition with Deep Fusion Convolutional Neural Network.IEEE Transactions on Multimedia,2017,19(12):2816-2831.
[18] USMAN M,et al.Using Deep Autoencoders for Facial Expression Recognition.arXiv:1801.08329,2018.
[19] KAZEMI V,JOSEPHINE S.One millisecond face alignment withan ensemble of regression trees//Proc.IEEE Conf.Comput.Vis.Pattern Recog..2014:1867-1874.
[20] 王守觉,梁先扬.图像变形计算方法及其应用.计算机辅助设计与图形学学报,2011,23(8):1304-1310.
[21] CHANG C C,LIN C J.LIBSVM:a library for supportvector machines.ACM Transactions on Intelligent Systems and Technology,2011,2:27:1-27:27.
[22] 王守觉,张晓盟,肖泉,等.基于四面体坐标系的三维变形方法及应用.计算机辅助设计与图形学学报,2015,27(3):469-477.
[23] LUCEY P,COHN J,KANADE T,et al.The extended Cohn-Kanade dataset (CK+):A completedataset for action unit and emotion-specified expression//Proc.IEEE Conf.Comput.Vis.Pattern Recognit.Workshops,2010:94-101.
[1] 韩洁, 陈俊芬, 李艳, 湛泽聪.
基于自注意力的自监督深度聚类算法
Self-supervised Deep Clustering Algorithm Based on Self-attention
计算机科学, 2022, 49(3): 134-143. https://doi.org/10.11896/jsjkx.210100001
[2] 柴冰, 李冬冬, 王喆, 高大启.
融合频率和通道卷积注意的脑电(EEG)情感识别
EEG Emotion Recognition Based on Frequency and Channel Convolutional Attention
计算机科学, 2021, 48(12): 312-318. https://doi.org/10.11896/jsjkx.201000141
[3] 龚扣林, 周宇, 丁笠, 王永超.
基于BiLSTM模型的漏洞检测
Vulnerability Detection Using Bidirectional Long Short-term Memory Networks
计算机科学, 2020, 47(5): 295-300. https://doi.org/10.11896/jsjkx.190800046
[4] 陈俊芬,张明,赵佳成.
复杂高维数据的密度峰值快速搜索聚类算法
Clustering Algorithm by Fast Search and Find of Density Peaks for Complex High-dimensional Data
计算机科学, 2020, 47(3): 79-86. https://doi.org/10.11896/jsjkx.190400123
[5] 刘剑, 金泽群.
基于深度学习的人脸表情迁移方法
Facial Expression Transfer Method Based on Deep Learning
计算机科学, 2019, 46(6A): 250-253.
[6] 袁丁,王茜,邓李维.
聚类辅助特征对齐的域适应方法
Clustering Assist Feature Alignment for Unsupervised Domain Adaptation
计算机科学, 2019, 46(3): 221-226. https://doi.org/10.11896/j.issn.1002-137X.2019.03.033
[7] 蒋斌,甘勇,张焕龙,张秋闻.
非正面人脸表情识别方法综述
Survey on Non-frontal Facial Expression Recognition Methods
计算机科学, 2019, 46(3): 53-62. https://doi.org/10.11896/j.issn.1002-137X.2019.03.007
[8] 黄建,李文书,高玉娟.
人脸表情识别研究进展
Research Advance of Facial Expression Recognition
计算机科学, 2016, 43(Z11): 123-126. https://doi.org/10.11896/j.issn.1002-137X.2016.11A.026
[9] 卢照敢,许春梅,孙楠,苗许娜.
采用改进高斯核的MLS-SVM人脸表情识别算法
Improved Face Emotion Identification Algorithm by MLS-SVM with Modified Gauss Kernel Function
计算机科学, 2014, 41(Z6): 132-134.
[10] 王金伟,马希荣,孙济洲.
基于无监督提取表情时空特征的情感识别
Emotion Recognition Based on Unsupervised Extraction of Facial Expression Spatio-temporal Features
计算机科学, 2014, 41(5): 266-269. https://doi.org/10.11896/j.issn.1002-137X.2014.05.056
[11] 杜杏菁,白廷柱.
人脸识别中表情弱化处理研究
Study of Weaken Expression in Face Recognition
计算机科学, 2012, 39(8): 281-283.
[12] 蒋斌,贾克斌,杨国胜.
人脸表情识别的研究进展
Research Advance of Facial Expression Recognition
计算机科学, 2011, 38(4): 25-31.
[13] 马希荣 刘琳 桑婧.
基于情感计算的e—Learning系统建模

计算机科学, 2005, 32(8): 131-133.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!