计算机科学 ›› 2018, Vol. 45 ›› Issue (10): 286-290.doi: 10.11896/j.issn.1002-137X.2018.10.053

• 图形图像与模式识别 • 上一篇    下一篇

基于光流特征与高斯LDA的面部表情识别算法

刘涛1, 周先春2, 严锡君3   

  1. 江苏开放大学信息与机电工程学院 南京210017 1
    南京信息工程大学电子与信息工程学院 南京210044 2
    河海大学计算机与信息学院 南京210098 3
  • 收稿日期:2017-08-08 出版日期:2018-11-05 发布日期:2018-11-05
  • 作者简介:刘 涛(1980-),男,硕士,副教授,主要研究方向为数据挖掘、无线传感网络等,E-mail:liutaoxzls@qq.com(通信作者);周先春(1974-),男,博士,副教授,主要研究方向为信号与信息处理;严锡君(1963-),男,博士,副教授,主要研究方向为数据挖掘与无线传感器网络。
  • 基金资助:
    国家自然科学基金项目(11202106,61201444), 江苏省高校自然科学研究面上基金项目(15KJD520003)资助。

LDA Facial Expression Recognition Algorithm Combining Optical Flow Characteristics with Gaussian

LIU Tao1, ZHOU Xian-chun2, YAN Xi-jun3   

  1. School of Information Mechanical & Electrical Engineering,Jiangsu Open University,Nanjing 210017,China 1
    School of Electronic and Information Engineering,Nanjing University of Information Science & Technology,Nanjing 210044,China 2
    College of Computer and Information,Hohai University,Nanjing 210098,China 3
  • Received:2017-08-08 Online:2018-11-05 Published:2018-11-05

摘要: 文中提出了一种人脸表情识别的新方法,该方法采用动态的光流特征来描述人脸表情的变化差异,提高人脸表情的识别率。首先,计算人脸表情图像与中性表情图像之间的光流特征;然后,对传统的线性判断分析方法(Linear Discriminant Analysis,LDA)进行扩展,采用高斯LDA方法对光流特征进行映射,从而得到人脸表情图像的特征向量;最后,设计多类支持向量机分类器,实现人脸表情的分类与识别。在JAFFE和CK人脸表情数据库上的表情识别实验结果表明,该方法的平均识别率比3种对比方法的高出2%以上。

关键词: 表情识别, 高斯分布, 光流, 线性判断分析, 支持向量机

Abstract: This paper presented a new method for facial expression recognition,which uses dynamic optical flow features to describe the differences in facial expressions and improve the recognition rate of facial expression recognition.Firstly,the optical flow features between a peak emotion image and the neutral expression image are calculated.Then,the linear discriminant analysis (LDA) method is extended,and the Gaussian LDA method is used to map the optical flow features into eigenvector of facial expression image.Finally,multi-class support vector machine classifier is designed to achieve the classification and the recognition of facial expression.The experimental results on the JAFFE and CK facial expression databases show that the average recognition rates of the proposed method are more than 2% higher than three benchmark methods.

Key words: Expression recognition, Gaussian distribution, Linear discriminant analysis, Optical flow, Support vector machines

中图分类号: 

  • TP391
[1]WANG D W,ZHOU J,MEI H Y,et al.Review of facial expression recognition[J].Computer Engineering and Applications,2014,50(20):149-157.(in Chinese)王大伟,周军,梅红岩,等.人脸表情识别综述[J].计算机工程与应用,2014,50(20):149-157.
[2]OUYANG Y,SANG N,HUANG R.Accurate and robust facial expressions recognition by fusing multiple sparse representation based classifiers [J].Neurocomputing,2015,149(Part A):71-78.
[3]SIDDIQI M H,ALI R,KHAN A M,et al.Facial expression re- cognition using active contour-based face detection,facial movement-based feature extraction,and non-linear feature selection[J].Multimedia Systems,2015,21(6):541-555.
[4]WANG L,LI R F,WANG K,et al.Feature Representation for Facial Expression Recognition Based on FACS and LBP[J].International Journal of Automation and Computing,2014,11(5):459-468.
[5]ZAVASCHI THIAGO H H,BRITTO JR ALCEU S,OLIVEIRA LUIZ E S,et al.Fusion of feature sets and classifiers for facial expression recognition [J].Experts Systems with Applications,2013,40(2),646-655.
[6]BALCONI M,LUCCHIARI C.Consciousness and emotional facial expression recognition:Subliminal/supraliminal stimulation effect on n200 and p300 ERPs[J].Journal of Psychophysiology,2016,21(2):100-108.
[7]UAR A,DEMIR Y,GZELIS, C.A new facial expression re- cognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering[J].Neural Computing & Applications,2016,27(1):131-142.
[8]LI Y Q,LI Y J,LI H B,et al.Fusion of Global and Local Va- rious Feature for Facial Expression Recognition[J].Acta Optica Sinica,2014,34(5):164-170.(in Chinese)
李雅倩,李颖杰,李海滨,等.融合全局与局部多样性特征的人脸表情识别[J].光学学报,2014,34(5):164-170.
[9]SIDDIQI M H,ALI R,KHAN A M,et al.Human facial expression recognition using stepwise linear discriminant analysis and hidden conditional random fields[J].IEEE Transactions on Ima-ge Processing a Publication of the IEEE Signal Processing Society,2015,24(4):1386-1398.
[10]HAPPY S L,ROUTRAY A.Automatic facial expression recognition using features of salient facial patches[J].IEEE Transactions on Affective Computing,2015,6(1):1-12.
[11]MOLLAHOSSEINI A,CHAN D,MAHOOR M H.Going deeper in facial expression recognition using deep neural networks[C]∥Applications of Computer Vision.IEEE,2016:1-10.
[12]HU B F,WANG J W.3D facial expression recognition method based on bimodal and semantic knowledge[J].Chinese Journal of Scientific Instrument,2013,34(4):873-880.(in Chinese)
胡步发,王金伟.双模态及语义知识的三维人脸表情识别方法[J].仪器仪表学报,2013,34(4):873-880.
[13]KUMAR D S,KUMARESAN S J.Real-time Face Recognition Based on Optical Flow and Histogram Equalization[J].Ictact Journal on Image & Video Processing,2013,3(4):626-629.
[14]IOSIFIDIS A,GABBOUJ M.Multi-class Support Vector Ma- chine classifiers using intrinsic and penalty graphs[J].Pattern Recognition,2016,55:231-246.
[1] 单晓英, 任迎春.
基于改进麻雀搜索优化支持向量机的渔船捕捞方式识别
Fishing Type Identification of Marine Fishing Vessels Based on Support Vector Machine Optimized by Improved Sparrow Search Algorithm
计算机科学, 2022, 49(6A): 211-216. https://doi.org/10.11896/jsjkx.220300216
[2] 陈景年.
一种适于多分类问题的支持向量机加速方法
Acceleration of SVM for Multi-class Classification
计算机科学, 2022, 49(6A): 297-300. https://doi.org/10.11896/jsjkx.210400149
[3] 张嘉淏, 刘峰, 齐佳音.
一种基于Bottleneck Transformer的轻量级微表情识别架构
Lightweight Micro-expression Recognition Architecture Based on Bottleneck Transformer
计算机科学, 2022, 49(6A): 370-377. https://doi.org/10.11896/jsjkx.210500023
[4] 梁懿雯, 杜育松.
抵御计时攻击的基于Knuth-Yao的二元离散高斯采样算法
Timing Attack Resilient Sampling Algorithms for Binary Gaussian Based on Knuth-Yao
计算机科学, 2022, 49(6A): 485-489. https://doi.org/10.11896/jsjkx.210600017
[5] 侯夏晔, 陈海燕, 张兵, 袁立罡, 贾亦真.
一种基于支持向量机的主动度量学习算法
Active Metric Learning Based on Support Vector Machines
计算机科学, 2022, 49(6A): 113-118. https://doi.org/10.11896/jsjkx.210500034
[6] 邢云冰, 龙广玉, 胡春雨, 忽丽莎.
基于SVM的类别增量人体活动识别方法
Human Activity Recognition Method Based on Class Increment SVM
计算机科学, 2022, 49(5): 78-83. https://doi.org/10.11896/jsjkx.210400024
[7] 武玉坤, 李伟, 倪敏雅, 许志骋.
单类支持向量机融合深度自编码器的异常检测模型
Anomaly Detection Model Based on One-class Support Vector Machine Fused Deep Auto-encoder
计算机科学, 2022, 49(3): 144-151. https://doi.org/10.11896/jsjkx.210100142
[8] 李星燃, 张立言, 姚树婧.
结合特征融合和注意力机制的微表情识别方法
Micro-expression Recognition Method Combining Feature Fusion and Attention Mechanism
计算机科学, 2022, 49(2): 4-11. https://doi.org/10.11896/jsjkx.210900028
[9] 冷佳旭, 谭明圮, 胡波, 高新波.
基于隐式视角转换的视频异常检测
Video Anomaly Detection Based on Implicit View Transformation
计算机科学, 2022, 49(2): 142-148. https://doi.org/10.11896/jsjkx.210900266
[10] 李玉强, 张伟江, 黄瑜, 李琳, 刘爱华.
基于高斯分布的改进词嵌入主题情感模型
Improved Topic Sentiment Model with Word Embedding Based on Gaussian Distribution
计算机科学, 2022, 49(2): 256-264. https://doi.org/10.11896/jsjkx.201200082
[11] 侯春萍, 赵春月, 王致芃.
基于自反馈最优子类挖掘的视频异常检测算法
Video Abnormal Event Detection Algorithm Based on Self-feedback Optimal Subclass Mining
计算机科学, 2021, 48(7): 199-205. https://doi.org/10.11896/jsjkx.200800146
[12] 郭福民, 张华, 胡瑢华, 宋岩.
一种基于表面肌电信号的腕部肌力估计方法研究
Study on Method for Estimating Wrist Muscle Force Based on Surface EMG Signals
计算机科学, 2021, 48(6A): 317-320. https://doi.org/10.11896/jsjkx.200600021
[13] 卓雅倩, 欧博.
噪声环境下的人脸防伪识别算法研究
Face Anti-spoofing Algorithm for Noisy Environment
计算机科学, 2021, 48(6A): 443-447. https://doi.org/10.11896/jsjkx.200900207
[14] 雷剑梅, 曾令秋, 牟洁, 陈立东, 王淙, 柴勇.
基于整车EMC标准测试和机器学习的反向诊断方法
Reverse Diagnostic Method Based on Vehicle EMC Standard Test and Machine Learning
计算机科学, 2021, 48(6): 190-195. https://doi.org/10.11896/jsjkx.200700204
[15] 孟祥玉, 薛昕惟, 李汶霖, 王祎.
基于运动估计与时空结合的多帧融合去雨网络
Motion-estimation Based Space-temporal Feature Aggregation Network for Multi-frames Rain Removal
计算机科学, 2021, 48(5): 170-176. https://doi.org/10.11896/jsjkx.210100104
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!