Computer Science ›› 2020, Vol. 47 ›› Issue (6A): 250-253.doi: 10.11896/JsJkx.190700081

• Computer Graphics & Multimedia • Previous Articles     Next Articles

New Representation of Facial Affect Based on Triangular Coordinate System

XIAO Xiao and KONG Fan-zhi   

  1. College of Electronics Information,ZheJiang University of Media and Communication,Hangzhou 310018,China
  • Published:2020-07-07
  • About author:XIAO Xiao, born in 1980, Ph.D, lectu-rer.Her research interests include pattern recognition and intelligence computation.
  • Supported by:
    This work was supported by Public Welfare ProJect of ZheJiang Province (LGG19E050002, LGG18F010001) and College Educational Reform ProJect ‘Video Monitoring Technology’ Course Construction.

Abstract: Based on the triangular coordinate system,the generalized triangular coordinates are given to be used in facial expression feature representation.Combined with the Gaussian kernel SVM classifier,the left-face cross-validation technique is used to obtain the correct facial expression.For the CK+ facial expression database,the recognition rate is 98.2%,which is greatly improved compared with benchmark algorithm and M-CRT algorithm,indicating the effectiveness of the proposed facial expression feature representation method.

Key words: Facial Expression, Feature representation, Transform vector, Triangle coordinate system

CLC Number: 

  • TP391.41
[1] THIES J,ZOLLHFER M,NIEβNER M,et al.Real-time expression transfer forfacial reenactment.ACM Transactions on Graphics (TOG),2015,34(6).
[2] SARIYANIDI E,GUNES H,CAVALLARO A.Automatic Analysis of Facial Affect:A Survey ofRegistration,Representation,and Recognition.IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(6):1113-1133.
[3] PRAMERDORFER C.KAMPEL M.Facial Expression Recognition using Convolutional Neural Networks:State of the Art.arXiv:1612.02903.
[4] LI S,DENG W.Deep Facial Expression Recognition:A Survey.arXiv:1804.08348,2018.
[5] OJALA T,PIETIKINEN M,HARWOOD D.A Comparative Study of Texture Measures with Classification Based on Feature Distributions.Pattern Recognition,1996,29:51-59.
[6] SHAN C,GONG S,MCOWAN P W.Facial expression recognition based on local binary patterns:A comprehensive study,Image Vis.Comput.,2009,27(6):803-816.
[7] DU L,HU H.Modified classification and regression tree for facial expression recognition with using difference expression images.Electronics Letters,2017,53(9):590-592,274.
[8] EKMAN P,FRIESEN P.Facial action coding system:a tech-nique for the measurement of facial movement.Palo Alto:Consulting Psychologists Press,1978.
[9] ELEFTHERIADIS S,et al.Variational Gaussian Process Auto-Encoder for Ordinal Prediction of Facial Action Units//AsianConference on Computer Vision Springer.Cham,2016.
[10] JENI L A,GIRARD J,COHN J,et al.Continuous A Uintensity estimation using localized,sparse facial feature space//Proc.IEEE Int.Conf.Autom.Face and Gesture Recognit.Workshops,2013:1-7.
[11] ZHONG L,LIU Q,YANG P,et al.Learning active facial patches for expression analysis//Proc.IEEE Conf.Comput.Vis.Pattern Recognit..2012:2562-2569.
[12] LONG F,WU T,MOVELLAN J R,et al.Learning spatiotemporal features by using independent component analysis with application to facial expression recognition.Neurocomputing,2012,93:126-132.
[13] ZHI R,FLIERL M,RUAN Q,et al.Graph-preserving sparse nonnegative matrix factorization with application to facialexpression recognition.IEEE Trans.Systems,Man,Cybern.B,Cybern.,2011,41(1):38-52.
[14] KRIZHEVSKY A,et al.Imagenet classification with deep convolutional neural networks//Advances in Neural Information Processing Systems.2012.
[15] HASANI B,MAHOOR M H.Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields//Proceedings 12th IEEE International Conference on Automatic Face and Gesture Recognition.FG 2017.
[16] RIFAI S,BENGIO Y,COURVILLE A,et al.Disentangling factors of variation for facial expression recognition//European Conference on Computer Vision.2012:808-822.
[17] LI H B,SUN J,XU Z B,et al.Multimodal 2D+3D Facial Expression Recognition with Deep Fusion Convolutional Neural Network.IEEE Transactions on Multimedia,2017,19(12):2816-2831.
[18] USMAN M,et al.Using Deep Autoencoders for Facial Expression Recognition.arXiv:1801.08329,2018.
[19] KAZEMI V,JOSEPHINE S.One millisecond face alignment withan ensemble of regression trees//Proc.IEEE Conf.Comput.Vis.Pattern Recog..2014:1867-1874.
[20] 王守觉,梁先扬.图像变形计算方法及其应用.计算机辅助设计与图形学学报,2011,23(8):1304-1310.
[21] CHANG C C,LIN C J.LIBSVM:a library for supportvector machines.ACM Transactions on Intelligent Systems and Technology,2011,2:27:1-27:27.
[22] 王守觉,张晓盟,肖泉,等.基于四面体坐标系的三维变形方法及应用.计算机辅助设计与图形学学报,2015,27(3):469-477.
[23] LUCEY P,COHN J,KANADE T,et al.The extended Cohn-Kanade dataset (CK+):A completedataset for action unit and emotion-specified expression//Proc.IEEE Conf.Comput.Vis.Pattern Recognit.Workshops,2010:94-101.
[1] DONG Hu-sheng, ZHONG Shan, YANG Yuan-feng, SUN Xun, GONG Sheng-rong. Person Re-identification by Region Correlated Deep Feature Learning with Multiple Granularities [J]. Computer Science, 2021, 48(12): 269-277.
[2] CHAI Bing, LI Dong-dong, WANG Zhe, GAO Da-qi. EEG Emotion Recognition Based on Frequency and Channel Convolutional Attention [J]. Computer Science, 2021, 48(12): 312-318.
[3] YE Ya-nan, CHI Jing, YU Zhi-ping, ZHAN Yu-liand ZHANG Cai-ming. Expression Animation Synthesis Based on Improved CycleGan Model and Region Segmentation [J]. Computer Science, 2020, 47(9): 142-149.
[4] GONG Kou-lin, ZHOU Yu, DING Li, WANG Yong-chao. Vulnerability Detection Using Bidirectional Long Short-term Memory Networks [J]. Computer Science, 2020, 47(5): 295-300.
[5] JIANG Bin,GAN Yong,ZHANG Huan-long,ZHANG Qiu-wen. Survey on Non-frontal Facial Expression Recognition Methods [J]. Computer Science, 2019, 46(3): 53-62.
[6] YUAN Ding, WANG Qian, DENG Li-wei. Clustering Assist Feature Alignment for Unsupervised Domain Adaptation [J]. Computer Science, 2019, 46(3): 221-226.
[7] DU Jin, CHEN Yun-hua, ZHANG Ling, MAI Ying-chao. Energy-efficient Facial Expression Recognition Based on Improved Deep Residual Networks [J]. Computer Science, 2018, 45(9): 303-307.
[8] HUANG Jian, LI Wen-shu and GAO Yu-juan. Research Advance of Facial Expression Recognition [J]. Computer Science, 2016, 43(Z11): 123-126.
[9] LIU Dong, LI Su and CAO Zhi-dong. State-of-the-art on Deep Learning and its Application in Image Object Classification and Detection [J]. Computer Science, 2016, 43(12): 13-23.
[10] WANG Jin-wei,MA Xi-rong and SUN Ji-zhou. Emotion Recognition Based on Unsupervised Extraction of Facial Expression Spatio-temporal Features [J]. Computer Science, 2014, 41(5): 266-269.
[11] PENG Hui. Research on Gabor Wavelet Transform Feature Recognition Robustness Based on Vector of Face [J]. Computer Science, 2014, 41(2): 308-311.
[12] . [J]. Computer Science, 2009, 36(5): 262-264.
[13] WANG Rong, MA Xi- rong (College of Computer and Information Engineering, Tianjin Normal University, Tianjin 300387). [J]. Computer Science, 2009, 36(1): 231-233.
[14] . [J]. Computer Science, 2007, 34(3): 213-215.
[15] . [J]. Computer Science, 2006, 33(11): 200-204.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!