Computer Science ›› 2019, Vol. 46 ›› Issue (6A): 250-253.

• Pattern Recognition & Image Processing • Previous Articles     Next Articles

Facial Expression Transfer Method Based on Deep Learning

LIU Jian, JIN Ze-qun   

  1. Faculty of Information and Control Engineering,Shenyang Jianzhu University,Shenyang 110168,China
  • Online:2019-06-14 Published:2019-07-02

Abstract: In order to solve the problems of low image quality,long training process and slow generation speed of face expression transfer,this paper proposed a facial expression transfermethod based on generative adversarial network to make expression transfer faster and more natural.Firstly,the facial features are extracted by using convolutional neural network,and the images are mapped from high-dimensional space to shallow space.In the shallow space,the facial expression features are discriminated by using the Generative Adversarial Networks.Then the nearest neighbors up-sampling and convolutional neural networks are used to mapthe image from the shallow space to the high-dimensional space,and in this process,the face expression is changed by adding the facial expression feature maps into neural networks.Compared with Fader Networks,the network model parameter amount of the proposed method is reduced by 43.7% and training time is reduced by 36%.The experimental results show that the proposed method can effectively improve the quality and the speed of generated images.

Key words: Computer vision, Deep learning, Face expression transfer, Generative adversarial networks

CLC Number: 

  • TP183
[1]IOFFE S,SZEGEDY C:Batch Normalization:Accelerating Deep Network Training by Reducing Internal Covariate Shift[J].ar-Xiv:1502.03167v3,2015.
[2]ISOLA P,ZHU J Y,ZHOU T H,et al.Image-to-image translation with conditional adversarial networks[J].arXiv:1611.07004,2016.
[3]王娅,侯进,王献.基于顶点权重的网格简化在虚拟人脸中的应用[J].计算机仿真,2014,31(2):329-334.
[4]雷腾.虚拟人眼的运动与表情合成的研究[D].成都:西南交通大学,2014.
[5]李俊龙,章登义,黄珺.Kinect驱动的人脸动画合成技术研究[J].计算机工程,2015,41(3):237-241.
[6]ZHANG H,XU T,LI H,et al.Stackgan:Text to photo-realistic image synthesis with stacked generative adversarial networks[J].arXiv:1612.03242,2016.
[7]ZHANG Z,SONG Y,QI H.Age progression/regression by conditional adversarial autoencoder[C]∥The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2017.
[8]ZHAO J,MATHIEU M,LECUN Y.Energy-based generative adversarial network[C]∥5th International Conference on Learning Representations (ICLR).2017.
[9]LAMPLE G,ZEGHIDOUR N.Fader Networks:Manipulating Images by Sliding Attributes[J].arXiv:1706.00409v2,2017.
[10]HINTON G,KRIZHEVSKY A,WANG S.Transforming auto-encoders[C]∥Artificial Neural Networks and Machine Learning(ICANN 2011).2011:44-51.
[11]PERARNAU G,VAN DE WEIJER J,RADUCANU B,et al.Invertible conditional gans for image editing[J].arXiv:1611.06355,2016.
[12]RATLIFF L J,BURDEN S A,SASTRY S S.Characterization and computation of local Nash equilibria in continuous games[C]∥Proceedings of the 51st Annual Allerton Conference on Communication,Control,and Computing (Allerton).Monticello,IL,USA,IEEE,2013:917-924.
[13]ARJOVSKY M,OTTOU L.Towards principled methods for training generative adversarial networks[C]∥ICLR.2017.
[14]SHEN W,LIU R.Learning residual images for face attribute manipulation[C]∥The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).2017.
[15]ANTIPOV G,BACCOUCHE M,DUGELAY J L.Face aging with conditional generative adversarial networks[J].arXiv:1702.01983,2017.
[16]LIU Z W,LUO P,WANG X G,et al.Deep learning face attri-butes in the wild[C]∥Proceedings of International Conference on Computer Vision (ICCV).2015.
[17]GLOROT X,BENGIO Y.Understanding the difficulty of training deep feedforward neural networks[C]∥AISTATS.2010.
[18]KINGMA D,BA J.Adam:A method for stochastic optimization[J].arXiv:1412.6980,2014.
[1] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[2] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[3] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[4] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[5] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[6] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[8] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[9] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[10] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[11] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[12] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[13] LIU Wei-ye, LU Hui-min, LI Yu-peng, MA Ning. Survey on Finger Vein Recognition Research [J]. Computer Science, 2022, 49(6A): 1-11.
[14] SUN Fu-quan, CUI Zhi-qing, ZOU Peng, ZHANG Kun. Brain Tumor Segmentation Algorithm Based on Multi-scale Features [J]. Computer Science, 2022, 49(6A): 12-16.
[15] KANG Yan, XU Yu-long, KOU Yong-qi, XIE Si-yu, YANG Xue-kun, LI Hao. Drug-Drug Interaction Prediction Based on Transformer and LSTM [J]. Computer Science, 2022, 49(6A): 17-21.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!