Computer Science ›› 2019, Vol. 46 ›› Issue (6): 263-269.doi: 10.11896/j.issn.1002-137X.2019.06.039

Special Issue: Face Recognition

Previous Articles     Next Articles

Face Pose and Expression Correction Based on 3D Morphable Model

WANG Qian-qing1, ZHANG Jing-lei2   

  1. (Tianjin Key Laboratory for Control Theory & Applications in Complicated Systems,Tianjin University of Technology,Tianjin 300384,China)1
    (School of Electrical and Electronics Engineering,Tianjin University of Technology,Tianjin 300384,China)2
  • Received:2018-05-16 Published:2019-06-24

Abstract: Aiming at the problems such as poor robustness and computational complexity in face pose correction,a new facial pose and expression correction algorithmis was proposed.First,the Fast-SIC algorithm is adopted to improve the AAM model and to enhence the fitting efficiency.Then,based on the face alignment results,3D face reconstruction is performed.A BFM-3DMM model combining expression parameters into classical 3DMM model was proposed.However,the face corrected by the BFM-3DMM model is not smooth enough.Due to the fact that the SFS algorithm is not constrained by the original statistical model,this algorithm is applied to re-correct 2D face from BFM-3DMM model.The algorithm achieves good alignment and correction effects both on AFLW and LFPW,which are the two famous large face databases,as well as self-build face database.The experimental evaluation results show that the corrected 2D faces have smoother apperance and higher fidelity compared with classical 3DMM model,and can also retain image background information.

Key words: 3D Face reconstruction, 3D morphable model (3DMM), Active appearance model (AAM), Shape from shading algorithm (SFS)

CLC Number: 

  • TP391
[1]WANG J T,ZHAO L,QI X B.Face recognition method based on adaptive 3D Morphable Model and Multiple Manifold Discriminant Analysis[J].Computer Science,2017,44(S1):232-235.(in Chinese)
[2]HUANG F,TAN S B.Face feature location based on improved active appearance model algorithm[J].Computer Engineering and Applications,2015,51(16):204-209.(in Chinese)
[3]TZIMIROPOULOS G,PANTIC M.Fast Algorithms for Fitting Active Appeaance Models to Unconstrained Images[J].International Journal of Computer Vision,2017,122(1):17-33.
[4]TRAN A T,HASSNER T,MASI I,et al.Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Network[C]∥2017 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2017:1493-1502.
[5]HU G,YAN F,KITTLER J,et al.Efficient 3D Morphable Face Model Fitting[J].Pattern Recognition,2017,67(C):366-379.
[6]GU Y R,QI R,WANG B Y.Research on 3D Face Attitude Correction Algorithm[J].Journal of Instrumentation and Instrument,2010,31(10):2291-2295.(in Chinese)
[7]FANG S Y,ZHOU D K,CAO Y P,et al.Positive Face Image Synthesis Based on Pose Estimation[J].Computer Engineering,2015,41(10):240-244.(in Chinese)
[8]DING L J,FENG H,HUANG Y.Geometric Algebra Invariant Method for 3D Face Attitude Correction[J].Microcomputer Systems,2015,36(1):177-181.(in Chinese)
[9]YANG B,MA L.Improvement of weak texture face image synthesis method based on deformation model[J].Computer Simulation,2016,33(9):248-251.(in Chinese)
[10]LUO Y,TAO Y,YANG G.Facial texture mapping and defor-mation based on facial feature constraints[J].Computer Engineering and Computer Engineering and Applications,2018,54(6):188-192,240.(in Chinese)
[11]YIN X,XIANG Y,SOHN K,et al.Towards Large-Pose Face Frontalization in the Wild[C]∥International Conference on Computer Vision.2017.
[12]TZIMIROPOULOS G,PANTIC M.Optimization Problems for Fast AAM Fitting in-the-Wild[C]∥IEEE International Confe-rence on Computer Vision.IEEE Computer Society,2013:593-600.
[13]PAYSAN P,KNOTHE R,AMBERG B,et al.A 3d face model for pose and illumination invariant face recognition[C]∥Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance,2009(AVSS’09).IEEE,2009:296-301.
[14]ZHU X,LEI Z,YAN J,et al.High-fidelity Pose and Expression Normalization for face recognition in thewild[C]∥Computer Vision and Pattern Recognition.IEEE,2015:787-796.
[15]CAO C,WENG Y,ZHOU S,et al.Faceware house:a 3d facial expression database for visual computing[J].IEEE Transactions on Visualization and Computer Graphics,2014,20(3):413-425.
[16]CHU B,ROMDHANI S,CHEN L.3D-Aided Face Recognition Robust to Expression and Pose Variations[C]∥IEEE Confe-rence on Computer Vision and Pattern Recognition.IEEE Computer Society,2014:1907-1914.
[17]BELHUMEUR D,JACOBS D,KRIEGMAN,et al.Localizing parts of faces using a consensus of exemplars[C]∥IEEE Conference on Computer Vision and Pattern Recognition.IEEE Computer Society,2011.
[18]KÖSTINGER M,WOHLHART P,ROTH P M,et al.Annotated facial landmarks in the wild:A large-scale,real-world database for facial landmark localization[C]∥2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).IEEE,2011:2144-2151.
[19]ARASHLOO S R,KITTLER J.Efficient processing of MRFs for unconstrained-pose face recognition[C]∥IEEE Sixth International Conference on Biometrics:Theory,Applications and Systems.IEEE,2013:1-8.
[20]HASSNER T,HAREL S,PAZ E,et al.Effective face frontalization in unconstrained images[C]∥IEEE Conference on Compu-ter Vision and Pattern Recognition.IEEE Computer Society,2014:4295-4304.
[21]HUANG G B,MATTAR M A,LEE H,et al.Learning to align from scratch[C]∥International Conference on Neural Information Processing Systems.Curran Associates Inc.,2012:764-772.
[1] HE Jia-yu, HUANG Hong-bo, ZHANG Hong-yan, SUN Mu-ye, LIU Ya-hui, ZHOU Zhe-hai. Review of 3D Face Reconstruction Based on Single Image [J]. Computer Science, 2022, 49(2): 40-50.
Full text



No Suggested Reading articles found!