Computer Science ›› 2015, Vol. 42 ›› Issue (10): 301-305.

Previous Articles     Next Articles

Fast Face Alignment Method Based on Sparse Cascade Regression and its Application on Mobile Devices

DENG Jian-kang, YANG Jing, SUN Yu-bao and LIU Qing-shan   

  • Online:2018-11-14 Published:2018-11-14

Abstract: Efficient face alignment is the key problem for the face applications on the mobile platform which has limited computing and storage capacity.We studied the problem of fast face alignment on the mobile platform.To reduce the computing and storage requirements for face alignment,sparse constrained cascade regression model was proposed in this paper.Sparse constraint was introduced to learn the regression matrix,which can not only select the robust features,but also compress the model size to about 5% compared to the original model.We further constructed the fast face alignment algorithm on mobile platform based on sparse cascade regression model.First,the facial landmarks on the tip of the nose,the corners of the mouth and eyes are quickly located by binary features after face detection,and face pose is estimated.Face image is rotated to frontal view according to the face pose.Then,the corresponding model (frontal model or profile model) is selected according to the face pose,and cascade regression with sparse constraint is used to face alignment.Extensive experiments show that the alignment method proposed in this paper is effective and efficient with compact model size.On the Samsung smart phone of Note3,the alignment time for each face image is about 10ms,and the size of whole apk is only 4MB,which is suitable for face applications on mobile platform.

Key words: Mobile platform,Fast face alignment,Cascade regression,Sparse constraint

[1] Hua G,Fu Y,Turk M,et al.Introduction to the special issue on mobile vision[J].International Journal of Computer Vision,2012,6(3):277-279
[2] Shan Shi-guang,Chang Yi-zheng,Gao Wen,et al.Curse of misa-lignment in face recognition:problem and a novel mis-alignment learning solution[C]∥Proceedings of the Automatic Face and Gesture Recognition,2004.Seoul,Korea,2004:314-320
[3] Cootes T F,Taylor C J.Active shape models—‘smart snakes’[C]∥Proceedings of the British Machine Vision Conference,1992.London,England,1992:266-275
[4] Cootes T F,Taylor C J,Cooper D H,et al.Active shape models-their training and application[J].Computer vision and image understanding,1995,1(1):38-59
[5] Cootes T F,Edwards G J,et al.Active appearance models[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2001,3(6):681-685
[6] Matthews I,Baker S.Active appearance models revisited[J].International Journal of Computer Vision,2004,0(2):135-164
[7] Cristinacce D,Cootes T.Automatic feature localisation withconstrained local models[J].Pattern Recognition,2008,1(10):3054-3067
[8] Zhu Xiang-xin,Ramanan D.Face detection,pose estimation,and landmark localization in the wild[C]∥Proceedings of the Computer Vision and Pattern Recognition,2012.Rhode,America,2012:2879-2886
[9] Zhou Feng,Brandt J,Zhe Lin.Exemplar-based graph matching for robust facial landmark localization[C]∥Proceedings of the International Conference on Computer Vision,2013.Sydney,Australia,2013:1025-1032
[10] Yi Sun,Wang Xiao-gang,Tang Xiao-ou.Deep convolutional network cascade for facial point detection[C]∥Proceedings of the Computer Vision and Pattern Recognition,2013.Portland,America,2013:3476-3483
[11] Zhou Er-jin,Fan Hao-qiang,Cao Zhi-min,et al.Extensive Facial Landmark Localization with Coarse-to-Fine Convolutional Network Cascade[C]∥Workshops of the International Conference on Computer Vision,2013.Sydney,Australia,2013:386-391
[12] Piotr D,Welinder P,Perona P.Cascaded pose regression[C]∥Proceedings of the Computer Vision and Pattern Recognition,2010.San Francisco,America,2010:1078-1085
[13] Cao Xu-dong,Wei Yi-chen,Wen Fang,et al.Face alignment by explicit shape regression[C]∥Proceedings of the Computer Vision and Pattern Recognition,2012.Rhode,America,2012:2887-2894
[14] Xiong Xue-han,De T F.Supervised descent method and its applications to face alignment[C]∥Proceedings of the Computer Vision and Pattern Recognition,2013.Portland,America,2013:532-539
[15] Yan Jun-jie,Zhen Lei,Dong Yi,et al.Learn to Combine Multiple Hypotheses for Accurate Face Alignment[C]∥Workshops of the International Conference on Computer Vision,2013.Sydney,Australia,2013:392-396
[16] Burgos A,Xavier P,Perona P,et al.Robust face landmark estimation under occlusion[C]∥Proceedings of the International Conference on Computer Vision.Sydney,Australia,2013:1513-1530
[17] Ren Shao-qing,Cao Xu-dong,Wei Yi-chen,et al.Face Alignment at 3000 FPS via Regressing Local Binary Features[C]∥Proceedings of the Computer Vision and Pattern Recognition.Columbus,America,2014:1685-1692
[18] Hare S,Saffari A,Torr P H S.Efficient online structured output learning for keypoint-based object tracking[C]∥Proceedings of the Computer Vision and Pattern Recognition.Rhode,America,2012:2887-2894
[19] Tibshirani R.Regression shrinkage and selection via the lasso[J].Journal of the Royal Statistical Society,1994,8(1):267-288
[20] Heikkila M,Pietikainen M,Schmid.Description of interest re-gions with local binary patterns[J].Pattern Recognition,2009,2(3):425-436
[21] Gross R,Matthews I,Cohn J,et al.Multi-pie[J].Image and Vision Computing,2010,8(5):807-813
[22] Sagonas C, Tzimiropoulos G,Zafeiriou S,et al.300 Faces in-the-Wild Challenge:The first facial landmark localization Challenge[C]∥Workshops of the International Conference on Computer Vision.Sydney,Australia,2013:397-403

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!