Computer Science ›› 2014, Vol. 41 ›› Issue (12): 297-302.doi: 10.11896/j.issn.1002-137X.2014.12.064

Previous Articles     Next Articles

Fast Face Alignment Method Based on Hierarchical Model and it’s Application on Mobile Device

DENG Jian-kang,WANG Can-tian and LIU Qing-shan   

  • Online:2018-11-14 Published:2018-11-14

Abstract: This paper studied the problem of fast localiztion of facial landmark on a mobile smart phone.Fast face alignment method based on hierarchical model was proposed,which is derived from active shape model.Firstly,the landmarks on the canthi and angulus oris are quickly located using binary feature based on the result of face detection.After that,calibration and correction are performed on these landmarks.Secondly,combined with edge constraint on the eyes,mouth and face outline,local alignments are performed independently based on the location of landmarks on the canthi and angulus oris.Finally,the shape of the whole face is aligned by weighted projection.Experimental results show that the proposed method will converge after 8 to 10 iterations.It takes 40ms or less to complete face alignment on a single face image on a smartphone(the Samsung I9300),which satisfies the request of real time.

Key words: Mobile platform,Facial landmark,Real-time localization

[1] Hua G,Fu Y,Turk M,et al.Introduction to the special issue on mobile vision[J].International Journal of Computer Vision,2012,96(3):277-279
[2] Shan S,Chang Y,Gao W,et al.Curse of mis-alignment in face recognition:problem and a novel mis-alignment learning solution[C]∥Sixth IEEE International Conference on Automatic Face and Gesture Recognition.Proceedings.IEEE,2004:314-320
[3] Cootes T F,Taylor C J.Active shape models—‘smart snakes’[M]∥BMVC92.Springer London,1992:266-275
[4] Cootes T F,Taylor C J,Cooper D H,et al.Active shape models-their training and application[J].Computer vision and image understanding,1995,61(1):38-59
[5] Zhou Y,Gu L,Zhang H J.Bayesian tangent shape model:Estimating shape and pose parameters via bayesian inference[C]∥2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2003.IEEE,vol.1,3:109-116
[6] Cootes T F,Edwards G J,Taylor C J.Active appearance models[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2001,23(6):681-685
[7] Matthews I,Baker S.Active appearance models revisited[J].International Journal of Computer Vision,2004,60(2):135-164
[8] Cristinacce D,Cootes T.Automatic feature localisation withconstrained local models[J].Pattern Recognition,2008,41(10):3054-3067
[9] Felzenszwalb P F,Huttenlocher D P.Pictorial structures for object recognition[J].International Journal of Computer Vision,2005,61(1):55-79
[10] Cootes T F,Taylor C J.Combining point distribution modelswith shape models based on finite element analysis[J].Image and Vision Computing,1995,13(5):403-409
[11] Rogers M,Graham J.Robust active shape model search[M]∥Computer Vision—ECCV 2002.Springer Berlin Heidelberg,2006:517-530
[12] Cootes T F,Taylor C J.A mixture model for representing shape variation[J].Image and Vision Computing,1999,17(8):567-573
[13] Romdhani S,Gong S,Psarrou A.A Multi-View Nonlinear Active Shape Model Using Kernel PCA[C]∥BMVC.1999 :483-492
[14] Huang Y,Liu Q,Metaxas D N.A component-based framework for generalized face alignment[J].Systems,Man,and Cyberne-tics,Part B:Cybernetics,IEEE Transactions on Biomentrics Compendium,IEEE,2011,41(1):287-298
[15] Yan S,Liu C,Li S Z,et al.Face alignment using texture-con-strained active shape models[J].Image and Vision Computing,2003,21(1):69-75
[16] Jiao F,Li S,Shum H Y,et al.Face alignment using statistical models and wavelet features[C]∥2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2003.IEEE,vol.1,3:321-327
[17] Zuo F.Fast facial feature extraction using a deformable shapemodel with haar-wavelet based local texture attributes[C]∥ 2004 International Conference on Image Processing(ICIP’04).IEEE,2004,3:1425-1428
[18] Hare S,Saffari A,Torr P H S.Efficient online structured outputlearning for keypoint-based object tracking[C]∥2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2012:1894-1901
[19] Zhao M,Li S Z,Chen C,et al.Shape evaluation for weighted active shape models[C]∥Proc.of the Asian Conference on Computer Vision.2004:1074-1079
[20] Viola P,Jones M J.Robust real-time face detection[J].International journal of computer vision,2004,57(2):137-154
[21] Heikkil M,Pietikinen M,Schmid C.Description of interest regions with local binary patterns[J].Pattern recognition,2009,42(3):425-436
[22] Milborrow S,Morkel J,Nicolls F.The MUCT landmarked face database[J].Pattern Recognition Association of South Africa,2010,201
[23] Rowley H A,Baluja S,Kanade T.Neural network-based face detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(1):23-38
[24] Calonder M,Lepetit V,Strecha C,et al.Brief:Binary robust independent elementary features[M]∥Computer Vision-ECCV 2010.Springer Berlin Heidelberg,2010:778-792
[25] Milborrow S,Nicolls F.Locating facial features with an extendedactive shape model[M]∥Computer Vision-ECCV 2008.Springer Berlin Heidelberg,2008:504-513
[26] 韩玉峰,王小林.一种基于改进的ASM的人脸特征点定位方法[J].计算机科学,2013,0(4):271-274

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!