计算机科学 ›› 2014, Vol. 41 ›› Issue (12): 297-302.doi: 10.11896/j.issn.1002-137X.2014.12.064

• 图形图像与模式识别 • 上一篇    下一篇

基于层进模型的快速人脸配准方法及其在智能移动设备上的应用

邓健康,王灿田,刘青山   

  1. 南京信息工程大学信息与控制学院 南京210044;南京信息工程大学信息与控制学院 南京210044;南京信息工程大学信息与控制学院 南京210044
  • 出版日期:2018-11-14 发布日期:2018-11-14
  • 基金资助:
    本文受国家自然科学基金项目(61272223),江苏省杰出青年基金(SBK201210296),模式识别国家重点实验室开放课题基金(201204234)资助

Fast Face Alignment Method Based on Hierarchical Model and it’s Application on Mobile Device

DENG Jian-kang,WANG Can-tian and LIU Qing-shan   

  • Online:2018-11-14 Published:2018-11-14

摘要: 主要研究了移动智能手机上人脸关键点的快速定位问题。在活动形状模型的基础上,提出了一种基于层进模型的快速人脸配准方法:首先,在人脸检测的结果上,采用二值特征快速定位眼角、嘴角等关键点,并对其进行校验修正;然后,通过眼角和嘴角的关键点,并结合边缘约束,对眼睛、嘴巴和人脸外轮廓进行局部配准;最后,对整个人脸形状进行基于加权投影的形状配准。实验结果表明,提出的方法在8~10次迭代后即可收敛,在三星I9300智能手机上,每幅人脸图像的配准时间在40ms以下,满足实时性要求。

关键词: 移动平台,人脸关键点,快速定位

Abstract: This paper studied the problem of fast localiztion of facial landmark on a mobile smart phone.Fast face alignment method based on hierarchical model was proposed,which is derived from active shape model.Firstly,the landmarks on the canthi and angulus oris are quickly located using binary feature based on the result of face detection.After that,calibration and correction are performed on these landmarks.Secondly,combined with edge constraint on the eyes,mouth and face outline,local alignments are performed independently based on the location of landmarks on the canthi and angulus oris.Finally,the shape of the whole face is aligned by weighted projection.Experimental results show that the proposed method will converge after 8 to 10 iterations.It takes 40ms or less to complete face alignment on a single face image on a smartphone(the Samsung I9300),which satisfies the request of real time.

Key words: Mobile platform,Facial landmark,Real-time localization

[1] Hua G,Fu Y,Turk M,et al.Introduction to the special issue on mobile vision[J].International Journal of Computer Vision,2012,96(3):277-279
[2] Shan S,Chang Y,Gao W,et al.Curse of mis-alignment in face recognition:problem and a novel mis-alignment learning solution[C]∥Sixth IEEE International Conference on Automatic Face and Gesture Recognition.Proceedings.IEEE,2004:314-320
[3] Cootes T F,Taylor C J.Active shape models—‘smart snakes’[M]∥BMVC92.Springer London,1992:266-275
[4] Cootes T F,Taylor C J,Cooper D H,et al.Active shape models-their training and application[J].Computer vision and image understanding,1995,61(1):38-59
[5] Zhou Y,Gu L,Zhang H J.Bayesian tangent shape model:Estimating shape and pose parameters via bayesian inference[C]∥2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2003.IEEE,vol.1,3:109-116
[6] Cootes T F,Edwards G J,Taylor C J.Active appearance models[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2001,23(6):681-685
[7] Matthews I,Baker S.Active appearance models revisited[J].International Journal of Computer Vision,2004,60(2):135-164
[8] Cristinacce D,Cootes T.Automatic feature localisation withconstrained local models[J].Pattern Recognition,2008,41(10):3054-3067
[9] Felzenszwalb P F,Huttenlocher D P.Pictorial structures for object recognition[J].International Journal of Computer Vision,2005,61(1):55-79
[10] Cootes T F,Taylor C J.Combining point distribution modelswith shape models based on finite element analysis[J].Image and Vision Computing,1995,13(5):403-409
[11] Rogers M,Graham J.Robust active shape model search[M]∥Computer Vision—ECCV 2002.Springer Berlin Heidelberg,2006:517-530
[12] Cootes T F,Taylor C J.A mixture model for representing shape variation[J].Image and Vision Computing,1999,17(8):567-573
[13] Romdhani S,Gong S,Psarrou A.A Multi-View Nonlinear Active Shape Model Using Kernel PCA[C]∥BMVC.1999 :483-492
[14] Huang Y,Liu Q,Metaxas D N.A component-based framework for generalized face alignment[J].Systems,Man,and Cyberne-tics,Part B:Cybernetics,IEEE Transactions on Biomentrics Compendium,IEEE,2011,41(1):287-298
[15] Yan S,Liu C,Li S Z,et al.Face alignment using texture-con-strained active shape models[J].Image and Vision Computing,2003,21(1):69-75
[16] Jiao F,Li S,Shum H Y,et al.Face alignment using statistical models and wavelet features[C]∥2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2003.IEEE,vol.1,3:321-327
[17] Zuo F.Fast facial feature extraction using a deformable shapemodel with haar-wavelet based local texture attributes[C]∥ 2004 International Conference on Image Processing(ICIP’04).IEEE,2004,3:1425-1428
[18] Hare S,Saffari A,Torr P H S.Efficient online structured outputlearning for keypoint-based object tracking[C]∥2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2012:1894-1901
[19] Zhao M,Li S Z,Chen C,et al.Shape evaluation for weighted active shape models[C]∥Proc.of the Asian Conference on Computer Vision.2004:1074-1079
[20] Viola P,Jones M J.Robust real-time face detection[J].International journal of computer vision,2004,57(2):137-154
[21] Heikkil M,Pietikinen M,Schmid C.Description of interest regions with local binary patterns[J].Pattern recognition,2009,42(3):425-436
[22] Milborrow S,Morkel J,Nicolls F.The MUCT landmarked face database[J].Pattern Recognition Association of South Africa,2010,201
[23] Rowley H A,Baluja S,Kanade T.Neural network-based face detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(1):23-38
[24] Calonder M,Lepetit V,Strecha C,et al.Brief:Binary robust independent elementary features[M]∥Computer Vision-ECCV 2010.Springer Berlin Heidelberg,2010:778-792
[25] Milborrow S,Nicolls F.Locating facial features with an extendedactive shape model[M]∥Computer Vision-ECCV 2008.Springer Berlin Heidelberg,2008:504-513
[26] 韩玉峰,王小林.一种基于改进的ASM的人脸特征点定位方法[J].计算机科学,2013,0(4):271-274

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!