Computer Science ›› 2020, Vol. 47 ›› Issue (11A): 615-619.doi: 10.11896/jsjkx.200400142

• Interdiscipline & Application • Previous Articles     Next Articles

Face Image Deduplication Based on Fusion of Face Tracking and Clustering

LIN Zeng-min, HONG Chao-qun, ZHUANG Wei-wei   

  1. College of Computer and Information Engineering,Xiamen University of Technology,Xiamen,Fujian 361024,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:LIN Zeng-min,born in 1996,postgraduate.His main research interests include computer vision and image processing.
    HONG Chao-qun,born in 1984,Ph.D,professor,is a member of China Computer Federation.His main research interests include computer vision,high-performance computing and Internet of Things.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61871464,61836002),Fujian Provincial Natural Science Foundation of China (2018J01573),Distinguished Young Scientific Research Talents Plan in Universities of Fujian Province and Program for New Century Excellent Talents in University of Fujian Province(2018J01573).

Abstract: Face image deduplication is of great significance to face recognition in intelligent surveillance systems,since face detection in videos will produce a large number of repeated face images.In this paper,a method of face image deduplication in videosby integration of face tracking and clustering is proposed.In a video,use the face detection algorithm in the Multi-task Convolutional Neural Network to extract the face frame and its corresponding coordinates.Face tracking is used to construct the face trajectory and the constraint matrix,and the face quality evaluation algorithm is introduced to select the face pose and image clarity from the face trajectory.An optimal face image is used as a representative of the face trajectory.Combined with the constraint matrix and unsupervised clustering algorithm,the representative images of the faces are clustered to obtain the face image of the same person.Finally,the face image of each person is evaluated again to obtain the deduplication.Experimental results show that,through face tracking and unsupervised clustering,the face image deduplication method in videos can quickly and efficiently obtain high-quality face images that are not repeated for each person from a video.

Key words: Face clustering, Face detection, Face track

CLC Number: 

  • TP391
[1] LI X F.Development status and changes of the face recognition market [J].China Security,2020(Z1):39-42.
[2] ZHOU J,LU C Y,ZHANG C S,et al.A review of automaticface recognition methods [J].Acta Electronica Sinica,2000(4):102-106.
[3] LIANG L H,AI H Z,XU G Y,et al.Review of research on face detection [J].Journal of Computer Science,2002(5):449-458.
[4] FANG G N,HU Q H,FANG S Y,et al.Face image quality evaluation in video stream and its application in classroom attendance system [J].Computer Applications and Software,2018,35(10):140-146,251.
[5] CHEN Q.Face detection and face deduplication in video surveillance [D].China Jiliang University,2018.
[6] CHEN Z H,WU Y D,CAI G R,et al.Facequality assessment algorithm based on texture feature fusion [J].Journal of Jimei University (Natural Science),2018,23(4):312-320.
[7] WANG C,CUI R Y,JIN J X,et al.Research on the optimization method of face images in videos based on face clustering [J].Progress in Laser and Optoelectronics,2019,56(20):243-251.
[8] CAO X,ZHANG C,ZHOU C,et al.Constrained multi-view video face clustering [J].IEEE Transactions on Image Processing,2015,24(11):4381-4393.
[9] WU B,ZHANG Y,HU B,et al.Constrained clustering and its application to face clustering in videos [C]//Proceedings of the IEEE Conference on Computer Vision and PatternRecognition.Portland Oregon:IEEE,2013:3507-3514.
[10] ZHANG K,ZHANG Z,LI Z,et al.Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks[J].IEEE Signal Processing Letters,2016,23(10):1499-1503.
[11] ORTIZ E G,WRIGHT A,SHAH M.Facerecognition in movie trailers via mean sequence sparse representation-based classification[J].IEEE Conference on Computer Vision and Pattern Recognition,2013:3531-3538.
[12] PECH-PACHECO J L,CRISTOBAL G,CHAMORRO-MAR-TINEZ J,et al.Diatom autofocusing in brightfield microscopy:a comparative study [C]//15th International Conference on Pattern Recognition.Barcelona,Spain.New York:IEEE,2002:6894564.
[13] ZHANG C H,SHI Y Z.Dynamic face clustering based on Chin-ese Whispers [J].Computer Technology and Development,2019,29(11):92-96.
[14] AMIG,ENRIQUE,GONZALO,et al.A comparison of extrinsic clustering evaluation metrics based on formalconstraints[J].Information Retrieval,2009,12(5):461-486.
[1] JING Hui-yun, ZHOU Chuan, HE Xin. Security Evaluation Method for Risk of Adversarial Attack on Face Detection [J]. Computer Science, 2021, 48(7): 17-24.
[2] ZHANG Kai-qiang, JIANG Cong-feng, CHENG Xiao-lan, JIA Gang-yong, ZHANG Ji-lin, WAN Jian. Resource-aware Based Adaptive-scaling Image Target Detection Under Multi-resolution Scenario [J]. Computer Science, 2021, 48(4): 180-186.
[3] WANG Wen-bo, LUO Heng-li. Complete Graph Face Clustering Based on Graph Convolution Network [J]. Computer Science, 2021, 48(11A): 275-277.
[4] DENG Liang, XU Geng-lin, LI Meng-jie, CHEN Zhang-jin. Fast Face Recognition Based on Deep Learning and Multiple Hash Similarity Weighting [J]. Computer Science, 2020, 47(9): 163-168.
[5] ZHAO Bo, YANG Ming, TANG Zhi-wei and CAI Yu-xin. Intelligent Video Surveillance Systems Based on FPGA [J]. Computer Science, 2020, 47(6A): 609-611.
[6] ZHONG Ma-chi, ZHANG Jun-lang, LAN Yang-bo, HE Yue-hua. Study on Online Education Focus Degree Based on Face Detection and Fuzzy Comprehensive Evaluation [J]. Computer Science, 2020, 47(11A): 196-203.
[7] LUO Heng-li, WANG Wen-bo, GE Hong-kong. Face Clustering Algorithm Based on Context Constraints [J]. Computer Science, 2019, 46(11A): 260-263.
[8] HUO Yu-lin and FU Yi-de. Face Detection Design Based on Zynq [J]. Computer Science, 2016, 43(10): 322-325.
[9] YE Jun and ZHANG Zheng-jun. Face Detection Based on DS-Adaboost Algorithm [J]. Computer Science, 2013, 40(Z11): 318-319.
[10] QIANG Bao-hua,LI Wei,ZOU Xian-chun,WANG Tian-tian and WU Chun-ming. Research on Deep Web Query Interface Clustering Based on Latent Semantic Analysis [J]. Computer Science, 2013, 40(11): 228-230.
[11] XIE Qian-ru,GENG Guo-hua. Automatic Face Detection in Video Sequences in Complex Lighting Environments [J]. Computer Science, 2011, 38(10): 267-269.
[12] ZHANG Yong,XUE Zhi-mao. Face Detection System Design Based on Two Classifiers [J]. Computer Science, 2010, 37(4): 293-.
[13] LEI Zhen,WANG Qing-hai,WU Ling-da,XUE Ting-mei. Face Detection Based on Adaptive Tracking Window Scale [J]. Computer Science, 2010, 37(4): 281-.
[14] LI Xiang,WANG Jian-guo. Optimization Algorithm for Detection and Localization of Pure Face in Color Images [J]. Computer Science, 2009, 36(7): 284-287.
[15] . [J]. Computer Science, 2008, 35(6): 223-226.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!