Computer Science ›› 2023, Vol. 50 ›› Issue (2): 209-213.doi: 10.11896/jsjkx.220500153

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Few-shot Object Detection Based on Feature Fusion

HUA Jie, LIU Xueliang, ZHAO Ye   

  1. School of Computer Science and Information Engineering,Hefei University of Technology,Hefei 230601,China
  • Received:2022-05-17 Revised:2022-11-08 Online:2023-02-15 Published:2023-02-22
  • Supported by:
    National Key R & D Program of China(2018AAA0102002) and National Natural Science Foundation of China(61976076,61632007)

Abstract: Few-shot object detection aims to train target detection model through a small amount of sample learning.At present,most of the existing few-shot object detection methods are based on classical target detection algorithms.In the two-stage detection method,due to the small number of new class samples,many irrelevant border boxes are generated,resulting in low accuracy of candidate regions.To solve this problem,this paper proposes a few-shot object detection algorithm FF-FSOD based on feature fusion.It uses the feature fusion method to enhance the data,supplements the new category samples,increases the coverage range of the sample,and introduces the FPN network to extract multi-scale feature.Then,the RPN network is improved,and the support set image branch is introduced.The depth correlation between the support set image feature and the query set image feature is calculated,and the attention feature map is obtained,and the more accurate candidate box is obtained.The effectiveness of the proposed model is verified on MS COCO and FSOD datasets.Experimental results show that the proposed method obtains more accurate candidate boxes and improves the detection accuracy.

Key words: Few-shot learning, Object detection, Deep learning, Feature fusion, Feature pyramid

CLC Number: 

  • TP391
[1]CAO J,QU X,LI X X.Few-shot image classification methodbased on sliding feature vectors[J].Journal of Jilin University(Engineering and Technology Edition),2021,51(5):1785-1791.
[2]CHEN H,WANG Y,WANG G,et al.LSTD:a low-shot transfer detector for object detection[C]//Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence.2018:2836-2843.
[3]DONAHUE J,JIA Y,VINYALS O,et al.Decaf:A deep convolutional activation feature for generic visual recognition[C]//International Conference on Machine Learning.PMLR,2014:647-655.
[4]WU J,LIU S,HUANG D,et al.Multi-scale positive sample refinement for few-shot object detection[C]//European Confe-rence on Computer Vision.Cham:Springer,2020:456-472.
[5]YAN X,CHEN Z,XU A,et al.Meta r-cnn:Towards general solver for instance-level low-shot learning[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:9577-9586.
[6]XIAO Z,ZHONG P,QUAN Y,et al.Few-shot object detection with feature attention highlight module in remote sensing images[C]//2020 International Conference on Image,Video Processing and Artificial Intelligence.SPIE,2020:217-223.
[7]FAN Q,ZHUO W,TANG C K,et al.Few-shot object detection with attention-RPN and multi-relation detector[C]//Procee-dings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:4013-4022.
[8]WANG X,HUANG T,GONZALEZ J,et al.Frustratingly simple few-shot object detection[C]//International Conference on Machine Learning.PMLR,2020:9919-9928.
[9]LI X,DENG J,FANG Y.Few-shot object detection on remote sensing images[J].IEEE Transactions on Geoscience and Remote Sensing,2021,60:1-14.
[10]KANG B,LIU Z,WANG X,et al.Few-shot object detection via feature reweighting[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:8420-8429.
[11]ZHANG W,WANG Y X.Hallucination improves few-shot object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:13008-13017.
[12]RIOU K,ZHU J,LING S,et al.Few-Shot Object Detection in Real Life:Case Study on Auto-Harvest[C]//2020 IEEE 22nd International Workshop on Multimedia Signal Processing(MMSP).IEEE,2020:1-6.
[13]ZHU C,CHEN F,AHMED U,et al.Semantic relation reasoning for shot-stable few-shot object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:8782-8791.
[14]RAHMAN S,KHAN S,BARNES N,et al.Any-shot object detection[C]//Proceedings of the Asian Conference on Computer Vision.2020.
[15]CHEN Z,FU Y,ZHANG Y,et al.Semantic feature augmentation in few-shot learning[J].arXiv:1804.05298,2018.
[16]KARLINSKY L,SHTOK J,HARARY S,et al.Repmet:Representative-based metric learning for classification and few-shot object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:5197-5206.
[17]ZHANG T,ZHANG Y,SUN X,et al.Comparison network for one-shot conditional object detection[J].arXiv:1904.02317,2019.
[18]XU P B,SANG J T,LU D Y.Few shot image recognition based on class semantic similarity supervision[J].Journal of Image and Graphics,2021,26(7):1594-1603.
[19]XIAO Y,MARLET R.Few-shot object detection and viewpoint estimation for objects in the wild[C]//European Conference on Computer Vision.Cham:Springer,2020:192-210.
[20]SUN B,LI B,CAI S,et al.Fsce:Few-shot object detection via contrastive proposal encod-ing[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:7352-7362.
[21]DONG X,ZHENG L,MA F,et al.Few-example object detection with model communication[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,41(7):1641-1654.
[22]CHEN X,JIANG M,ZHAO Q.Leveraging bottom-up and top-down attention for few-shot object detection[J].arXiv:2007.12104,2020.
[23]REN S,HE K,GIRSHICK R,et al.Faster R-CNN:Towardsreal-time object detection with region proposal networks[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2016,39(6):1137-1149.
[24]GIRSHICK R.Fast r-cnn[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:1440-1448.
[25]HARRIS E,MARCU A,PAINTER M,et al.Fmix:Enhancing mixed sample data augmentation[J].arXiv:2002.12047,2020.
[26]LIN T Y,DOLLÁR P,GIRSHICK R,et al.Feature pyramidnetworks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:2117-2125.
[27]TSUNGYL,PRIYA G,ROSS G,et al.Focal loss for dense object detection[C]//ICCV.2017.
[28]REDMON J,FARHADI A.Yolov3:An incremental improvement[J].arXiv:1804.02767,2018.
[29]WU A,HAN Y,ZHU L,et al.Universal-prototype enhancing for few-shot object detection[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2021:9567-9576.
[1] BAI Xuefei, MA Yanan, WANG Wenjian. Segmentation Method of Edge-guided Breast Ultrasound Images Based on Feature Fusion [J]. Computer Science, 2023, 50(3): 199-207.
[2] LIU Hang, PU Yuanyuan, LYU Dahua, ZHAO Zhengpeng, XU Dan, QIAN Wenhua. Polarized Self-attention Constrains Color Overflow in Automatic Coloring of Image [J]. Computer Science, 2023, 50(3): 208-215.
[3] XIE Qinqin, HE Lang, XU Ruli. Classification of Oil Painting Art Style Based on Multi-feature Fusion [J]. Computer Science, 2023, 50(3): 223-230.
[4] ZHANG Weiliang, CHEN Xiuhong. SSD Object Detection Algorithm with Cross-layer Fusion and Receptive Field Amplification [J]. Computer Science, 2023, 50(3): 231-237.
[5] CHEN Liang, WANG Lu, LI Shengchun, LIU Changhong. Study on Visual Dashboard Generation Technology Based on Deep Learning [J]. Computer Science, 2023, 50(3): 238-245.
[6] ZHANG Yi, WU Qin. Crowd Counting Network Based on Feature Enhancement Loss and Foreground Attention [J]. Computer Science, 2023, 50(3): 246-253.
[7] YING Zonghao, WU Bin. Backdoor Attack on Deep Learning Models:A Survey [J]. Computer Science, 2023, 50(3): 333-350.
[8] DONG Yongfeng, HUANG Gang, XUE Wanruo, LI Linhao. Graph Attention Deep Knowledge Tracing Model Integrated with IRT [J]. Computer Science, 2023, 50(3): 173-180.
[9] HUA Xiaofeng, FENG Na, YU Junqing, HE Yunfeng. Shooting Event Detection of Free Kick in Soccer Video Based on Rule Reasoning [J]. Computer Science, 2023, 50(3): 181-190.
[10] MEI Pengcheng, YANG Jibin, ZHANG Qiang, HUANG Xiang. Sound Event Joint Estimation Method Based on Three-dimension Convolution [J]. Computer Science, 2023, 50(3): 191-198.
[11] LIU Zejing, WU Nan, HUANG Fuqun, SONG You. Hybrid Programming Task Recommendation Model Based on Knowledge Graph and Collaborative Filtering for Online Judge [J]. Computer Science, 2023, 50(2): 106-114.
[12] ZOU Yunzhu, DU Shengdong, TENG Fei, LI Tianrui. Visual Question Answering Model Based on Multi-modal Deep Feature Fusion [J]. Computer Science, 2023, 50(2): 123-129.
[13] WANG Pengyu, TAI Wenxin, LIU Fang, ZHONG Ting, LUO Xucheng, ZHOU Fan. Self-supervised Flight Trajectory Prediction Based on Data Augmentation [J]. Computer Science, 2023, 50(2): 130-137.
[14] GUO Nan, LI Jingyuan, REN Xi. Survey of Rigid Object Pose Estimation Algorithms Based on Deep Learning [J]. Computer Science, 2023, 50(2): 178-189.
[15] LI Junlin, OUYANG Zhi, DU Nisuo. Scene Text Detection with Improved Region Proposal Network [J]. Computer Science, 2023, 50(2): 201-208.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!