计算机科学 ›› 2026, Vol. 53 ›› Issue (6): 252-262.doi: 10.11896/jsjkx.250400032

• 计算机图形学&多媒体 • 上一篇    下一篇

小样本下基于空间交互和分割注意力的电力目标检测

邬满1,2, 王高才3, 卢玉婷1, 文莉莉2,3   

  1. 1 广西大学电气工程学院 南宁 530004
    2 广西科学院广西北部湾碳汇与低碳工程研究中心 南宁 530007
    3 广西大学计算机与电子信息学院 南宁 530004
  • 收稿日期:2025-04-08 修回日期:2025-07-04 出版日期:2026-06-15 发布日期:2026-06-09
  • 通讯作者: 王高才(gcwang@gxu.edu.cn)
  • 作者简介:(250016761@qq.com)
  • 基金资助:
    广西自然科学基金(2025GXNSFAA069673,2025GXNSFBA069129);广西科技重大专项(桂科AA22068072)

Power Object Detection Based on Spatial Interaction and Split Attention in Few-shots

WU Man1,2, WANG Gaocai3, LU Yuting1, WEN Lili2,3   

  1. 1 School of Electrical Engineering,Guangxi University,Nanning 530004,China
    2 Research Center for Carbon Sink and Low-Carbon Engineering in the Beibu Gulf of Guangxi,Guangxi Academy of Sciences,
    Nanning 530007,China
    3 School of Computer,Electronics and Information,Guangxi University,Nanning 530004,China
  • Received:2025-04-08 Revised:2025-07-04 Published:2026-06-15 Online:2026-06-09
  • About author:WU Man,born in 1985,Ph.D,professor-level senior engineer,master's supervisor.His main research interests include power system automation and machine vision algorithms.
    WANG Gaocai,born in 1976,Ph.D,professor,Ph.D supervisor.His main research interests include computer networks,system performance evaluation and machine vision.
  • Supported by:
    Natural Science Foundation of Guangxi(2025GXNSFAA069673,2025GXNSFBA069129) and Science and Technology Major Project of Guangxi(Guike-AA22068072).

摘要: 电力线路巡检是预防停电、保障电网安全稳定运行以及促进经济发展的一项核心任务。在实际应用中,会遇到缺陷样本数量有限、设备形状多样、目标遮挡/粘连以及样本不平衡等挑战。为解决这些问题,提出了一种融入空间交互和分割注意力改进的新型两阶段目标检测网络AKS2-Net。该网络引入了多路分割注意力机制进行特征提取与融合,并通过度量学习对候选目标进行二次筛选,增强了对不规则、远小/模糊目标和被遮挡目标特征信息的提取与融合能力,并降低了少样本、样本不均衡对网络性能的影响。具体而言:1)设计了一种基于可变卷积和空间位移的分组卷积特征提取网络AKS2 block(AKConv,Spatial-shift and Split-attention Block),使图像特征之间的空间信息交互以及特征通道之间的关系学习成为可能,从而增强了网络挖掘不规则和多尺度特征信息的能力;2)提出了一种新颖的多分支注意力多尺度特征融合(Multi-branch Attention Feature Fusion,MAFF)模块,通过空洞空间金字塔池化(Atrous Spatial Pyramid Pooling,ASPP)和混合跳跃连接(Mixed Skip Connections,MSC)融合多通道和多层次的图像细节特征以及空间信息,从而在复杂场景中提高了分割精度和边界定位能力;3)提出了一种基于度量学习的特征相似度计算方法,通过对区域候选网络筛选出的负样本特征与所有支持的类别特征进行相似度计算,结合阈值实现对候选负样本的重新筛选,纠正出被误判为负样本的正样本,减少对网络训练的干扰,降低网络对小、模糊目标的漏检率;4)在分类损失计算中引入了FocalLoss函数,以减轻样本不平衡对检测结果的影响;5)以AKS2-Net为骨干,构建了一种适用于小样本、不均衡样本条件的基于两阶段微调的目标检测网络,通过微调机制为小样本目标检测提供了新的选择。大量实验结果表明,所提方法在电力线路目标检测数据集上表现出色,尤其是增强了网络对远小/模糊、被遮挡目标的检测能力,具有显著的实用价值。此外,在使用包括小样本数据集在内的各种数据集的类似实验条件下,与现有的目标检测网络(如ResNet 50,ResNet 101,Inception ResNet,ResNeXt 101,ResNeSt 101)相比,所提模型显示出更强的竞争力。

关键词: 小样本, 度量学习, AKConv, Spatial-shift, Split-Attention, 特征融合

Abstract: Power line inspection is a core task for preventing power outages,ensuring the safe and stable operation of power grids,and promoting economic development.In practical applications,challenges such as limited defect sample numbers,diverse equipment shapes,target occlusion/adhesion,and sample imbalance are often encountered.To address these issues,this paper proposes a novel two-stage object detection network,AKS2-Net,which integrates attention and metric learning improvements.This network combines multiple attention mechanisms for feature extraction and fusion,and uses metric learning for secondary scree-ning of candidate targets,enhancing the extraction and fusion of feature information for irregular,small/fuzzy,and occluded targets,and reducing the impact of few samples and sample imbalance on network performance.Specifically,1)It designs a group convolution feature extraction network AKS2 block(AKConv,Spatial-shift and Split-attention Block)based on variable convolution and spatial shift,making spatial information interaction between image features and relationship learning between feature channels possible,thereby enhancing the network's ability to mine irregular and multi-scale feature information.2)It proposes a novel multi-branch attention multi-scale feature fusion(MAFF)module,which fuses multi-channel and multi-level image detail features and spatial information through atrous spatial pyramid pooling(ASPP)and mixed skip connections(MSC),thereby improving segmentation accuracy and boundary localization ability in complex scenes.3)It proposes a feature similarity calculation method based on metric learning,which re-screens candidate negative samples by calculating the similarity between negative sample features selected by the region proposal network and all support category features,and combines a threshold to correct positive samples misjudged as negative samples,reducing interference with network training and lowering the missed detection rate of small and fuzzy targets.4)It introduces the FocalLoss function in the classification loss calculation to mitigate the impact of sample imbalance on detection results.5)Based on AKS2-Net as the backbone,a two-stage fine-tuning-based object detection network suitable for small sample and imbalanced sample conditions is constructed,providing a new option for small sample object detection through the fine-tuning mechanism.A large number of experimental results show that the proposed method performs well on the power line object detection dataset,especially enhancing the network's detection ability for far small/fuzzy and occluded objects,and has significant practical value.Additionally,under similar experimental conditions using various datasets including small sample datasets,the proposed model demonstrates stronger competitiveness compared to existing object detection networks such as ResNet 50,ResNet 101,Inception ResNet,ResNeXt 101,and ResNeSt 101.

Key words: Few-shot, Metric learning, AKConv, Spatial-shift, Split-Attention, Feature fusion

中图分类号: 

  • TM755
[1]LI S,ZHOU H,WANG G,et al.Cracked Insulator Detection Based on R-FCN[C]//3rd Annual International Conference on Information System and Artificial Intelligence(ISAI2018).2018.
[2]LEI X,SUI Z.Intelligent fault detection of high voltage linebased on the Faster R-CNN[J].Measurement,2019,138:379-385.
[3]LIU X,LI Y,SHUANG F,et al.ISSD:Improved SSD for Insulator and Spacer Online Detection Based on UAV System[J].Sensors,2020,20(23):6961.
[4]YANG Y,WANG L.Insulator recognition based on convolution neural network[C]//MATEC Web of Conferences.EDP Sciences,2017.
[5]LIU X,JIANG H,CHEN J,et al.Insulator detection in aerial images based on faster regions with convolutional neural network[C]//2018 IEEE 14th International Conference on Control and Automation(ICCA).IEEE,2018:1082-1086.
[6]ZHAO Z N,LIU Q F,CAO W M,et al.Self-guided Information for Few-shot Classification[J].Pattern Recognition,2022,131:108880.
[7]DAI J,LI Y,HE K,et al.R-fcn:Object detection via region-based fully convolutional networks[C]//Advances in Neural Information Processing Systems.2016:379-387.
[8]BAI Y F,WANG L B,GAO W D,et al.Multi-modal hierarchicalclassification for power equipment defect detection.Journal of Image and Graphics,29(7):2011-2023.
[9]WU Y,LIU L,XIAO Y,et al.Power Device Image Recognition Based on Improved Attention Mechanism[J].Proceedings of the CSEE,2025,45(3):870-883.
[10]LI L F,MA W F,LI L,et al.Research on detection algorithm for bridge cracks based on deep learning[J].Acta Automatica Sinica,2019,45(9):1727-1742.
[11]ZHAO Z,TANG P,ZHAO L,et al.Few-Shot Object Detection of Remote Sensing Images via Two-Stage Fine-Tuning[J].IEEE Geoscience and Remote Sensing Letters,2022,19:1-5.
[12]DAI J,QI H,XIONG Y,et al Deformable convolutional net-works[C]//Proceedings of the 2017 IEEE International Conference on Computer Vision.IEEE,2017:764-773.
[13]WU A,HAN Y,ZHU L,et al.Universal-prototype enhancing for few-shot object detection[C]//Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision.Piscataway,NJ:IEEE,2021:9567-9576.
[14]HU H,BAI S,LI A,et al.Dense relation distillation with context-aware aggregation for few-shot object detection[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2021:10185-10194.
[15]KANG B,LIU Z,WANG X,et al.Few-shot object detection via feature reweighting[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision.Piscataway,NJ:IEEE,2019:8420-8429.
[16]WANG X,HUANG T E,DARRELL T,et al.Frustratinglysimple few-shot object detection [C]//Proceedings of the 2020 International Conference on Machine Learning.New York:PMLR,2020:9919-9928.
[17]YAN X,CHEN Z,XU A,et al.Meta r-cnn:Towards general solver for instance-level low-shot learning[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision.Piscataway,NJ:IEEE,2019:9577-9586.
[18]YAN X,CHEN Z,XU A,et al.Meta r-cnn:Towards general solver for instance-level low-shot learning[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision.Piscataway,NJ:IEEE,2019:9577-9586.
[19]HAN G,HE Y,HUANG S,et al.Query adaptive few-shot object detection with heterogeneous graph convolutional networks[C]//Proceedings of the 2021 IEEE/CVF International Confe-rence on Computer Vision.Piscataway,NJ:IEEE,2021:3263-3272.
[20]XIAO Y,LEPETIT V,MARLET R.Few-shot object detection and viewpoint estimation for objects in the wild [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2022,45(3):3090-3106.
[21]KANG B,LIU Z,WANG X,et al.Few-shot object detection via feature reweighting[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision.Piscataway,NJ:IEEE,2019:8420-8429.
[22]WANG Y X,RAMANAN D,HEBERT M.Meta-learning to detect rare objects[C]//Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision.Piscataway,NJ:IEEE,2019:9925-9934.
[23]WANG X,HUANG T E,DARRELL T,et al.Frustratinglysimple few-shot object detection [C]//Proceedings of the 2020 International Conference on Machine Learning.New York:PMLR,2020:9919-9928.
[24]ZHU C,CHEN F,AHMED U,et al.Semantic relation reasoning for shot-stable few-shot object detection[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2021:8782-8791.
[25]SUN B,LI B,CAI S,et al.Fsce:Few-shot object detection via contrastive proposal encoding[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2021:7352-7362.
[26]FAN Z,MA Y,LI Z,et al.Generalized few-shot object detection without forgetting[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Pisca-taway,NJ:IEEE,2021:4527-4536.
[27]WU A,HAN Y,ZHU L,et al.Universal-prototype enhancing for few-shot object detection[C]//Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision.Piscataway,NJ:IEEE,2021:9567-9576.
[28]HU H,BAI S,LI A,et al.Dense relation distillation with context-aware aggregation for few-shot object detection[C]//Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2021:10185-10194.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!