计算机科学 ›› 2020, Vol. 47 ›› Issue (11A): 215-218.doi: 10.11896/jsjkx.200500067

• 计算机图形学&多媒体 • 上一篇    下一篇

基于卷积神经网络的焊接装配特征识别研究

陈建强, 秦娜   

  1. 西南交通大学电气工程学院 成都 610031
    西南交通大学系统科学与技术研究所 成都 610031
  • 出版日期:2020-11-15 发布日期:2020-11-17
  • 通讯作者: 秦娜(qinna@swjtu.cn)
  • 作者简介:cjqsyghr@my.swjtu.edu.cn
  • 基金资助:
    2017年度国家重点研发计划“智能机器人”重点专项(2017YFB1303402,2017YFB1303402-03);国家自然科学基金项目(61603316,61773323);四川省科技计划(2019YJ0210,2019YFG0345)

Recognition Algorithm of Welding Assembly Characteristics Based on Convolutional Neural Network

CHEN Jian-qiang, QIN Na   

  1. School of Electrical Engineering,Southwest Jiaotong University,Chengdu 610031,China
    Institute of Systems Science and Technology,Southwest Jiaotong University,Chengdu 610031,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:CHEN Jian-qiang,born in 1995,postgraduate.His main research interests include computer vision and so on.
    QIN Na,born in 1978,Ph.D,associate professor,Ph.D supervisor.Her main research interests include machine vision and intelligent image processing.
  • Supported by:
    This work was supported by the 2017 National Key R&D Program “Intelligent Robot” Key Special Project(2017YFB1303402,2017YFB1303402-03),National Natural Science Foundation of China(61603316,61773323) and Sichuan Science and Technology Plan(2019YJ0210, 2019YFG0345).

摘要: 为实现高铁白车身焊接拼装技术的智能化与自动化,解决焊接过程中特征区域小、背景干扰多等问题,提出了基于迁移学习和卷积神经网络的焊接装配特征快速识别算法。首先采用二值化等传统图像处理算法确定待提取特征的粗略位置,在此基础上再使用sobel、腐蚀、霍夫线段检测确定特征区域的精确位置。其次,考虑到不同环境下,精确定位后特征区域表现不同,故采用基于卷积神经网络的分类模型以增强预测模型的鲁棒性和准确性。最后,选择基于迁移学习的的视觉几何群网络(VGG16)来解决样本量不足以训练整个模型参数的问题。实验结果表明,本文所提的识别算法能够准确识别型材的状态,且在识别检测速度上优于YOLOV3,在准确率上劣于YOLOV3,算法满足使用场景下的实时性要求。

关键词: 霍夫线段检测, 卷积神经网络, 迁移学习, 视觉几何群网络(VGG16), 特征快速识别

Abstract: In order to realize the intellectualization and automation of welding and assembling technology for high-speed white body,the problems of small feature area and multi-background interference in welding process are solved,a novel fast recognition algorithm of welding assembly based on migration learning and convolution neural network is proposed.Firstly,the traditional image processing algorithms such as binarization are used to determine the rough position of the feature to be extracted.On this basis,Sobel,corrosion and Hough line detection are used to determine the precise position of the feature area.Secondly,considering the different performance of feature regions in different environments,a classification model based on convolution neural network is adopted to enhance the robustness and accuracy of the prediction model.At last,Visual Geometry Group Network (VGG16) based on transfer learning is selected to solve the problem that the number of the samples is not enough to train the parameters of the whole model.The experimental results show that the recognition algorithm proposed in this paper can accurately identify the state of profile,and the detection speed is better than YOLOV3,and the accuracy is inferior to YOLOV3.The algorithm can meet the real-time requirements in the use scene.

Key words: Convolution neural network (CNN), Fast feature recognition, Hough line segment detection, Transfer learning, Visual geometry group network(VGG16)

中图分类号: 

  • TP391.4
[1] YANG S Y.Image recognition and project practice:VC ++ and MATLAB technology implementation [M].Electronic Industry Press,2014.
[2] KRIZHEVSKY A,SUTSKEVER I,HINTON G.Image NetClassification with Deep Convolutional Neural Networks[J].Advances in neural information processing systems,2012,25(2):1097-1105.
[3] LECUN Y,KAVUKCUOGLU K,et al.Convolutional Net-works and Applications in Vision[C]//Proceedings of 2010 IEEE International Symposium on Circuits and Systems.2010.
[4] LIN T Y,GOYAL,PRIYA,et al.Focal Loss for Dense Object Detection[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2020,42(2):318-327.
[5] PAN S J,YANG Q.A Survey on Transfer Learning[J].IEEE Transactions on Knowledge and Data Engineering,2010,22(10):1345-1359.
[6] YUAN C L,XIONG Z L,ZHOU X H,et al.Research on image edge detection based on Sobel operator [J].Laser and Infrared,2009,39 (1):85-87.
[7] BAKER L,MILLS S,LANGLOTZ T,et al.Power line detectionusing Hough transform and line tracing techniques[C]//International Conference on Image and Vision Computing New Zea-land.IEEE,2017:1-6.
[8] YE H,SHANG G,WANG L,et al.A new method based onhough transform for quick line and circle detection[C]//International Conference on Biomedical Engineering & Informatics.IEEE,2016:52-56.
[9] MAO X Y,LENG X F,et al.Introduction to Opencv3 programming [M].Beijing:Electronic Industry Press,2015.
[10] SIMONYAN K,ZISSERMAN A.Very Deep Convolutional Networks for Large-Scale Image Recognition[J].arXiv:1409.1556.
[11] DENG J,DONG W,SOCHER R,et al.ImageNet:A large-scale hierarchical image database[C]//CVPR.2009:248-255.
[12] LI J,MEI X,PROKHOROV D.Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene[J].IEEE Transactions on Neural Networks & Learning Systems,2016,28(3):690-703.
[13] ZHENG Z Y,LIANG B W,GU S Y,et al,TensorFlow combat Google deep learning framework(Second Edition) [M].Beijing:Electronic Industry Press,2017.
[1] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
[2] 李宗民, 张玉鹏, 刘玉杰, 李华.
基于可变形图卷积的点云表征学习
Deformable Graph Convolutional Networks Based Point Cloud Representation Learning
计算机科学, 2022, 49(8): 273-278. https://doi.org/10.11896/jsjkx.210900023
[3] 方义秋, 张震坤, 葛君伟.
基于自注意力机制和迁移学习的跨领域推荐算法
Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning
计算机科学, 2022, 49(8): 70-77. https://doi.org/10.11896/jsjkx.210600011
[4] 陈泳全, 姜瑛.
基于卷积神经网络的APP用户行为分析方法
Analysis Method of APP User Behavior Based on Convolutional Neural Network
计算机科学, 2022, 49(8): 78-85. https://doi.org/10.11896/jsjkx.210700121
[5] 朱承璋, 黄嘉儿, 肖亚龙, 王晗, 邹北骥.
基于注意力机制的医学影像深度哈希检索算法
Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism
计算机科学, 2022, 49(8): 113-119. https://doi.org/10.11896/jsjkx.210700153
[6] 檀莹莹, 王俊丽, 张超波.
基于图卷积神经网络的文本分类方法研究综述
Review of Text Classification Methods Based on Graph Convolutional Network
计算机科学, 2022, 49(8): 205-216. https://doi.org/10.11896/jsjkx.210800064
[7] 金方焱, 王秀利.
融合RACNN和BiLSTM的金融领域事件隐式因果关系抽取
Implicit Causality Extraction of Financial Events Integrating RACNN and BiLSTM
计算机科学, 2022, 49(7): 179-186. https://doi.org/10.11896/jsjkx.210500190
[8] 张颖涛, 张杰, 张睿, 张文强.
全局信息引导的真实图像风格迁移
Photorealistic Style Transfer Guided by Global Information
计算机科学, 2022, 49(7): 100-105. https://doi.org/10.11896/jsjkx.210600036
[9] 戴朝霞, 李锦欣, 张向东, 徐旭, 梅林, 张亮.
基于DNGAN的磁共振图像超分辨率重建算法
Super-resolution Reconstruction of MRI Based on DNGAN
计算机科学, 2022, 49(7): 113-119. https://doi.org/10.11896/jsjkx.210600105
[10] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[11] 徐鸣珂, 张帆.
Head Fusion:一种提高语音情绪识别的准确性和鲁棒性的方法
Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition
计算机科学, 2022, 49(7): 132-141. https://doi.org/10.11896/jsjkx.210100085
[12] 王君锋, 刘凡, 杨赛, 吕坦悦, 陈峙宇, 许峰.
基于多源迁移学习的大坝裂缝检测
Dam Crack Detection Based on Multi-source Transfer Learning
计算机科学, 2022, 49(6A): 319-324. https://doi.org/10.11896/jsjkx.210500124
[13] 杨玥, 冯涛, 梁虹, 杨扬.
融合交叉注意力机制的图像任意风格迁移
Image Arbitrary Style Transfer via Criss-cross Attention
计算机科学, 2022, 49(6A): 345-352. https://doi.org/10.11896/jsjkx.210700236
[14] 杨健楠, 张帆.
一种结合双注意力机制和层次网络结构的细碎农作物分类方法
Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure
计算机科学, 2022, 49(6A): 353-357. https://doi.org/10.11896/jsjkx.210200169
[15] 杨涵, 万游, 蔡洁萱, 方铭宇, 吴卓超, 金扬, 钱伟行.
基于步态分类辅助的虚拟IMU的行人导航方法
Pedestrian Navigation Method Based on Virtual Inertial Measurement Unit Assisted by GaitClassification
计算机科学, 2022, 49(6A): 759-763. https://doi.org/10.11896/jsjkx.211200148
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!