基于半直接方法的序列影像直线特征跟踪匹配算法

摘要/Abstract

摘要： 针对序列影像相邻帧间相对运动较小的特点,提出了一种基于半直接方法的序列影像直线特征跟踪匹配算法。首先,选取关键帧进行点特征和直线特征的提取与匹配;然后,利用运动恢复结构算法对直线上的特征点进行重建;接着,通过反向合成图像对齐算法实现相邻帧的直线特征点的跟踪和摄像机相对位姿估的计;最后,由跟踪特征点实现对直线特征的跟踪匹配。采用两组不同的序列影像数据对算法进行了验证,实验表明所提算法能够实现序列影像直线特征的准确跟踪匹配,并能同时估计得到摄像机的位姿;摄像机的位姿估计误差随着帧数的增加而累积。文中还提出了一种新的序列影像直线特征跟踪匹配算法,该算法仅利用直线上的稀疏特征点就可实现对相邻影像间的直线特征的准确跟踪匹配,并能估计得到摄像机的运动轨迹。但是,该方法存在累积误差,需要进一步改进。

关键词: 半直接方法, 相对位姿估计, 序列影像, 直线特征跟踪匹配

Abstract: Considering the small motion in image sequence,this paper proposed a line tracking and matching algorithm based on semi-direct method is proposed.Firstly,extracting and matching of feature point and line should be conducted in the key frames.Secondly,feature point of the line is reconstructed by using the method of structure from motion.Then,feature point tracking and relative pose estimation are calculated through inverse compositional image alignment algorithm.Finally,line matching result is obtained based on feature point tracking result.Two group of image sequence experiments were conducted to validate the proposed algorithm.The experiments results indicate that the proposed algorithm is capable of tracking and matching the lines in the image sequence,and can estimate the camera pose simultaneously.And camera pose error accumulates with the increase of image frame.A novel line matching algorithm in image sequence was proposed.The algorithm can achieve line tracking and matching and obtain camera track at the same time through sparse feature point of the line.However,the algorithm needs to be corrected because of accumulate error.

Key words: Image sequence, Line tracking and matching, Relative pose estimation, Semi-direct method

中图分类号:

TP391

朱世昕, 杨泽民. 基于半直接方法的序列影像直线特征跟踪匹配算法[J]. 计算机科学, 2019, 46(6A): 270-273. https://doi.org/

ZHU Shi-xin, YANG Ze-min. Line Tracking and Matching Algorithm Based on Semi-direct Method in Image Sequence[J]. Computer Science, 2019, 46(6A): 270-273. https://doi.org/

参考文献

[1]张跃强,苏昂,朱遵尚,等.结合局部描述符合拓扑约束的直线段匹配算法[J].国防科技大学学报,2014,36(6):25-30.
[2]张聪炫,陈震,黎明.点线光流预测机制的图像序列运动直线跟踪[J].中国图象图形学报 2015,20(9):1177-1187.
[3]BAY H,FERRARIS V,VAN GOOL L.Wide-baseline stereo matching with line segments[C]∥Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington DC,USA:IEEE,2005:329-336.
[4]LOPEZ J,FUCINOS M,FDEZVIDAL X R,et al.Detection and matching of lines for close-range photogrammetry[C]∥Proceedings of the 6th Iberian Conference on Pattern Recognition and Image Analysis.Madeira,Portugal:Springer,2013:732-739.
[5]ZHANG L L,KOCH R.An e±cient and robust line segment matching approach based on LBD descriptor and pairwisegeometric consistency[J].Journal of Visual Communication and Image Representation,2013,24(7):794-805.
[6]文贡坚.一种基于特征编组的直线立体匹配全局算法[J].软件学报,2006,17(12):2471-2484.
[7]梁艳,盛业华,张卡,等.利用局部仿射不变及核线约束的近景影像直线特征匹配[J].武汉大学学报(信息科学版),2014,39(2):229-233.
[8]胡海霞,李钢.几何特性二元关系的直线匹配[J].中国图象图形学报 2014,19(9):1338-1348.
[9]FORSTER C,PIZZOLI M,SCARAMUZZA D.SVO:Fast Semi-Direct Monocular Visual Odometry[C]∥IEEE International Conference on Robotics & Automation(ICRA).2014:15-22.
[10]RUBLEE E,RABAUD V,KONOLIGE K,et al.ORB:an effi-cient alternative to SIFT or SURF[C]∥IEEE International Conference on Computer Vision (ICCV).Barcelona,Spain,2011:2564-2571.
[11]ROSTEN E,PORTER R,DRUMMOND T.Faster and better:a machine learning approach to corner detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,32(1):105-119.
[12]CALONDER M,LEPETIT V,STRECHA C,et al.BRIEF: Computing a local binary descriptor very fast[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(7):1281-1298.
[13]张振杰,郝向阳,刘松林,等.基于Hough一维变换的直线检测算法[J].光学学报,2016,36(4):1-8.

相关文章 15

[1]	陈志强, 韩萌, 李慕航, 武红鑫, 张喜龙. 数据流概念漂移处理方法研究综述 Survey of Concept Drift Handling Methods in Data Streams 计算机科学, 2022, 49(9): 14-32. https://doi.org/10.11896/jsjkx.210700112
[2]	王明, 武文芳, 王大玲, 冯时, 张一飞. 生成链接树:一种高数据真实性的反事实解释生成方法 Generative Link Tree:A Counterfactual Explanation Generation Approach with High Data Fidelity 计算机科学, 2022, 49(9): 33-40. https://doi.org/10.11896/jsjkx.220300158
[3]	张佳, 董守斌. 基于评论方面级用户偏好迁移的跨领域推荐算法 Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer 计算机科学, 2022, 49(9): 41-47. https://doi.org/10.11896/jsjkx.220200131
[4]	周芳泉, 成卫青. 基于全局增强图神经网络的序列推荐 Sequence Recommendation Based on Global Enhanced Graph Neural Network 计算机科学, 2022, 49(9): 55-63. https://doi.org/10.11896/jsjkx.210700085
[5]	宋杰, 梁美玉, 薛哲, 杜军平, 寇菲菲. 基于无监督集群级的科技论文异质图节点表示学习方法 Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level 计算机科学, 2022, 49(9): 64-69. https://doi.org/10.11896/jsjkx.220500196
[6]	柴慧敏, 张勇, 方敏. 基于特征相似度聚类的空中目标分群方法 Aerial Target Grouping Method Based on Feature Similarity Clustering 计算机科学, 2022, 49(9): 70-75. https://doi.org/10.11896/jsjkx.210800203
[7]	郑文萍, 刘美麟, 杨贵. 一种基于节点稳定性和邻域相似性的社区发现算法 Community Detection Algorithm Based on Node Stability and Neighbor Similarity 计算机科学, 2022, 49(9): 83-91. https://doi.org/10.11896/jsjkx.220400146
[8]	吕晓锋, 赵书良, 高恒达, 武永亮, 张宝奇. 基于异质信息网的短文本特征扩充方法 Short Texts Feautre Enrichment Method Based on Heterogeneous Information Network 计算机科学, 2022, 49(9): 92-100. https://doi.org/10.11896/jsjkx.210700241
[9]	徐天慧, 郭强, 张彩明. 基于全变分比分隔距离的时序数据异常检测 Time Series Data Anomaly Detection Based on Total Variation Ratio Separation Distance 计算机科学, 2022, 49(9): 101-110. https://doi.org/10.11896/jsjkx.210600174
[10]	聂秀山, 潘嘉男, 谭智方, 刘新放, 郭杰, 尹义龙. 基于自然语言的视频片段定位综述 Overview of Natural Language Video Localization 计算机科学, 2022, 49(9): 111-122. https://doi.org/10.11896/jsjkx.220500130
[11]	曹晓雯, 梁美玉, 鲁康康. 基于细粒度语义推理的跨媒体双路对抗哈希学习模型 Fine-grained Semantic Reasoning Based Cross-media Dual-way Adversarial Hashing Learning Model 计算机科学, 2022, 49(9): 123-131. https://doi.org/10.11896/jsjkx.220600011
[12]	周旭, 钱胜胜, 李章明, 方全, 徐常胜. 基于对偶变分多模态注意力网络的不完备社会事件分类方法 Dual Variational Multi-modal Attention Network for Incomplete Social Event Classification 计算机科学, 2022, 49(9): 132-138. https://doi.org/10.11896/jsjkx.220600022
[13]	戴禹, 许林峰. 基于文本行匹配的跨图文本阅读方法 Cross-image Text Reading Method Based on Text Line Matching 计算机科学, 2022, 49(9): 139-145. https://doi.org/10.11896/jsjkx.220600032
[14]	曲倩文, 车啸平, 曲晨鑫, 李瑾如. 基于信息感知的虚拟现实用户临场感研究 Study on Information Perception Based User Presence in Virtual Reality 计算机科学, 2022, 49(9): 146-154. https://doi.org/10.11896/jsjkx.220500200
[15]	周乐员, 张剑华, 袁甜甜, 陈胜勇. 多层注意力机制融合的序列到序列中国连续手语识别和翻译 Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion 计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed