计算机科学 ›› 2020, Vol. 47 ›› Issue (11A): 175-177.doi: 10.11896/jsjkx.200400096

• 计算机图形学&多媒体 • 上一篇    下一篇

双视系统的室内三维场景重建研究

陈颖, 赵来旺, 詹洪陈, 丁尧   

  1. 南京大学金陵学院 南京 210089
  • 出版日期:2020-11-15 发布日期:2020-11-17
  • 通讯作者: 丁尧(ammdistin@nju.edu.cn)
  • 作者简介:1803901252@qq.com
  • 基金资助:
    江苏省高校自然科学研究基金(BK20151299)

Study on Reconstruction of Indoor 3D Scene Based on Binocular Vision

CHEN Ying, ZHAO Lai-wang, ZHAN Hong-chen, DING Yao   

  1. Jinling College,Nanjing University,Nanjing 210089,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:CHEN Ying,born in 1999,undergra-duate.Her main research interests include digital image processing and computer vision.
    DING Yao,born in 1981,senior engineer,is a member of China Computer Federation.His main research interests include digital image processing,computer vision and machine learning.
  • Supported by:
    This work was supported by the Natural Science Foundation of the Higher Education Institutions of Jiangsu Province,China(BK20151299).

摘要: 在早期三维场景重建中,受硬件条件的限制,无法很好地对场景进行三维重建。随着硬件的更新迭代,目前可利用结构光和双视系统进行更加高效的三维场景重建。以ZED双目相机和捷宝AD-10电动云台构建硬件平台,通过双目相机获得场景的点云信息,基于全局SBGM(Semi-Global Block Matching)算法的立体匹配和RGB-D图(Red Green Blue Depth Map)的生成来进行单一场景点云重建,并通过ORB特征匹配和ICP(Iterative Closest Point)点云配准融合,实现对室内场景的全景三维重建。实验对比了双目立体视觉的场景重建在过远/过近目标、低纹理特征目标、玻璃等材质目标上的优势,同时在点云的三维场景重建中,提出通过稀疏化来优化点云信息,对比单一采集与多次采集的重建效果。经过实验,该系统在折中采用次数的前提下,可以兼顾场景重建细节与显示效果,并对不同场景目标的三维重建具有实际的工程借鉴意义和应用价值。

关键词: ICP, PCL, 全景场景重建, 三维场景重建, 双目视觉

Abstract: In the early three-dimensional scene reconstruction,due to hardware constraints,it can not be very good for the three-dimensional reconstruction of the scene.With the hardware update iteration,at present,the structured light and dual vision system is used for for more efficient three-dimensional scene reconstruction.The hardware platform is built with zed binocular ca-mera and jabao Ad-10 electric cloud platform,and the point cloud information of the scene is obtained through binocular camera.Based on the stereo matching of the global sbgm (semi global block matching) algorithm and the red green blue depth map generation,the single scene cloud reconstruction is carried out,and through the orb feature matching and ICP (iterative closure Point) point cloud registration and fusion can realize panoramic 3D reconstruction of indoor scene.The experiment compares the advantages of binocular stereo vision scene reconstruction in far/near targets,low texture feature targets,glass and other material targets.At the same time,in the three-dimensional scene reconstruction of point cloud,this paper proposes to optimize the point cloud information through sparseness,and compares the reconstruction effect of single acquisition and multiple acquisition.After the experiment,the system can give consideration to the details of scene reconstruction and the display effect under the premise of the eclectic number of times,and it can be used for reference and application value for 3D reconstruction of different scene targets.

Key words: 3D scene reconstruction, Binocular vision, ICP, Panoramic scene reconstruction, PCL

中图分类号: 

  • TP391
[1] HENRY P,KRAININ M,HERBST E,et al.RGB-D mapping:Using Kinect-style depth cameras for dense 3D modeling of indoor environments[J].The International Journal of Robotics Research,2012,31(5):647-663.
[2] HUANG Y,HUANG J,XIAO C S,et al.Research on ShipTrajectory Tracking Algorithm based on Binocular stereo Vision [J].Computer Science,2017(1):308-313.
[3] YU J W,WEI C.Indoor Mobile Measurement System based on SLAM and its application [J].Bulletin of Surveying and Mapping,2016(6):146-147.
[4] IZADI S,KIM D,HILLIGES O,et al.Kinect Fusion:real-time 3D reconstruction and interaction using a moving depth camera[C]//Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology.ACM,2011:559-568.
[5] ZHANG C,LI Z,CHENG Y,et al.Meshstereo:A global stereo model with mesh alignment regularization for view interpolation[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:2057-2065.
[6] MIAO H C,WANG J H,ZHANG Q Y.Concave-convex Manufacturing Feature Recognition based on single view 3D Reconstruction [J].Computer Science,2019(7):280-285.
[7] HU Z Y,WU F C.Calibration method based on active visioncamera[J].Journal of Computer Science,2002,25(11):1149-1156.
[8] ZHOU S P,GENG G H,LI K,et al.A multi-view geometric 3D reconstruction method based on AKAZE Algorithm [J].Computer Science,2018(S2):180-184,207.
[9] ZHAO F Q,JIA Y T.Point Cloud Registration Method based on Geometric Attributes and improved ICP [J].Information Technology,2019(4):33-38.
[1] 常子霆, 施雨晴, 王俊, 于明鹤, 姚兰, 赵志滨.
基于双目视觉的车辆速度测量方法
Vehicle Speed Measurement Method Based on Binocular Vision
计算机科学, 2021, 48(9): 135-139. https://doi.org/10.11896/jsjkx.201000047
[2] 赵子阳, 蒋慕蓉, 黄亚群, 郝健宇, 曾科.
结合SFS和双目模型的单幅图像深度估计算法
Single Image Depth Estimation Algorithm Based on SFS and Binocular Model
计算机科学, 2019, 46(6A): 161-164.
[3] 李银国, 周中奎, 白羚.
基于双目图像的大尺度智能驾驶场景重建
Large-scale Automatic Driving Scene Reconstruction Based on Binocular Image
计算机科学, 2019, 46(11A): 251-254.
[4] 李秀娟,刘伟,李珊红.
基于双目视觉导航的仿生机器人鲁棒控制算法
Robust Control Algorithm of Bionic Robot Based on Binocular Vision Navigation
计算机科学, 2017, 44(8): 318-321. https://doi.org/10.11896/j.issn.1002-137X.2017.08.055
[5] 赵霞,袁家政,刘宏哲.
基于视觉的目标定位技术的研究进展
Advances in Vision-based Target Location Technology
计算机科学, 2016, 43(6): 10-16. https://doi.org/10.11896/j.issn.1002-137X.2016.06.002
[6] 周娟.
基于三维采样点集的人脸识别
Face Recognition Based on Sampled 3D Points Clouds
计算机科学, 2014, 41(Z6): 147-149.
[7] 王万良,金亦挺,赵燕伟,郑建炜.
基于边缘相关性距离约束的角点匹配
Corner Matching Based on Edge Correlation Distance Constraints
计算机科学, 2013, 40(5): 283-286.
[8] .
双目视觉测量在乒乓球运动速度分析中的应用

计算机科学, 2008, 35(3): 256-257.
[9] 李方敏 叶澄清 等.
移动环境下支持最小速率保证的端端可靠传输机制

计算机科学, 2001, 28(4): 97-100.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!