Computer Science ›› 2020, Vol. 47 ›› Issue (11A): 175-177.doi: 10.11896/jsjkx.200400096

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Study on Reconstruction of Indoor 3D Scene Based on Binocular Vision

CHEN Ying, ZHAO Lai-wang, ZHAN Hong-chen, DING Yao   

  1. Jinling College,Nanjing University,Nanjing 210089,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:CHEN Ying,born in 1999,undergra-duate.Her main research interests include digital image processing and computer vision.
    DING Yao,born in 1981,senior engineer,is a member of China Computer Federation.His main research interests include digital image processing,computer vision and machine learning.
  • Supported by:
    This work was supported by the Natural Science Foundation of the Higher Education Institutions of Jiangsu Province,China(BK20151299).

Abstract: In the early three-dimensional scene reconstruction,due to hardware constraints,it can not be very good for the three-dimensional reconstruction of the scene.With the hardware update iteration,at present,the structured light and dual vision system is used for for more efficient three-dimensional scene reconstruction.The hardware platform is built with zed binocular ca-mera and jabao Ad-10 electric cloud platform,and the point cloud information of the scene is obtained through binocular camera.Based on the stereo matching of the global sbgm (semi global block matching) algorithm and the red green blue depth map generation,the single scene cloud reconstruction is carried out,and through the orb feature matching and ICP (iterative closure Point) point cloud registration and fusion can realize panoramic 3D reconstruction of indoor scene.The experiment compares the advantages of binocular stereo vision scene reconstruction in far/near targets,low texture feature targets,glass and other material targets.At the same time,in the three-dimensional scene reconstruction of point cloud,this paper proposes to optimize the point cloud information through sparseness,and compares the reconstruction effect of single acquisition and multiple acquisition.After the experiment,the system can give consideration to the details of scene reconstruction and the display effect under the premise of the eclectic number of times,and it can be used for reference and application value for 3D reconstruction of different scene targets.

Key words: 3D scene reconstruction, Binocular vision, ICP, Panoramic scene reconstruction, PCL

CLC Number: 

  • TP391
[1] HENRY P,KRAININ M,HERBST E,et al.RGB-D mapping:Using Kinect-style depth cameras for dense 3D modeling of indoor environments[J].The International Journal of Robotics Research,2012,31(5):647-663.
[2] HUANG Y,HUANG J,XIAO C S,et al.Research on ShipTrajectory Tracking Algorithm based on Binocular stereo Vision [J].Computer Science,2017(1):308-313.
[3] YU J W,WEI C.Indoor Mobile Measurement System based on SLAM and its application [J].Bulletin of Surveying and Mapping,2016(6):146-147.
[4] IZADI S,KIM D,HILLIGES O,et al.Kinect Fusion:real-time 3D reconstruction and interaction using a moving depth camera[C]//Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology.ACM,2011:559-568.
[5] ZHANG C,LI Z,CHENG Y,et al.Meshstereo:A global stereo model with mesh alignment regularization for view interpolation[C]//Proceedings of the IEEE International Conference on Computer Vision.2015:2057-2065.
[6] MIAO H C,WANG J H,ZHANG Q Y.Concave-convex Manufacturing Feature Recognition based on single view 3D Reconstruction [J].Computer Science,2019(7):280-285.
[7] HU Z Y,WU F C.Calibration method based on active visioncamera[J].Journal of Computer Science,2002,25(11):1149-1156.
[8] ZHOU S P,GENG G H,LI K,et al.A multi-view geometric 3D reconstruction method based on AKAZE Algorithm [J].Computer Science,2018(S2):180-184,207.
[9] ZHAO F Q,JIA Y T.Point Cloud Registration Method based on Geometric Attributes and improved ICP [J].Information Technology,2019(4):33-38.
[1] CHANG Zi-ting, SHI Yu-qing, WANG Jun, YU Ming-he, YAO Lan, ZHAO Zhi-bin. Vehicle Speed Measurement Method Based on Binocular Vision [J]. Computer Science, 2021, 48(9): 135-139.
[2] ZHAO Zi-yang, JIANG Mu-rong, HUANG Ya-qun, HAO Jian-yu, ZENG Ke. Single Image Depth Estimation Algorithm Based on SFS and Binocular Model [J]. Computer Science, 2019, 46(6A): 161-164.
[3] LI Yin-guo, ZHOU Zhong-kui, BAI Ling. Large-scale Automatic Driving Scene Reconstruction Based on Binocular Image [J]. Computer Science, 2019, 46(11A): 251-254.
[4] LI Xiu-juan, LIU Wei and LI Shan-hong. Robust Control Algorithm of Bionic Robot Based on Binocular Vision Navigation [J]. Computer Science, 2017, 44(8): 318-321.
[5] ZHOU Juan. Face Recognition Based on Sampled 3D Points Clouds [J]. Computer Science, 2014, 41(Z6): 147-149.
[6] WANG Wan-liang,JIN Yi-ting,ZHAO Yan-wei and ZHENG Jian-wei. Corner Matching Based on Edge Correlation Distance Constraints [J]. Computer Science, 2013, 40(5): 283-286.
[7] . [J]. Computer Science, 2009, 36(1): 148-152.
[8] . [J]. Computer Science, 2008, 35(3): 256-257.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!