Computer Science ›› 2022, Vol. 49 ›› Issue (11A): 211200054-6.doi: 10.11896/jsjkx.211200054

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Multi-camera Calibration Method Based on Large-scale Scene

LIAO De1, ZHANG Hui2, ZHAO Chen-yang1   

  1. 1 College of Electrical and Information Engineering,Changsha University of Science and Technology,Changsha 410114,China
    2 College of Electrical and Information Engineering,Hunan University,Changsha 410012,China
  • Online:2022-11-10 Published:2022-11-21
  • About author:LIAO De,born in 1995,master.His main research interests include image processing,robot control technology,etc.
    ZHANG Hui,born in 1983,Ph.D,professor.His main research interests include machine vision,sparse representation and vision tracking.
  • Supported by:
    National Key R & D Program of China(2018YFB1308200),National Natural Science Foundation of China(61971071,6202780012),Hunan Science Fund for Distinguished Young Scholars(2021JJ10025),Changsha Science and Technology Major Project(kh2003026),Joint Open Foundation of State Key Laboratory of Robotics(2021-KF-22-17) and China University Industry-University-Research Innovation Fund(2020HYA06006).

Abstract: In the field of computer vision,multiple camera sensors need to be used to obtain three-dimensional information of the object so as to achieve a series of measurements such as detection,positioning and size estimation of large target objects.In actual applications,in complex environments,there will be a problem of non-overlapping field of view between the cameras,which prevents effective visual measurement.Therefore,in order to solve the calibration problem of multiple cameras,a multi-camera calibration method with constraints is proposed,without changing the mechanical structure.First,install the cameras in a fixed position,and ensure that there is no vibration between the cameras,by establishing a multi-camera optimization mathematical model and the cameras simultaneously collecting the pose parameter relationships of multiple sets of cameras corresponding to the calibration board,and using the SVRG optimization algorithm to achieve Optimize the pose parameters between the camera coordinate systems,and then obtain the pose matrix between multiple cameras.Finally,the coordinate system transformation matrix between the cameras is used to obtain the relative pose parameters between the corresponding targets as the evaluation accuracy index.And combined with the actual large-scale shield machine to carry out simulation experiment and actual test.The results show that this method has strong anti-interference,stable optimization effect,and can achieve millimeter-level accuracy in practical applications.

Key words: Vision measurement, Camera calibration, Non-overlapping field of view, Shield machine, Pose estimation

CLC Number: 

  • TP391
[1]ZHANG Q,PLESS R.Extrinsic calibration of a camera and laserrange finder(improves camera calibration)[C]//2004 IEEE/RSJ International Conference on Intelligent Robots and Systems(IROS)(IEEE Cat.No.04CH37566).IEEE,2004:2301-2306.
[2]CHEN X,DAVIS J,SLUSALLEK P.Wide area camera calibration using virtual calibration objects[C]//Proceedings IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2000)(Cat.No.PR00662).IEEE,2000:520-527.
[3]HEIKKILA J,SILVÉNO.A four-step camera calibration procedure with implicit image correction[C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.IEEE,1997:1106-1112.
[4]PEREZ A J,PEREZ-CORTES J C,GUARDIOLA J L.Simpleand precise multi-view camera calibration for 3D reconstruction[J].Computers in Industry,2020,123:166-3615.
[5]GAO Z,ZHU M,YU J.A Novel Camera Calibration PatternRobust to Incomplete Pattern Projection[J].IEEE Sensors Journal,2021,21(8):10051-10060.
[6]MENG X,WEI Z Z,ZHANG G J,et al.A flexible technique for calibrating relative position and orientation of two cameras with no-overlapping FOV[J].Measurement,2013,46(1):34-44.
[7]DONG W B,ISLER V.A Novel Method for the Extrinsic Calibration of a 2D Laser Rangefinder and a Camera[J].IEEE Sensors Journal,2018,18(10):4200-4211.
[8]HUO J,LI Y H,YANG M.Multi-camera calibration method based on minimizing the difference of reprojection error vectors[J].Journal of Systems Engineering and Electronics,2018,29(4):844-853.
[9]SHUANG M M.Accurate calibration method of non overlap-ping field of view camera based on spatial constraints[J].Acta Optica Sinica,2019,39(10):237-245.
[10]LI S T.Research on segment assembly robot and vision system of shield machine[D].Guangzhou:South China University of Technology,2018.
[11]TSAI R Y,LENZ R K.A new technique for fully autonomous and efficient 3D robotics hand/eye calibration[J].IEEE Transactions on Robotics and Automation,1989,5(3):345-358.
[12]RIE J,ZHANG T.Accelerating stochastic gradient descentusing predictive variance reduction[J].Advances in Neural Information Processing Systems,2013,26(1):315-323.
[13]BRAGIN M.Convergence of the surrogate Lagrangian relaxa-tion method[J].Journal of Optimization Theory and Applications,2015,164(1):173-201.
[14]DATTORRO J.Convex optimization & Euclidean distance geometry[M]//Springer US,2005.
[15]WANG G G.Simultaneous calibration of multicoordinates for a dual-robot system by solving the AXB=YCZ problem[J].IEEE Transactions on Robotics,2021,37(4):1172-1185.
[16]KANG Y H.Reverse engineering of a Hamiltonian for a three-level system via the Rodrigues’ rotation formula[J].Laser Physics Letters,2016,14(2):025201.
[17]ZHANG Z.A flexible new technique for camera calibration[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2000,22(11):1330-1334.
[1] SHAO Yan-hua, LI Wen-feng, ZHANG Xiao-qiang, CHU Hong-yu, RAO Yun-bo, CHEN Lu. Aerial Violence Recognition Based on Spatial-Temporal Graph Convolutional Networks and Attention Model [J]. Computer Science, 2022, 49(6): 254-261.
[2] MA Wan-yi, ZHANG De-ping. Study on Human Pose Estimation Based on Multiscale Dual Attention [J]. Computer Science, 2022, 49(11A): 220100057-5.
[3] YANG Lian-ping, SUN Yu-bo, ZHANG Hong-liang, LI Feng, ZHANG Xiang-de. Human Keypoint Matching Network Based on Encoding and Decoding Residuals [J]. Computer Science, 2020, 47(6): 114-120.
[4] PEI Jia-zhen, XU Zeng-chun, HU Ping. Person Re -identification Fusing Viewpoint Mechanism and Pose Estimation [J]. Computer Science, 2020, 47(6): 164-169.
[5] FENG Xiao-yue, SONG Jie. Research Advance on 2D Human Pose Estimation [J]. Computer Science, 2020, 47(11): 128-136.
[6] ZHU Shi-xin, YANG Ze-min. Line Tracking and Matching Algorithm Based on Semi-direct Method in Image Sequence [J]. Computer Science, 2019, 46(6A): 270-273.
[7] CUI Jing-chun, WANG Jing. Face Expression Recognition Model Based on Enhanced Head Pose Estimation [J]. Computer Science, 2019, 46(6): 322-327.
[8] SONG Yi-fan, ZHANG Peng, LIU Li-bo. Human-machine Interaction System with Vision-based Gesture Recognition [J]. Computer Science, 2019, 46(11A): 570-574.
[9] ZHANG Guo-liang, WU Yan-xiang, WANG Zhan-ni and WANG Tian. Research on Augmented Reality System Modeling and Registration Error Based on Simple Visual Marker [J]. Computer Science, 2015, 42(6): 299-302.
[10] LI Na, GENG Guo-hua and WANG Xiao-feng. Calibration Method of Using Texture Distribution Features [J]. Computer Science, 2015, 42(12): 288-291.
[11] WANG Hao,LIU Ze-fen,FANG Bao-fu and CHEN Jin-jin. Human Pose Estimation Based on Appearance Model for Constraint Tree Pictorial Structure [J]. Computer Science, 2014, 41(3): 76-79.
[12] WANG Zhi-liang,ZHANG Qiong,CHI Jian-nan,SHI Xue-fei. Camera Calibration Based on Projective Lines [J]. Computer Science, 2011, 38(8): 272-274.
[13] LI Lin-yao,ZHANG Zhao-xiang,WANG Yun-hong,WANG Chao. Motion-based 3D Reconstruction and Applications to Virtual Reality [J]. Computer Science, 2011, 38(7): 273-276.
[14] LIU Chang-hong,YANG Yang,CHEN Yong. Incrementally Learning Human Pose Mapping Model [J]. Computer Science, 2010, 37(3): 268-270.
[15] HAN Jian-dong,YANG Hong-ju. Analysis Method for the Projection Error of Circle Center in 3D Vision Measurement [J]. Computer Science, 2010, 37(12): 247-249.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!