Computer Science ›› 2020, Vol. 47 ›› Issue (11A): 281-285.doi: 10.11896/jsjkx.200400049

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Video Fusion Method Based on 3D Scene

NING Ze-xi, QIN Xu-jia, CHEN Jia-zhou   

  1. College of Computer Science and Technology,Zhejiang University of Technology,Hangzhou 310023,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:NING Ze-xi,born in 1995,M.S.candidate.His main research interests include computer graphics and so on.
    QIN Xu-jia,born in 1968,Ph.D,professor,Ph.D candidate supervisor,is a member of China Computer Federation.His main research interests include computer graphics,image processing and data visualization.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61672462) and Natural Science Foundation of Zhejiang Province,China (LY20F020025,LY18F020035).

Abstract: With the continuous progress of science and technology and social development,urban security monitoring system is also constantly improved,how to make full use of the massive monitoring video data has become a hot issue.This paper proposes a method of multi-channel video fusion based on 3D scenes.In this method,multiple video streams from a specified region of a 3D scene are fused into a complete image and projected into the region,thus enhancing the authenticity and effectiveness of the virtual 3D scene.At the same time,aiming at the problem of projection texture mapping,this paper proposes a texture mapping algorithm to solve the problem of occlusion penetration caused by the lack of depth information.By establishing a one-to-one correspondence between the model vertices and the texture coordinates,video frames are projected as textures into 3D scene models.Experimental results show that the proposed method can effectively integrate video and 3D scene models.

Key words: 3D projection, Video fusion, Virtual-reality, Texture mapping

CLC Number: 

  • TP391
[1] TAN G T.Research on Application of Face Detection SystemBased on Video Image[J].Digital Technology and Application,2013(2):89-89.
[2] ZHOU Z H,MENG M,ZHOU Y.Massive Video IntegratedMixed Reality Technology[J].ZTE Communications Technology,2017,23(6):6-9,36.
[3] DEBEVEC P E,TAYLOR C J,MALIK J.Modeling and Rendering Architecture from Photographs:A Hybrid Geometry-andImage-Based Approach[C]//Proceedings of the Annual Conference on ComputerGraphics and Interactive Techniques.USA:ACM,1996:11-20.
[4] SAWHNEY H S,ARPA A,KUMAR R,et al.Video flash-lights:real time rendering of multiple videos for immersive model visualization[C]//Eurographics Workshop on Rendering.Switzerland.ACM Press,2002:157-168.
[5] HU J H.Doctor Degree Dissertation:Intergrating Complementary Information For Photorealistic Representation[D].Los Angeles:University of Southern California,2009.
[6] CHEN S L,CHANG S K,SUN K M,et al.DevelopmentofaMultisensor Embedded Intelligent Home Enviroment Monitoring System Based on Digital Signal Processor and Wi-Fi[J].International Journal of Distributed Sensor Networks,2015,171365:1-11.
[7] ZHOU Y,MENG M,WU W,et al.Virtual-reality Video Fusion System Based on Video Model[J].Journal of System Simulation,2018,30(7):2550-2557.
[8] NIE D K,L W M,ZH J N.Fusion Implementation of VideoMosaic in Three-dimensional Space[J].Computer Programming Skills and Maintenance,2017(12):78-79,87.
[9] YU Y H,TAN C H,ZHOU Z H,et al.Real-time Video WebGIS with Virtual-reality Fusion[J].Journal of System Simulation,2018,30(7):2568-2575.
[10] MA Y Y,ZHAO G,HE B.Design and Implementation of aFused System with 3DGIS and Multiple-Videos[J].Computer Applications and Software,2012,29(6):109-112,117.
[11] ABRAMS A,FRIDRICH N,JACOBS N.Participatory integration of live webcams into GIS[C]//Proceedings of the 1stInternational Conference and Exhibition on Computing for Geospatial Research & Application.ACM,2010:1-8.
[12] LV Z,LI X,ZHANG B,et al.Managing Big City Information Based on WebVRGIS[J].IEEE Access,2016,4(1):407-415.
[13] CHEN S C,LEE C Y,LIN C W,et al.2D and 3D Visualiza-tion with Dual-Resolution for Surveillance[C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.USA:IEEE,2012:23-30.
[14] HANSEN C,WIEFERICH J,RITTER F,et al.Illustrative Visualization of 3D Planning Models for Augmented Reality in Liver Surgery[J].International Journal of Computer Assisted Radiology and Surgery,2010,5(2):133-141.
[1] YANG Yang,XIAO Fei,MENG Kun,ZHAO Xiao-yong. Solution to Render the 2D Timely in the 3D Visual Reality [J]. Computer Science, 2011, 38(6): 279-282.
[2] DONG Liang,LIU Hai,HAN Jun-gang. Design and Simulation of Lighting and Texture Mapping in GPU [J]. Computer Science, 2011, 38(2): 284-287.
[3] WANG Xiang-hai,LI Ting-ting,PANG Xin. Real-time Simulation of Dynamic Cloud Based on Repeating Texture Mapping [J]. Computer Science, 2011, 38(2): 257-259.
[4] ZHAO Na,GUO Li,YUAN Hong-xing. Research on Free Modeling Method Based on Free Hand Sketching [J]. Computer Science, 2010, 37(12): 262-265.
[5] . [J]. Computer Science, 2009, 36(3): 253-255.
[6] LUO Yan,WU Zhong-fu,GUO Xuan-chang. Bamboo Simulation Based on Improvement Fractal Algorithm and Displacement and Texture Mapping [J]. Computer Science, 2009, 36(12): 285-289.
[7] . [J]. Computer Science, 2008, 35(5): 216-219.
[8] . [J]. Computer Science, 2007, 34(6): 235-238.
[9] . [J]. Computer Science, 2007, 34(2): 230-233.
[10] . [J]. Computer Science, 2006, 33(2): 230-233.
Full text



[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75 .
[2] GENG Hai-jun, SHI Xin-gang, WANG Zhi-liang, YIN Xia and YIN Shao-ping. Energy-efficient Intra-domain Routing Algorithm Based on Directed Acyclic Graph[J]. Computer Science, 2018, 45(4): 112 -116 .
[3] WANG Zhen-chao, HOU Huan-huan and LIAN Rui. Path Optimization Scheme for Restraining Degree of Disorder in CMT[J]. Computer Science, 2018, 45(4): 122 -125 .
[4] YANG Yu-qi, ZHANG Guo-an and JIN Xi-long. Dual-cluster-head Routing Protocol Based on Vehicle Density in VANETs[J]. Computer Science, 2018, 45(4): 126 -130 .
[5] HAN Kui-kui, XIE Zai-peng and LV Xin. Fog Computing Task Scheduling Strategy Based on Improved Genetic Algorithm[J]. Computer Science, 2018, 45(4): 137 -142 .
[6] HOU Yan-e, KONG Yun-feng and DANG Lan-xue. Greedy Randomized Adaptive Search Procedure Algorithm Combining Set Partitioning for Heterogeneous School Bus Routing Problems[J]. Computer Science, 2018, 45(4): 240 -246 .
[7] WEI Qin-shuang, WU You-xi, LIU Jing-yu and ZHU Huai-zhong. Distinguishing Sequence Patterns Mining Based on Density and Gap Constraints[J]. Computer Science, 2018, 45(4): 252 -256 .
[8] TONG Ze-ping, LI Tao, LI Li-jie and REN Liang. Study on Collaborative Optimization of Supply Chain with Uncertain Demand and Capacity Constraint[J]. Computer Science, 2018, 45(4): 260 -265 .
[9] LIANG Jun-bin, ZHOU Xiang, WANG Tian and LI Tao-shen. Research Progress on Data Collection in Mobile Low-duty-cycle Wireless Sensor Networks[J]. Computer Science, 2018, 45(4): 19 -24 .
[10] WANG Zhen-wu, LV Xiao-hua and HAN Xiao-hui. Survey of Terrain LOD Technology Based on Quadtree Segmentation[J]. Computer Science, 2018, 45(4): 34 -45 .