计算机科学 ›› 2020, Vol. 47 ›› Issue (11A): 281-285.doi: 10.11896/jsjkx.200400049

• 计算机图形学&多媒体 • 上一篇    下一篇

基于三维场景的视频融合方法

宁泽西, 秦绪佳, 陈佳舟   

  1. 浙江工业大学计算机科学与技术学院 杭州 310023
  • 出版日期:2020-11-15 发布日期:2020-11-17
  • 通讯作者: 秦绪佳 (qxj@zjut.edu.cn)
  • 作者简介:1652754015@qq.com
  • 基金资助:
    国家自然科学基金(61672462);浙江省自然科学基金(LY20F020025,LY18F020035)

Video Fusion Method Based on 3D Scene

NING Ze-xi, QIN Xu-jia, CHEN Jia-zhou   

  1. College of Computer Science and Technology,Zhejiang University of Technology,Hangzhou 310023,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:NING Ze-xi,born in 1995,M.S.candidate.His main research interests include computer graphics and so on.
    QIN Xu-jia,born in 1968,Ph.D,professor,Ph.D candidate supervisor,is a member of China Computer Federation.His main research interests include computer graphics,image processing and data visualization.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61672462) and Natural Science Foundation of Zhejiang Province,China (LY20F020025,LY18F020035).

摘要: 随着科学技术与社会发展的不断进步,城市安防监控系统也不断完善,如何充分利用海量监控视频数据已经成为一个热点问题。文中提出一种基于三维场景多路视频融合的方法,该方法将三维场景指定区域的多个视频流融合成一个完整的图像并投影至该区域,从而增强虚拟三维场景的真实性和有效性。同时针对投影纹理映射问题,文中提出了一种纹理映射算法,用于解决缺少深度信息导致的遮挡穿透问题。通过将模型顶点与纹理坐标一一对应,将视频帧当做纹理投影到三维场景模型中。实验结果表明,所提方法可实现视频与三维场景模型的有效融合。

关键词: 三维投影, 视频融合, 纹理映射, 虚拟现实

Abstract: With the continuous progress of science and technology and social development,urban security monitoring system is also constantly improved,how to make full use of the massive monitoring video data has become a hot issue.This paper proposes a method of multi-channel video fusion based on 3D scenes.In this method,multiple video streams from a specified region of a 3D scene are fused into a complete image and projected into the region,thus enhancing the authenticity and effectiveness of the virtual 3D scene.At the same time,aiming at the problem of projection texture mapping,this paper proposes a texture mapping algorithm to solve the problem of occlusion penetration caused by the lack of depth information.By establishing a one-to-one correspondence between the model vertices and the texture coordinates,video frames are projected as textures into 3D scene models.Experimental results show that the proposed method can effectively integrate video and 3D scene models.

Key words: 3D projection, Texture mapping, Video fusion, Virtual-reality

中图分类号: 

  • TP391
[1] TAN G T.Research on Application of Face Detection SystemBased on Video Image[J].Digital Technology and Application,2013(2):89-89.
[2] ZHOU Z H,MENG M,ZHOU Y.Massive Video IntegratedMixed Reality Technology[J].ZTE Communications Technology,2017,23(6):6-9,36.
[3] DEBEVEC P E,TAYLOR C J,MALIK J.Modeling and Rendering Architecture from Photographs:A Hybrid Geometry-andImage-Based Approach[C]//Proceedings of the Annual Conference on ComputerGraphics and Interactive Techniques.USA:ACM,1996:11-20.
[4] SAWHNEY H S,ARPA A,KUMAR R,et al.Video flash-lights:real time rendering of multiple videos for immersive model visualization[C]//Eurographics Workshop on Rendering.Switzerland.ACM Press,2002:157-168.
[5] HU J H.Doctor Degree Dissertation:Intergrating Complementary Information For Photorealistic Representation[D].Los Angeles:University of Southern California,2009.
[6] CHEN S L,CHANG S K,SUN K M,et al.DevelopmentofaMultisensor Embedded Intelligent Home Enviroment Monitoring System Based on Digital Signal Processor and Wi-Fi[J].International Journal of Distributed Sensor Networks,2015,171365:1-11.
[7] ZHOU Y,MENG M,WU W,et al.Virtual-reality Video Fusion System Based on Video Model[J].Journal of System Simulation,2018,30(7):2550-2557.
[8] NIE D K,L W M,ZH J N.Fusion Implementation of VideoMosaic in Three-dimensional Space[J].Computer Programming Skills and Maintenance,2017(12):78-79,87.
[9] YU Y H,TAN C H,ZHOU Z H,et al.Real-time Video WebGIS with Virtual-reality Fusion[J].Journal of System Simulation,2018,30(7):2568-2575.
[10] MA Y Y,ZHAO G,HE B.Design and Implementation of aFused System with 3DGIS and Multiple-Videos[J].Computer Applications and Software,2012,29(6):109-112,117.
[11] ABRAMS A,FRIDRICH N,JACOBS N.Participatory integration of live webcams into GIS[C]//Proceedings of the 1stInternational Conference and Exhibition on Computing for Geospatial Research & Application.ACM,2010:1-8.
[12] LV Z,LI X,ZHANG B,et al.Managing Big City Information Based on WebVRGIS[J].IEEE Access,2016,4(1):407-415.
[13] CHEN S C,LEE C Y,LIN C W,et al.2D and 3D Visualiza-tion with Dual-Resolution for Surveillance[C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.USA:IEEE,2012:23-30.
[14] HANSEN C,WIEFERICH J,RITTER F,et al.Illustrative Visualization of 3D Planning Models for Augmented Reality in Liver Surgery[J].International Journal of Computer Assisted Radiology and Surgery,2010,5(2):133-141.
[1] 曲倩文, 车啸平, 曲晨鑫, 李瑾如.
基于信息感知的虚拟现实用户临场感研究
Study on Information Perception Based User Presence in Virtual Reality
计算机科学, 2022, 49(9): 146-154. https://doi.org/10.11896/jsjkx.220500200
[2] 刘月红, 牛少华, 神显豪.
基于卷积神经网络的虚拟现实视频帧内预测编码
Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network
计算机科学, 2022, 49(7): 127-131. https://doi.org/10.11896/jsjkx.211100179
[3] 张继凯, 李琦, 王月明, 吕晓琪.
基于单目RGB图像的三维手势跟踪算法综述
Survey of 3D Gesture Tracking Algorithms Based on Monocular RGB Images
计算机科学, 2022, 49(4): 174-187. https://doi.org/10.11896/jsjkx.210700084
[4] 朱晨爽, 程时伟.
虚拟现实环境下基于眼动跟踪的导航需求预测与辅助
Prediction and Assistance of Navigation Demand Based on Eye Tracking in Virtual Reality Environment
计算机科学, 2021, 48(8): 315-321. https://doi.org/10.11896/jsjkx.200500031
[5] 马思琪, 车啸平, 于淇, 岳晨峰.
基于事件的虚拟现实用户体验评估方法研究
Event-based User Experience Evaluation Method for Virtual Reality Applications
计算机科学, 2021, 48(2): 167-174. https://doi.org/10.11896/jsjkx.200100065
[6] 张宇翔, 任爽.
定位技术在虚拟现实中的应用综述
Overview of Application of Positioning Technology in Virtual Reality
计算机科学, 2021, 48(1): 308-318. https://doi.org/10.11896/jsjkx.200800010
[7] 张政霖,张利伟,王文娟,夏莉,符豪,王宏志,杨立状,李海.
计算机化神经认知评估系统研究综述
Survey on Computerized Neurocognitive Assessment System
计算机科学, 2020, 47(2): 150-156. https://doi.org/10.11896/jsjkx.190100150
[8] 姬莉霞,刘成明.
基于虚拟现实技术的模糊静态图像目标重现方法
Fuzzy Static Image Target Reproduction Method Based on Virtual Reality Technology
计算机科学, 2018, 45(7): 248-251. https://doi.org/10.11896/j.issn.1002-137X.2018.07.043
[9] 张宁, 刘迎春, 沈智鹏, 郭晨.
虚拟现实技术在专门用途英语教学中的应用研究综述
Review of Virtual Reality Technology Based Application Research in English Teaching for Special Purposes
计算机科学, 2017, 44(Z6): 43-47. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.009
[10] 潘仁宇,孙长乐,熊伟,王海涛.
虚拟装配环境中碰撞检测算法的研究综述与展望
Survey and Prospect of Collision Detection Based on Virtual Assembly Environment
计算机科学, 2016, 43(Z11): 136-139. https://doi.org/10.11896/j.issn.1002-137X.2016.11A.029
[11] 黄地龙,邓飞,唐云.
虚拟现实技术在隧道开挖工程中的应用
Application of Virtual Reality Technique in Tunnel Excavation Engineering
计算机科学, 2013, 40(Z6): 377-380.
[12] 李代伟,孙建顺.
爆炸装置排除视景仿真系统的设计与实现
Design and Implementation of Explosive Devices Exclude Virtual Simulation Training System
计算机科学, 2013, 40(9): 302-306.
[13] 曹建军,刁兴春,张慧,谭明超,邓波.
信息系统模拟数据生成研究综述
Simulated Data Generation for Information System: A Survey
计算机科学, 2012, 39(Z6): 322-324.
[14] 刘小丹,佟鹏.
随意图像纹理映射的补偿方法
Compensation Method for Texture Mapping Using Casual Images
计算机科学, 2012, 39(11): 291-293.
[15] 黄宁宁,曹存根.
一种支持多种运动方式的三维虚拟角色路径规划和姿态调整方法
Motion Path Planning Method for 3D Virtual Characters with Different Motion Modes
计算机科学, 2012, 39(1): 268-272.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!