视频流的实时景深延拓算法

doi:10.11896/jsjkx.201100187

计算机科学 ›› 2022, Vol. 49 ›› Issue (6A): 314-318.doi: 10.11896/jsjkx.201100187

• 图像处理&多媒体技术 • 上一篇下一篇

视频流的实时景深延拓算法

来腾飞¹, 周海洋², 余飞鸿¹

1 浙江大学光电科学与工程学院杭州 310027
2 杭州图谱光电科技有限公司杭州 310030

出版日期:2022-06-10 发布日期:2022-06-08
通讯作者: 余飞鸿(feihong@zju.edu.cn)
作者简介:(21860117@zju.edu.cn)

Real-time Extend Depth of Field Algorithm for Video Processing

LAI Teng-fei¹, ZHOU Hai-yang², YU Fei-hong¹

1 College of Optical Science and Engineering,Zhejiang University,Hangzhou 310027,China
2 Hangzhou ToupTek Photonics Co.,Ltd,Hangzhou 310030,China

Online:2022-06-10 Published:2022-06-08
About author:LAI Teng-fei,born in 1995,postgra-duate.His main research interests include image processing and software developing.
YU Fei-hong,born in 1964,Ph.D,professor,Ph.D.His main research in-terests include optical design and image processing.

摘要/Abstract

摘要： 基于图像处理的景深延拓算法(Extend Depth of Field,EDF)指提取聚焦于样本不同区域的图像中的清晰部分,将其融合到一张图像中,使融合图像中样本的各个区域都清晰。文中提出了一种针对视频流的景深延拓算法,首先通过差值图像筛选出被认为是焦面深度发生变化的图像;然后进行配准,减小融合误差;最后使用基于拉普拉斯金字塔的图像融合算法,与前一次的融合图像融合,通过重复这个过程来实现视频流的实时动态景深延拓。以基于空间域的图像融合算法和基于小波变换的图像融合算法为参照,从主观和客观角度比较了视频流场景下的运行效率和融合质量,实验结果表明基于拉普拉斯金字塔的图像融合算法具有较好的运算效率,而且对输入图像中存在离焦模糊的情况具有鲁棒性。

关键词: 景深延拓, 拉普拉斯金字塔, 离散小波变换, 图像处理, 图像融合

Abstract: The extend depth of field algorithm(EDF) refers to extracting the clear parts of the image focusing on different areas of the sample and fusing them into an image to make each area of the sample in the fused image clear.The article proposes aEDF algorithm for video.First,the difference image is used to filter out the images that are considered to be the key frame whose focal depth changes.Then image registration is used to reduce the fusion error.Finally,the Laplacian pyramid based fusion algorithm is used to fuse the frame and previous fusion result and generate new EDF result.By repeating this process,the real-time dynamic EDF of the video is realized.The article designs experiments,using the spatial domain-based and the wavelet transform-based image fusion algorithm as a reference,comparing the operating efficiency and fusion quality in the scene of video from subjective and objective perspectives,and proves that the algorithm based on the Laplacian pyramid has good real-time performance,and is robust to out-of-focus blurred image.

Key words: Discrete wavelet transform, Extend depth of field, Image fusion, Image processing, Laplacian pyramid

中图分类号:

TP751.1

来腾飞, 周海洋, 余飞鸿. 视频流的实时景深延拓算法[J]. 计算机科学, 2022, 49(6A): 314-318. https://doi.org/10.11896/jsjkx.201100187

LAI Teng-fei, ZHOU Hai-yang, YU Fei-hong. Real-time Extend Depth of Field Algorithm for Video Processing[J]. Computer Science, 2022, 49(6A): 314-318. https://doi.org/10.11896/jsjkx.201100187

参考文献

[1] BURT P J,ADELSON E H.The Laplacian Pyramid as a Compact Image Code[J].IEEE Transactions on Communications,1983,31(4):671-679.
[2] LI H,MANJUNATH B S,MITRA S K.Multisensor Image Fusion Using the Wavelet Transform[J].Graphical Models and Image Processing,1995,57(3):235-245.
[3] ZHANG Q,GUO B L.Multifocus image fusion using the nonsubsampled contourlet transform[J].Signal Processing,2009,89(7):1334-1346.
[4] DA CUNHA A L,ZHOU J,DO M N.The nonsubsampled con-tourlet transform:theory,design,and applications[J].IEEE Transactions on Image Processing,2006,15(10):3089-3101.
[5] LI S,KANG X,HU J.Image fusion with guided filtering[J].IEEE Trans Image Process,2013,22(7):2864-2875.
[6] PERTUZ S,PUIG D,GARCIA M A,et al.Generation of all-in-focus images by noise-robust selective fusion of limited depth-of-field images[J].IEEE Transactions on Image Processing,2013,22(3):1242-1251.
[7] ZHIGUO J,DONGBING H,JIN C,et al.A wavelet based algorithm for multi-focus micro-image fusion [C]//Proceedings of the International Conference on Image and Graphics.2004.
[8] HOSSNY M,NAHAVANDI S,CREIGHTON D.Comments on ‘Information measure for performance of image fusion'[J].Electronics Letters,2008,44(18):1066-1067.

相关文章 15

[1]	郭拯危, 付泽文, 李宁, 白澜. 高分辨率斜视聚束SAR回波仿真加速算法研究 Study on Acceleration Algorithm for Raw Data Simulation of High Resolution Squint Spotlight SAR 计算机科学, 2022, 49(8): 178-183. https://doi.org/10.11896/jsjkx.210600066
[2]	赵明华, 周童童, 都双丽, 石争浩. 基于虚拟曝光方法的单幅逆光图像增强 Single Backlit Image Enhancement Based on Virtual Exposure Method 计算机科学, 2022, 49(6A): 384-389. https://doi.org/10.11896/jsjkx.210400243
[3]	孙洁琪, 李亚峰, 张文博, 刘鹏辉. 基于离散小波变换的双域特征融合深度卷积神经网络 Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation 计算机科学, 2022, 49(6A): 434-440. https://doi.org/10.11896/jsjkx.210900199
[4]	刘伟业, 鲁慧民, 李玉鹏, 马宁. 指静脉识别技术研究综述 Survey on Finger Vein Recognition Research 计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056
[5]	高元浩, 罗晓清, 张战成. 基于特征分离的红外与可见光图像融合算法 Infrared and Visible Image Fusion Based on Feature Separation 计算机科学, 2022, 49(5): 58-63. https://doi.org/10.11896/jsjkx.210200148
[6]	颜敏, 罗晓清, 张战成. 基于光传输模型学习的红外和可见光图像融合网络设计 Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning 计算机科学, 2022, 49(4): 215-220. https://doi.org/10.11896/jsjkx.210200174
[7]	官铮, 邓扬琳, 聂仁灿. 光谱重建约束非负矩阵分解的高光谱与全色图像融合 Non-negative Matrix Factorization Based on Spectral Reconstruction Constraint for Hyperspectral and Panchromatic Image Fusion 计算机科学, 2021, 48(9): 153-159. https://doi.org/10.11896/jsjkx.200900054
[8]	黄晓生, 徐静. 基于PCANet的非下采样剪切波域多聚焦图像融合 Multi-focus Image Fusion Method Based on PCANet in NSST Domain 计算机科学, 2021, 48(9): 181-186. https://doi.org/10.11896/jsjkx.200800064
[9]	田嵩旺, 蔺素珍, 杨博. 基于多判别器的多波段图像自监督融合方法 Multi-band Image Self-supervised Fusion Method Based on Multi-discriminator 计算机科学, 2021, 48(8): 185-190. https://doi.org/10.11896/jsjkx.200600132
[10]	詹瑞, 雷印杰, 陈训敏, 叶书函. 基于多重差异特征网络的街景变化检测 Street Scene Change Detection Based on Multiple Difference Features Network 计算机科学, 2021, 48(2): 142-147. https://doi.org/10.11896/jsjkx.200500158
[11]	王丽芳, 王蕊芳, 蔺素珍, 秦品乐, 高媛, 张晋. 基于双残差超密集网络的多模态医学图像融合 Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks 计算机科学, 2021, 48(2): 160-166. https://doi.org/10.11896/jsjkx.200400095
[12]	张育龙, 王强, 陈明康, 孙静涛. 图像去雨算法在云物联网应用中的研究综述 Survey of Intelligent Rain Removal Algorithms for Cloud-IoT Systems 计算机科学, 2021, 48(12): 231-242. https://doi.org/10.11896/jsjkx.201000055
[13]	姚楠, 张征. 基于三维图像的疤痕面积计算 Scar Area Calculation Based on 3D Image 计算机科学, 2021, 48(11A): 308-313. https://doi.org/10.11896/jsjkx.201100044
[14]	冯一凡, 赵雪青, 师昕, 杨坤. 基于光照叠加的颜色恒常计算方法 Light Superposition-based Color Constancy Computational Method 计算机科学, 2021, 48(11A): 386-390. https://doi.org/10.11896/jsjkx.210200053
[15]	宋一言, 唐东林, 吴续龙, 周立, 秦北轩. 改进穿线法与HOG+SVM结合的数码管图像读数研究 Study on Digital Tube Image Reading Combining Improved Threading Method with HOG+SVM Method 计算机科学, 2021, 48(11A): 396-399. https://doi.org/10.11896/jsjkx.210100123

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

视频流的实时景深延拓算法

Real-time Extend Depth of Field Algorithm for Video Processing

PDF (PC)

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

Metrics

本文评价

推荐阅读 0