Computer Science

Computer Science ›› 2022, Vol. 49 ›› Issue (6A): 314-318.doi: 10.11896/jsjkx.201100187

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Real-time Extend Depth of Field Algorithm for Video Processing

LAI Teng-fei1, ZHOU Hai-yang2, YU Fei-hong1   

  1. 1 College of Optical Science and Engineering,Zhejiang University,Hangzhou 310027,China
    2 Hangzhou ToupTek Photonics Co.,Ltd,Hangzhou 310030,China
  • Online:2022-06-10 Published:2022-06-08
  • About author:LAI Teng-fei,born in 1995,postgra-duate.His main research interests include image processing and software developing.
    YU Fei-hong,born in 1964,Ph.D,professor,Ph.D.His main research in-terests include optical design and image processing.

PDF (PC)

540

Abstract: The extend depth of field algorithm(EDF) refers to extracting the clear parts of the image focusing on different areas of the sample and fusing them into an image to make each area of the sample in the fused image clear.The article proposes aEDF algorithm for video.First,the difference image is used to filter out the images that are considered to be the key frame whose focal depth changes.Then image registration is used to reduce the fusion error.Finally,the Laplacian pyramid based fusion algorithm is used to fuse the frame and previous fusion result and generate new EDF result.By repeating this process,the real-time dynamic EDF of the video is realized.The article designs experiments,using the spatial domain-based and the wavelet transform-based image fusion algorithm as a reference,comparing the operating efficiency and fusion quality in the scene of video from subjective and objective perspectives,and proves that the algorithm based on the Laplacian pyramid has good real-time performance,and is robust to out-of-focus blurred image.

Key words: Discrete wavelet transform, Extend depth of field, Image fusion, Image processing, Laplacian pyramid

CLC Number: 

  • TP751.1
[1] BURT P J,ADELSON E H.The Laplacian Pyramid as a Compact Image Code[J].IEEE Transactions on Communications,1983,31(4):671-679.
[2] LI H,MANJUNATH B S,MITRA S K.Multisensor Image Fusion Using the Wavelet Transform[J].Graphical Models and Image Processing,1995,57(3):235-245.
[3] ZHANG Q,GUO B L.Multifocus image fusion using the nonsubsampled contourlet transform[J].Signal Processing,2009,89(7):1334-1346.
[4] DA CUNHA A L,ZHOU J,DO M N.The nonsubsampled con-tourlet transform:theory,design,and applications[J].IEEE Transactions on Image Processing,2006,15(10):3089-3101.
[5] LI S,KANG X,HU J.Image fusion with guided filtering[J].IEEE Trans Image Process,2013,22(7):2864-2875.
[6] PERTUZ S,PUIG D,GARCIA M A,et al.Generation of all-in-focus images by noise-robust selective fusion of limited depth-of-field images[J].IEEE Transactions on Image Processing,2013,22(3):1242-1251.
[7] ZHIGUO J,DONGBING H,JIN C,et al.A wavelet based algorithm for multi-focus micro-image fusion [C]//Proceedings of the International Conference on Image and Graphics.2004.
[8] HOSSNY M,NAHAVANDI S,CREIGHTON D.Comments on ‘Information measure for performance of image fusion'[J].Electronics Letters,2008,44(18):1066-1067.
[1] ZHAO Ming-hua, ZHOU Tong-tong, DU Shuang-li, SHI Zheng-hao. Single Backlit Image Enhancement Based on Virtual Exposure Method [J]. Computer Science, 2022, 49(6A): 384-389.
[2] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[3] LIU Wei-ye, LU Hui-min, LI Yu-peng, MA Ning. Survey on Finger Vein Recognition Research [J]. Computer Science, 2022, 49(6A): 1-11.
[4] GAO Yuan-hao, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Based on Feature Separation [J]. Computer Science, 2022, 49(5): 58-63.
[5] YAN Min, LUO Xiao-qing, ZHANG Zhan-cheng. Infrared and Visible Image Fusion Network Based on Optical Transmission Model Learning [J]. Computer Science, 2022, 49(4): 215-220.
[6] GUAN Zheng, DENG Yang-lin, NIE Ren-can. Non-negative Matrix Factorization Based on Spectral Reconstruction Constraint for Hyperspectral and Panchromatic Image Fusion [J]. Computer Science, 2021, 48(9): 153-159.
[7] HUANG Xiao-sheng, XU Jing. Multi-focus Image Fusion Method Based on PCANet in NSST Domain [J]. Computer Science, 2021, 48(9): 181-186.
[8] TIAN Song-wang, LIN Su-zhen, YANG Bo. Multi-band Image Self-supervised Fusion Method Based on Multi-discriminator [J]. Computer Science, 2021, 48(8): 185-190.
[9] ZHAN Rui, LEI Yin-jie, CHEN Xun-min, YE Shu-han. Street Scene Change Detection Based on Multiple Difference Features Network [J]. Computer Science, 2021, 48(2): 142-147.
[10] WANG Li-fang, WANG Rui-fang, LIN Su-zhen, QIN Pin-le, GAO Yuan, ZHANG Jin. Multimodal Medical Image Fusion Based on Dual Residual Hyper Densely Networks [J]. Computer Science, 2021, 48(2): 160-166.
[11] ZHANG Yu-long, WANG Qiang, CHEN Ming-kang, SUN Jing-tao. Survey of Intelligent Rain Removal Algorithms for Cloud-IoT Systems [J]. Computer Science, 2021, 48(12): 231-242.
[12] YAO Nan, ZHANG Zheng. Scar Area Calculation Based on 3D Image [J]. Computer Science, 2021, 48(11A): 308-313.
[13] FENG Yi-fan, ZHAO Xue-qing, SHI Xin, YANG Kun. Light Superposition-based Color Constancy Computational Method [J]. Computer Science, 2021, 48(11A): 386-390.
[14] SONG Yi-yan, TANG Dong-lin, WU Xu-long, ZHOU Li, QIN Bei-xuan. Study on Digital Tube Image Reading Combining Improved Threading Method with HOG+SVM Method [J]. Computer Science, 2021, 48(11A): 396-399.
[15] XIE Hai-ping, LI Gao-yuan, YANG Hai-tao, ZHAO Hong-li. Classification Research of Remote Sensing Image Based on Super Resolution Reconstruction [J]. Computer Science, 2021, 48(11A): 424-428.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.