基于图像变形融合时空滤波的视频细微运动增强算法

计算机科学 ›› 2015, Vol. 42 ›› Issue (Z6): 175-179.

基于图像变形融合时空滤波的视频细微运动增强算法

张军,戴霞

江南大学数字媒体学院无锡214122,西华大学数学与计算机学院成都610039

出版日期:2018-11-14 发布日期:2018-11-14
基金资助:
本文受江苏省自然科学基金(BK20130158,BK20141113)资助

Subtle Video Motion Magnification by Spatial-temporal Filtering and Image Warping

ZHANG Jun and DAI Xia

Online:2018-11-14 Published:2018-11-14

摘要/Abstract

摘要： 提出一种基于图像几何变形的视频细微运动增强算法,该算法可在不放大图像噪声的前提下,揭示视频中人眼无法察觉的细微运动信息。其融合了Eulerian和Lagrangian对运动目标描述的形式,以Eulerian视频增强算法(Eulerian Video Magnification,EVM)作为时-空滤波器,通过逐帧检测视频中像素级运动信息建立运动映射图,再根据该运动映射图以Lagrangian的形式计算几何变形网格。最后,使用变形网格对原始输入视频的每一帧图像进行几何变形,放大视频中细微运动目标的运动幅度。实验结果表明,提出的视频运动增强算法能显著降低图像噪声对输出视频画面质量的影响,其视频数据处理管线具备较高的可扩展性,适合于引入先进图像预处理和网格以进一步提高输出视频画面的质量。

Abstract: An image warping based video motion magnification method was introduced to reveal subtle motion in the input video that are difficult or impossible to see with the naked eye.The main advantage of the presented method is that it amplifies the video motion without increasing the frame noise.The proposed method fuses the approaches of Eulerian and Lagrangian to calculate the motion.The Eulerian video magnification method is used as a spatial-temporal motion analyzer to get pixel-level motion mapping of each frames in the input video.Then each frame of the input video is warped based on this mapping to amplify the input video motion.Experiments show that the presented method is signi-ficantly less sensitive to noise and its data processing pipeline is high scalable for introducing advanced image pre-processing filters or mesh post-processing algorithms to further improve the visual quality of the output video.

Key words: Motion magnification,Eulerian motion,Spatial-temporal filter,Image warping,Edge-preserving image filtering

张军,戴霞. 基于图像变形融合时空滤波的视频细微运动增强算法[J]. 计算机科学, 2015, 42(Z6): 175-179. https://doi.org/

ZHANG Jun and DAI Xia. Subtle Video Motion Magnification by Spatial-temporal Filtering and Image Warping[J]. Computer Science, 2015, 42(Z6): 175-179. https://doi.org/

参考文献

[1] Liu C,Torralba A,Freeman W T,et al.Motion Magnification [J].ACM Transactions on Graphics,2005,24(7):519-526
[2] Gautama T,Van Hulle M M.A Phase-Based Approach to theEstimation of the Optical Flow Field Using Spatial Filtering [J].IEEE Transactions on Neural Networks,2002,13(5):1127-1136
[3] Rubinstein M,Liu C,Sand P,et al.Motion De-noising with Application to Time-lapse Photography[C]∥IEEE Computer Vision and Pattern Recognition.Colorado Springs,USA:IEEE Computer Society,2011:313-320
[4] Freeman W T,Adelson E H,Heeger D J.Motion WithoutMovement [J].Computer Graphics,1991,25(4):27-30
[5] Fuchs M,Tongbochen,Wangc O,et al.Real-time temporal shaping of high-speed video streams [J].Computer and Graphics,2010,34(5):575-584
[6] Wu H,Rubinstein M,Shih E,et al.Eulerian Video Magnifica-tion for Revealing Subtle Changes in the World [J].ACM Trans-actions on Graphics,2012,31(4):65
[7] Wadhwa N,Rubinstein M,Durand F,et al.Phase-Based VideoMotion Processing [J].ACM Transactions on Graphics,2013,32(4):80
[8] Bai J,Agarwala A,Agrawala M,et al.Selectively De-Animating Video [J].ACM Transactions on Graphics,2012,31(4):66
[9] Liu F,Niu Y,Jin H.Joint Subspace Stabilization for Stereoscopic Video[C]∥ IEEE International Conference on Computer Vision.Sydney,Australia:IEEE Computer Society,2013:73-80
[10] Liu F,Gleicher M,Wang J,et al.Subspace Video Stabilization [J].ACM Transactions on Graphics,2011,30(1):4
[11] 李新仕,王天江,刘芳.基于高斯混合模型的视频运动对象自动分割算法[J].计算机科学,2009,36(1):205-207
[12] 甘新标,沈立,王志英.基于CUDA的并行全搜索运动估计算法[J].计算机辅助设计与图形学学报,2010,22(3):457-460
[13] 全红艳.利用特征向量聚类的流体运动矢量计算[J].计算机辅助设计与图形学学报,2013,25(2):222-228
[14] 戴霞,李辉,等.基于虚拟图像金字塔序列融合的快速图像增强算法[J].计算机学报,2014,37(3):602-609

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed