Computer Science ›› 2015, Vol. 42 ›› Issue (Z6): 175-179.

Previous Articles     Next Articles

Subtle Video Motion Magnification by Spatial-temporal Filtering and Image Warping

ZHANG Jun and DAI Xia   

  • Online:2018-11-14 Published:2018-11-14

Abstract: An image warping based video motion magnification method was introduced to reveal subtle motion in the input video that are difficult or impossible to see with the naked eye.The main advantage of the presented method is that it amplifies the video motion without increasing the frame noise.The proposed method fuses the approaches of Eulerian and Lagrangian to calculate the motion.The Eulerian video magnification method is used as a spatial-temporal motion analyzer to get pixel-level motion mapping of each frames in the input video.Then each frame of the input video is warped based on this mapping to amplify the input video motion.Experiments show that the presented method is signi-ficantly less sensitive to noise and its data processing pipeline is high scalable for introducing advanced image pre-processing filters or mesh post-processing algorithms to further improve the visual quality of the output video.

Key words: Motion magnification,Eulerian motion,Spatial-temporal filter,Image warping,Edge-preserving image filtering

[1] Liu C,Torralba A,Freeman W T,et al.Motion Magnification [J].ACM Transactions on Graphics,2005,24(7):519-526
[2] Gautama T,Van Hulle M M.A Phase-Based Approach to theEstimation of the Optical Flow Field Using Spatial Filtering [J].IEEE Transactions on Neural Networks,2002,13(5):1127-1136
[3] Rubinstein M,Liu C,Sand P,et al.Motion De-noising with Application to Time-lapse Photography[C]∥IEEE Computer Vision and Pattern Recognition.Colorado Springs,USA:IEEE Computer Society,2011:313-320
[4] Freeman W T,Adelson E H,Heeger D J.Motion WithoutMovement [J].Computer Graphics,1991,25(4):27-30
[5] Fuchs M,Tongbochen,Wangc O,et al.Real-time temporal shaping of high-speed video streams [J].Computer and Graphics,2010,34(5):575-584
[6] Wu H,Rubinstein M,Shih E,et al.Eulerian Video Magnifica-tion for Revealing Subtle Changes in the World [J].ACM Trans-actions on Graphics,2012,31(4):65
[7] Wadhwa N,Rubinstein M,Durand F,et al.Phase-Based VideoMotion Processing [J].ACM Transactions on Graphics,2013,32(4):80
[8] Bai J,Agarwala A,Agrawala M,et al.Selectively De-Animating Video [J].ACM Transactions on Graphics,2012,31(4):66
[9] Liu F,Niu Y,Jin H.Joint Subspace Stabilization for Stereoscopic Video[C]∥ IEEE International Conference on Computer Vision.Sydney,Australia:IEEE Computer Society,2013:73-80
[10] Liu F,Gleicher M,Wang J,et al.Subspace Video Stabilization [J].ACM Transactions on Graphics,2011,30(1):4
[11] 李新仕,王天江,刘芳.基于高斯混合模型的视频运动对象自动分割算法[J].计算机科学,2009,36(1):205-207
[12] 甘新标,沈立,王志英.基于CUDA的并行全搜索运动估计算法[J].计算机辅助设计与图形学学报,2010,22(3):457-460
[13] 全红艳.利用特征向量聚类的流体运动矢量计算[J].计算机辅助设计与图形学学报,2013,25(2):222-228
[14] 戴霞,李辉,等.基于虚拟图像金字塔序列融合的快速图像增强算法[J].计算机学报,2014,37(3):602-609

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!