计算机科学 ›› 2016, Vol. 43 ›› Issue (Z6): 171-174.doi: 10.11896/j.issn.1002-137X.2016.6A.040

• 模式识别与图像处理 • 上一篇    下一篇

基于视觉显著性的多视点纹理视频编码算法

罗晓林,罗雷   

  1. 重庆交通科研设计研究院 重庆400065,重庆邮电大学通信与信息工程学院 重庆400065
  • 出版日期:2018-12-01 发布日期:2018-12-01
  • 基金资助:
    本文受国家自然科学基金(61501074),重庆市基础与前沿研究计划(cstc2015jcyjA40012),重庆市教委科学技术研究项目(KJ1500430)资助

Visual Saliency Based Multi-view Video Coding Algorithm

LUO Xiao-lin and LUO Lei   

  • Online:2018-12-01 Published:2018-12-01

摘要: 针对多视点视频的压缩问题,提出一种基于视觉显著性分析的编码算法。该算法根据人眼对显著性区域的失真更加敏感这一特性,通过控制显著性区域与非显著性区域的编码质量来有效提高多视点视频编码的效率。首先,利用融合颜色与运动信息的视频显著性滤波器提取出多视点视频图像像素级精度的视觉显著性图;然后,将所有视点视频的视觉显著性图转换为编码宏块的显著性表示;最后,利用感知视频编码的原理实现基于显著性的宏块质量自适应控制。实验结果表明,该算法有效地提高了多视点视频编码的率失真效率及主观视频质量。

关键词: 显著性,三维视频,码率分配,量化参数

Abstract: Towards the compression issue for multi-view video coding,a visual saliency based coding algorithm was proposed.Based on the fact that the human eyes are more sensitive to the distortion of the salient regions,the proposed method employed the controlling of the coding quality of the salient and non-salient regions to improve the multi-view video coding efficiency.First,pixel based visual saliency map of the multi-view video was extracted by the color and motion information fusion based video saliency filter.Then,the visual saliency map was transformed to the saliency representation of the coding macroblock.Finally,through the principle of the perceptual video coding,the coding quality of each macroblock was adaptively controlled based on its saliency representation.The experimental results demonstrate that the proposed method can effectively improve the rate-distortion performance and the subjective quality of the multi-view video coding.

Key words: Saliency,3D video,Rate allocation,Quantization parameter

[1] Wiegand T,Sullivan G J,Bjontegaard G,et al.Overview of the H.264/AVC video coding standard[J].IEEE Transaction on Circuits and Systems for Video Technology,2003,13(7):560-576
[2] Sullivan G J,Ohm J R,Han W J,et al.Overview of the High efficiency video coding (HEVC) standard[J].IEEE Transaction on Circuits and Systems for Video Technology,2012,22(12):1649-1667
[3] Vetro A,Wiegand T,Sullivan G J.Overview of the stereo and multiview video coding,extensions of the H.264/AVC standard [J].Proceedings of the IEEE,2011,99(4):626-642
[4] Merkle P,Smolic A,Muller K,et al.Efficient prediction structure for Multiview video video[J].IEEE Transaction on Circuits and Systems for Video Technology,2007,17(11):1461-1473
[5] Qin Yao,Lu Hu-chuan,Xu Yi-qun,et al.Saliency detection via cellular automata[C]∥IEEE International Conference on Computer Vision and Pattern Recognition (CVPR).2015:110-119
[6] Hadizadeh H,Bajic I V.Saliency-aware video compression[J].IEEE Transaction on Image Processing,2014,23(1):19-33
[7] Zhang Y,Jang G Y,Yu M,et al.Depth perceptual region-of-interest based multiview video coding[J].Journal of Visual Communication and Image Representation,2010,21(5):498-512
[8] Chen Z,Guillemot C.Perceptually-friendly H.264/AVC video coding based on foveated just-noticeable-distortion model[J].IEEE Transactions on Circuits and Systems for Video Technology,2010,20(6):806-819
[9] 罗雷,蒋荣欣,田翔,等.融合颜色与运动信息的视频显著性滤波器[J].华中科技大学学报(自然科学版),2014,42(2):81-85
[10] ISO/IEC MPEG&ITU-T VCEG,Draft Reference Software for MVC[S].Doc.JVT-AE207,Lundon,UK,2009
[11] Song H,Kuo C J.A region-based H.263+ codec and its rate control for low VBR video[J].IEEE Transactions on Multimedia,2004,6(3):489-500

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!